00000001:02000400:3.0F:1789265056.074140:0:3298:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg349-server.virtnet: executing set_hostid 00000001:02000400:3.0:1789265073.260289:0:3519:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg349-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1789265075.271979:0:3581:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 621 MB/s 00000001:01000000:1.0:1789265075.522303:0:3581:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 649 MB/s 00000001:01000000:3.0:1789265075.774210:0:3581:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5278 MB/s 00000020:02000000:0.0F:1789265076.588959:0:3610:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_105_g2595dd0 00000400:02000000:0.0:1789265077.335804:0:3625:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.149@tcp [8/256/0/180] 00008000:02000000:3.0:1789265080.587644:0:3775:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1789265134.785449:0:5743:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg349-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789265146.029624:0:6493:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789265146.029629:0:6493:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1789265146.029630:0:6493:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789265146.029771:0:6493:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000491fdb6f 00000080:02000400:0.0:1789265146.029781:0:6493:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1789265146.045053:0:6493:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1789265146.045069:0:6493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789265146.045101:0:6493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000004db78d16) 00000020:00000080:0.0:1789265146.047286:0:6493:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789265146.135765:0:6493:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789265146.135915:0:6493:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1789265146.162370:0:6493:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789265146.162604:0:6493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789265146.162611:0:6493:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789265146.162622:0:6493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9272d942b4a96110 00000020:01000004:1.0:1789265146.162628:0:6493:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1789265146.162633:0:6493:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789265146.162637:0:6493:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000491fdb6f from MGS 00000020:01000004:1.0:1789265146.162641:0:6493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789265146.162658:0:6493:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000061f33b74) 00000020:00000080:1.0:1789265146.162669:0:6493:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789265146.162767:0:6493:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000491fdb6f from MGS, refs=2 00080000:01000000:1.0:1789265146.162773:0:6493:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789265146.162779:0:6493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9272d942b4a9611e 00000100:00100000:1.0:1789265146.162880:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789265146.163286:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789265146.163293:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789265146.164866:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789265146.164877:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789265146.166552:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265146.167184:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789265146.167191:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789265146.170693:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789265146.170715:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789265146.172722:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789265146.172735:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789265146.175776:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265146.175782:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265146.175784:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265146.176872:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265146.176876:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265146.176877:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265146.178186:0:6493:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789265146.188325:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1789265146.427256:0:6493:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2695 MB/s 00000001:01000000:3.0:1789265146.677176:0:6493:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3127 MB/s 00000001:01000000:2.0F:1789265146.927606:0:6493:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 727 MB/s 00000001:01000000:3.0:1789265147.177584:0:6493:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 859 MB/s 00080000:10000000:2.0:1789265147.183133:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1789265147.196535:0:6493:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1789265147.197661:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789265147.197710:0:6493:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789265147.197745:0:6493:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1789265147.197894:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789265147.197914:0:6493:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789265147.198330:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789265147.198502:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789265147.198509:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789265147.203321:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789265147.203337:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789265147.204836:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789265147.204847:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00010000:00010000:2.0:1789265147.205533:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789265147.212169:0:6493:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789265147.212195:0:6493:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.149@tcp' 00000020:01000004:0.0:1789265147.212197:0:6493:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789265147.212259:0:6493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.149@tcp (typ=mgc) 00000020:00000080:0.0:1789265147.212271:0:6493:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.149@tcp (00000000759e82b2) 00000020:00000080:0.0:1789265147.212305:0:6493:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:3.0:1789265147.212314:0:6512:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:0.0:1789265147.212385:0:6493:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000af024a3d@MGC192.168.203.149@tcp: add connection 192.168.203.149@tcp at head 00010000:00010000:0.0:1789265147.212553:0:6493:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.149@tcp-0 is initialized 00000040:01000000:0.0:1789265147.212559:0:6493:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.149@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789265147.218859:0:6513:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789265147.219135:0:6493:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.149@tcp (uuid c287aa82-1100-4c72-b927-3b8d47a88a15) 00000020:00000080:2.0:1789265147.219162:0:6493:0:(genops.c:1385:class_connect()) connect: client c287aa82-1100-4c72-b927-3b8d47a88a15, cookie 0x9272d942b4a9612c 00000100:00080000:2.0:1789265147.219175:0:6493:0:(import.c:510:import_select_connection()) MGC192.168.203.149@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789265147.219180:0:6493:0:(import.c:624:import_select_connection()) MGC192.168.203.149@tcp: import 00000000af024a3d using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265147.219228:0:6493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004f1a8abf x1876180417380480/t0(0) o250->MGC192.168.203.149@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789265147.219268:0:6493:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c287aa82-1100-4c72-b927-3b8d47a88a15->MGS 00000020:01000004:2.0:1789265147.219287:0:6493:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789265147.219291:0:6493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789265147.219311:0:6493:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000006a8f84b3) 00000020:00000080:2.0:1789265147.219323:0:6493:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789265147.219940:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f1a8abf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c287aa82-1100-4c72-b927-3b8d47a88a15:3640:1876180417380480:0@lo:250: 00000100:00100000:3.0:1789265147.222442:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265147.226417:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417380480 00000100:00100000:1.0:1789265147.226431:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417380480 00000100:00100000:1.0:1789265147.226469:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265147.226476:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042e34b86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3640:x1876180417380480:12345-0@lo:250: 00010000:00080000:1.0:1789265147.226915:0:6508:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c287aa82-1100-4c72-b927-3b8d47a88a15@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:1.0:1789265147.226953:0:6508:0:(genops.c:1385:class_connect()) connect: client c287aa82-1100-4c72-b927-3b8d47a88a15, cookie 0x9272d942b4a9613a 00000100:00080000:1.0:1789265147.227174:0:6508:0:(import.c:65:import_set_state_nolock()) 000000001e80763b : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265147.227420:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042e34b86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+5:3640:x1876180417380480:12345-0@lo:250: Request processed in 944us (4984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265147.227430:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265147.227486:0:3640:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.149@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789265147.227494:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.149@tcp: connect to target with instance 0 00000100:00080000:1.0:1789265147.227500:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.149@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789265147.227505:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789265147.227576:0:3640:0:(import.c:65:import_set_state_nolock()) 00000000af024a3d MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789265147.227579:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789265147.227589:0:3640:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789265147.227593:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f1a8abf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c287aa82-1100-4c72-b927-3b8d47a88a15:3640:1876180417380480:0@lo:250: 00000100:00100000:2.0:1789265147.234382:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789265147.234593:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789265147.234599:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789265147.244247:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789265147.244262:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789265147.244742:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789265147.244749:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789265147.245576:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789265147.245756:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789265147.245761:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789265147.246472:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789265147.246481:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789265147.271830:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265147.272116:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789265147.272122:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789265147.272994:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789265147.273002:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789265147.273677:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265147.273842:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789265147.273848:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789265147.278283:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789265147.278298:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789265147.278909:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265147.279235:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789265147.279250:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789265147.279710:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789265147.279716:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789265147.280344:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265147.280499:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789265147.280504:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789265147.281018:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789265147.281197:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789265147.311017:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265147.311308:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789265147.311315:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789265147.313186:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789265147.313200:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789265147.314180:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789265147.314188:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789265147.315091:0:6493:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789265147.315119:0:6493:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1789265147.315131:0:6493:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.149@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789265147.315221:0:6493:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.149@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789265147.315262:0:6493:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.149@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1789265147.315266:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789265147.315268:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789265147.315269:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265147.315271:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265147.315272:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265147.315273:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265147.315274:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789265147.315276:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789265147.315277:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789265147.315278:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789265147.315280:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265147.315281:0:6493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789265147.315283:0:6493:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1789265147.315285:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789265147.315286:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789265147.315287:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265147.315288:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265147.315289:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265147.315290:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265147.315291:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789265147.315292:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789265147.315293:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789265147.315293:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789265147.315294:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265147.315295:0:6493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789265147.315333:0:6493:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789265147.315414:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005dd5f5e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417380608:0@lo:253: 00000100:00100000:0.0:1789265147.315501:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265147.315589:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000097fd1c91 going to sleep for 11 seconds 00000100:00100000:1.0:1789265147.315632:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417380608 00000100:00100000:1.0:1789265147.315639:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417380608 00000100:00100000:1.0:1789265147.315782:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265147.315791:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8ba883 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+5:6493:x1876180417380608:12345-0@lo:253: 20000000:01000000:1.0:1789265147.315829:0:6511:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789265147.315831:0:6511:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1789265147.316164:0:6532:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789265147.316204:0:6511:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1789265147.316542:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265147.323600:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1789265147.326559:0:6511:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789265147.326566:0:6511:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1789265147.326571:0:6511:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1789265147.326574:0:6511:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1789265147.326586:0:6511:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1789265147.327740:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265147.329475:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1789265147.329506:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789265147.329535:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1789265147.329549:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1789265147.329563:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1789265147.329637:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1789265147.329645:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1789265147.330214:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1789265147.330226:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1789265147.330251:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1789265147.330257:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1789265147.330270:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1789265147.330285:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1789265147.330333:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789265147.330339:0:6511:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1789265147.330347:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265147.331289:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1789265147.331320:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789265147.331338:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1789265147.331789:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1789265147.331812:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1789265147.331824:0:6511:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1789265147.331860:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1789265147.331868:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789265147.331881:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1789265147.332181:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1789265147.332200:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1789265147.332209:0:6511:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1789265147.332234:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1789265147.332254:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1789265147.332268:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1789265147.332284:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1789265147.333846:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1789265147.333871:0:6511:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1789265147.333879:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1789265147.336787:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1789265147.337283:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1789265147.337320:0:6511:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.149@tcp for mdt 20000000:01000000:3.0:1789265147.337322:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.149@tcp (null) (null) (null) 00000040:00080000:3.0:1789265147.337363:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1789265147.337371:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789265147.337386:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1789265147.337392:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.149@tcp (null) (null) 00000040:00080000:3.0:1789265147.337406:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1789265147.337413:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789265147.337425:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1789265147.337438:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1789265147.337467:0:6511:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789265147.337470:0:6511:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789265147.337474:0:6511:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789265147.337530:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789265147.337532:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789265147.338220:0:6535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1789265147.338521:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1789265147.338545:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1789265147.338561:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1789265147.338569:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789265147.338571:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789265147.338958:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1789265147.339170:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1789265147.339189:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1789265147.339203:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1789265147.339214:0:6511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789265147.339216:0:6511:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1789265147.339221:0:6511:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789265147.339223:0:6511:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789265147.339235:0:6511:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789265147.339250:0:6511:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789265147.339638:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1789265147.339821:0:6511:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789265147.347974:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1789265147.348013:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1789265147.348451:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1789265147.348475:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789265147.348496:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000458a334f/0x9272d942b4a96141 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.348517:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000458a334f/0x9272d942b4a96141 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.348526:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000458a334f/0x9272d942b4a96141 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.348531:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000458a334f/0x9272d942b4a96141 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.348538:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000458a334f/0x9272d942b4a96141 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.348545:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000458a334f/0x9272d942b4a96141 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.348550:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000458a334f already unused, calling callback (00000000ff461ba4) 00010000:00010000:2.0:1789265147.348553:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000458a334f/0x9272d942b4a96141 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.348561:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000458a334f/0x9272d942b4a96141 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.348572:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000458a334f/0x9272d942b4a96141 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.348580:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000458a334f/0x9272d942b4a96141 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.348586:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000458a334f/0x9272d942b4a96141 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789265147.348613:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789265147.360542:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8ba883 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+5:6493:x1876180417380608:12345-0@lo:253: Request processed in 44744us (45033us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265147.360559:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265147.360610:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005dd5f5e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417380608:0@lo:253: 10000000:01000000:0.0:1789265147.360640:0:6493:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789265147.360643:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789265147.360645:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789265147.360646:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265147.360647:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1789265147.360648:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265147.360649:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265147.360651:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789265147.360653:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789265147.360654:0:6493:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789265147.360655:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265147.360656:0:6493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789265147.360674:0:6493:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000491fdb6f from lustre-MDT0000 10000000:01000000:0.0:1789265147.360703:0:6493:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789265147.360706:0:6493:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789265147.360711:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9fcc83f119b8 10000000:01000000:0.0:1789265147.360714:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789265147.360721:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fcc83f119b8 from 1 10000000:01000000:0.0:1789265147.360724:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789265147.360758:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: 00000000ff86d7ac/0x9272d942b4a96148 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265147.360768:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: 00000000ff86d7ac/0x9272d942b4a96148 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265147.360777:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: 00000000ff86d7ac/0x9272d942b4a96148 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265147.360795:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005dd5f5e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417380736:0@lo:101: 00000100:00100000:0.0:1789265147.360833:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265147.360911:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417380736 00000100:00100000:1.0:1789265147.360917:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417380736 00000100:00100000:1.0:1789265147.360962:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265147.360970:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6874101 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+5:6493:x1876180417380736:12345-0@lo:101: 00010000:00010000:1.0:1789265147.360981:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265147.360995:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000044ac9794/0x9272d942b4a9614f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96148 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265147.361016:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000044ac9794/0x9272d942b4a9614f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96148 expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265147.361043:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000044ac9794/0x9272d942b4a9614f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96148 expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265147.361051:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000044ac9794, rc 0) 00000100:00100000:1.0:1789265147.361084:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6874101 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+6:6493:x1876180417380736:12345-0@lo:101: Request processed in 116us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265147.361090:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789265147.373675:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000006efb85fa going to sleep for 11 seconds 00000100:00100000:0.0:1789265147.373727:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005dd5f5e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417380736:0@lo:101: 00010000:00010000:0.0:1789265147.373768:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: 00000000ff86d7ac/0x9272d942b4a96148 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9614f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265147.373790:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: 00000000ff86d7ac/0x9272d942b4a96148 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9614f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265147.373890:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005dd5f5e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417380864:0@lo:501: 00000100:00100000:0.0:1789265147.374209:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265147.374266:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000006efb85fa going to sleep for 11 seconds 00000100:00100000:2.0:1789265147.374845:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417380864 00000100:00100000:2.0:1789265147.374856:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417380864 00000100:00100000:2.0:1789265147.374916:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265147.374924:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4ac175d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+6:6493:x1876180417380864:12345-0@lo:501: 00000100:00100000:2.0:1789265147.375067:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4ac175d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+6:6493:x1876180417380864:12345-0@lo:501: Request processed in 144us (859us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789265147.375075:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789265147.375209:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005dd5f5e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417380864:0@lo:501: 10000000:01000000:0.0:1789265147.375254:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789265147.375272:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: 00000000ff86d7ac/0x9272d942b4a96148 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9614f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265147.375281:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: 00000000ff86d7ac/0x9272d942b4a96148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9614f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265147.375291:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fcc8a583000 10000000:01000000:0.0:1789265147.375296:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789265147.375300:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fcc8a583000 10000000:01000000:0.0:1789265147.375303:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789265147.375307:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fcc8a583000 from 1 10000000:01000000:0.0:1789265147.375310:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789265147.375335:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: 0000000073c14378/0x9272d942b4a96156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265147.375342:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: 0000000073c14378/0x9272d942b4a96156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265147.375367:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: 0000000073c14378/0x9272d942b4a96156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265147.375381:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005dd5f5e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417380992:0@lo:101: 00000100:00100000:0.0:1789265147.375410:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265147.375441:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000006efb85fa going to sleep for 11 seconds 00000100:00100000:2.0:1789265147.375495:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417380992 00000100:00100000:2.0:1789265147.375500:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417380992 00000100:00100000:2.0:1789265147.375532:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789265147.375538:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af77bd01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+6:6493:x1876180417380992:12345-0@lo:101: 00010000:00010000:2.0:1789265147.375546:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265147.375559:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000458a334f/0x9272d942b4a9615d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96156 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.375911:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000458a334f/0x9272d942b4a9615d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96156 expref: 7 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.375921:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000458a334f/0x9272d942b4a9615d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96156 expref: 7 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.375927:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000458a334f, rc 0) 00000100:00100000:2.0:1789265147.375967:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af77bd01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+7:6493:x1876180417380992:12345-0@lo:101: Request processed in 429us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265147.375973:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265147.376352:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005dd5f5e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417380992:0@lo:101: 00010000:00010000:0.0:1789265147.376366:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: 0000000073c14378/0x9272d942b4a96156 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9615d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265147.376374:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: 0000000073c14378/0x9272d942b4a96156 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9615d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265147.376389:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789265147.376399:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: 0000000073c14378/0x9272d942b4a96156 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9615d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265147.376405:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: 0000000073c14378/0x9272d942b4a96156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9615d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265147.376411:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789265147.376415:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789265147.376420:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fcc8a583000 10000000:01000000:0.0:1789265147.376422:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789265147.376426:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789265147.376428:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789265147.376445:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: 000000008e09bcca/0x9272d942b4a96164 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265147.376460:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: 000000008e09bcca/0x9272d942b4a96164 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265147.376467:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: 000000008e09bcca/0x9272d942b4a96164 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265147.376479:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005dd5f5e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417381120:0@lo:101: 00000100:00100000:0.0:1789265147.376509:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265147.376540:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000006efb85fa going to sleep for 11 seconds 00000100:00100000:2.0:1789265147.376650:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417381120 00000100:00100000:2.0:1789265147.376661:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417381120 00000100:00100000:2.0:1789265147.376706:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265147.376713:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a476917e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+7:6493:x1876180417381120:12345-0@lo:101: 00010000:00010000:2.0:1789265147.376721:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265147.376731:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000ae68594/0x9272d942b4a9616b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96164 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.376747:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000ae68594/0x9272d942b4a9616b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96164 expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.376755:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000ae68594/0x9272d942b4a9616b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96164 expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.376761:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000ae68594, rc 0) 00000100:00100000:2.0:1789265147.376850:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a476917e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+8:6493:x1876180417381120:12345-0@lo:101: Request processed in 137us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265147.376856:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265147.378208:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005dd5f5e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417381120:0@lo:101: 00010000:00010000:0.0:1789265147.378232:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: 000000008e09bcca/0x9272d942b4a96164 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9616b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265147.378252:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: 000000008e09bcca/0x9272d942b4a96164 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9616b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265147.378325:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005dd5f5e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417381248:0@lo:501: 00000100:00100000:0.0:1789265147.378372:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265147.378463:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000006efb85fa going to sleep for 11 seconds 00000100:00100000:2.0:1789265147.378506:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417381248 00000100:00100000:2.0:1789265147.378511:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417381248 00000100:00100000:2.0:1789265147.379262:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265147.379274:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c388be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+8:6493:x1876180417381248:12345-0@lo:501: 00000100:00100000:2.0:1789265147.379419:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c388be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+9:6493:x1876180417381248:12345-0@lo:501: Request processed in 148us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265147.379426:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265147.379497:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005dd5f5e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417381248:0@lo:501: 00000100:00100000:0.0:1789265147.379534:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005dd5f5e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417381376:0@lo:503: 00000100:00100000:0.0:1789265147.379591:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265147.380104:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000006efb85fa going to sleep for 11 seconds 00000100:00100000:3.0:1789265147.380286:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417381376 00000100:00100000:3.0:1789265147.380292:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417381376 00000100:00100000:1.0:1789265147.380343:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789265147.380364:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb1a1158 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+9:6493:x1876180417381376:12345-0@lo:503: 00000100:00100000:1.0:1789265147.380469:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb1a1158 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+9:6493:x1876180417381376:12345-0@lo:503: Request processed in 119us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265147.380476:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265147.380509:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005dd5f5e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417381376:0@lo:503: 00000100:00100000:3.0:1789265147.382604:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e915c40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:6538:1876180417381504:0@lo:502: 00000100:00100000:3.0:1789265147.383134:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265147.383180:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417381504 00000100:00100000:3.0:1789265147.383181:0:6538:0:(client.c:2715:ptlrpc_set_wait()) set 000000000328f52f going to sleep for 11 seconds 00000100:00100000:2.0:1789265147.383188:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417381504 00000100:00100000:2.0:1789265147.383248:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789265147.383256:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000af8ae90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+9:6538:x1876180417381504:12345-0@lo:502: 00000100:00100000:2.0:1789265147.383368:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000af8ae90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+9:6538:x1876180417381504:12345-0@lo:502: Request processed in 113us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265147.383381:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265147.383460:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e915c40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:6538:1876180417381504:0@lo:502: 00000020:01000000:3.0:1789265147.383488:0:6538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265147.383499:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265147.383502:0:6538:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789265147.383506:0:6538:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789265147.383510:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265147.383530:0:6538:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000049af3cb9) 00000020:00000080:3.0:1789265147.383554:0:6538:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789265147.383561:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789265147.383633:0:6538:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789265147.383639:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9272d942b4a96179 00000020:00000080:3.0:1789265147.383855:0:6538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789265147.383859:0:6538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265147.383863:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265147.383864:0:6538:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789265147.383867:0:6538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265147.383870:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265147.383871:0:6538:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789265147.383874:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265147.383880:0:6538:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000af188d32) 00000020:00000080:3.0:1789265147.383889:0:6538:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789265147.383893:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789265147.383900:0:6538:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789265147.383902:0:6538:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789265147.383909:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789265147.383957:0:6538:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000491fdb6f from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789265147.383970:0:6538:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000001425edd) 00000020:00000080:3.0:1789265147.383978:0:6538:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789265147.384079:0:6538:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789265147.384085:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9272d942b4a9618e 00000020:00000080:3.0:1789265147.384178:0:6538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789265147.384184:0:6538:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789265147.384188:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9272d942b4a96195 00080000:01000000:3.0:1789265147.384193:0:6538:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789265147.384195:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9272d942b4a9619c 00080000:10000000:3.0:1789265147.385826:0:6538:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1789265147.385996:0:6538:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789265147.405144:0:6538:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789265147.481305:0:6538:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789265147.481804:0:6538:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789265147.484335:0:6538:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789265147.484609:0:6538:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789265147.486641:0:6538:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000000eab452e) 00000020:00000080:3.0:1789265147.486665:0:6538:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789265147.486740:0:6538:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789265147.486747:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9272d942b4a961aa 00000020:00000080:2.0:1789265147.487546:0:6538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1789265147.488511:0:6538:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1789265147.491694:0:6538:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1789265147.495912:0:6538:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1789265147.500657:0:6538:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1789265147.504330:0:6538:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1789265147.506584:0:6538:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1789265147.510735:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9272d942b4a961b1 00000020:00000080:3.0:1789265147.513553:0:6538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789265147.513580:0:6538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265147.513586:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265147.513588:0:6538:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789265147.513591:0:6538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265147.513594:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265147.513595:0:6538:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789265147.513597:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789265147.513599:0:6538:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789265147.513601:0:6538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265147.513603:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265147.513604:0:6538:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789265147.513606:0:6538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265147.513610:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265147.513612:0:6538:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789265147.513615:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789265147.513664:0:6538:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1789265147.513715:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e915c40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:6538:1876180417381632:0@lo:502: 00000100:00100000:3.0:1789265147.513790:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265147.513846:0:6538:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f325a6a5 going to sleep for 11 seconds 00000100:00100000:1.0:1789265147.513853:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417381632 00000100:00100000:1.0:1789265147.513864:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417381632 00000100:00100000:1.0:1789265147.513972:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789265147.513980:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c10f82cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+9:6538:x1876180417381632:12345-0@lo:502: 00000100:00100000:1.0:1789265147.515014:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c10f82cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+9:6538:x1876180417381632:12345-0@lo:502: Request processed in 1031us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265147.515042:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789265147.515336:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e915c40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:6538:1876180417381632:0@lo:502: 00000020:01000000:2.0:1789265147.515375:0:6538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265147.515381:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265147.515383:0:6538:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1789265147.515389:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1789265147.515577:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1789265147.515600:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789265147.515621:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: 000000008e09bcca/0x9272d942b4a96164 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9616b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265147.515632:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: 000000008e09bcca/0x9272d942b4a96164 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9616b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265147.515640:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fcc8a583000 from 1 10000000:01000000:1.0:1789265147.515643:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789265147.515689:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: 0000000073ce4217/0x9272d942b4a961b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265147.516197:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: 0000000073ce4217/0x9272d942b4a961b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265147.516218:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: 0000000073ce4217/0x9272d942b4a961b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265147.516246:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d4cdaef2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417381760:0@lo:101: 00000100:00100000:1.0:1789265147.516306:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265147.516340:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f02b2a2b going to sleep for 11 seconds 00000100:00100000:2.0:1789265147.516364:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417381760 00000100:00100000:2.0:1789265147.516371:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417381760 00000100:00100000:2.0:1789265147.516412:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789265147.516420:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000484a7647 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+9:6493:x1876180417381760:12345-0@lo:101: 00010000:00010000:2.0:1789265147.516430:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265147.516443:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000059a2d81a/0x9272d942b4a961bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a961b8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.516464:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000059a2d81a/0x9272d942b4a961bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a961b8 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.516474:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000059a2d81a/0x9272d942b4a961bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a961b8 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.516483:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000059a2d81a, rc 0) 00000100:00100000:2.0:1789265147.516527:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000484a7647 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+10:6493:x1876180417381760:12345-0@lo:101: Request processed in 108us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265147.516533:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265147.516587:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d4cdaef2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417381760:0@lo:101: 00010000:00010000:1.0:1789265147.516599:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: 0000000073ce4217/0x9272d942b4a961b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a961bf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265147.516607:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: 0000000073ce4217/0x9272d942b4a961b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a961bf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265147.517179:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d4cdaef2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417381888:0@lo:256: 00000100:00100000:1.0:1789265147.517234:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265147.517274:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f02b2a2b going to sleep for 11 seconds 00000100:00100000:3.0:1789265147.517444:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417381888 00000100:00100000:3.0:1789265147.517450:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417381888 00000100:00100000:3.0:1789265147.517485:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789265147.517492:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000adea138a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+10:6493:x1876180417381888:12345-0@lo:256: 20000000:01000000:3.0:1789265147.517506:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789265147.517512:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789265147.517745:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000adea138a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+10:6493:x1876180417381888:12345-0@lo:256: Request processed in 253us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265147.517752:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789265147.517911:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d4cdaef2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417381888:0@lo:256: 10000000:01000000:2.0:1789265147.518675:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789265147.518747:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: 0000000073ce4217/0x9272d942b4a961b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a961bf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.518757:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: 0000000073ce4217/0x9272d942b4a961b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a961bf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265147.518766:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fcc8a583000 from 1 10000000:01000000:2.0:1789265147.518768:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265147.518802:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: 0000000003b67a21/0x9272d942b4a961c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.518808:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: 0000000003b67a21/0x9272d942b4a961c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.518815:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: 0000000003b67a21/0x9272d942b4a961c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265147.518832:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002237710d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417382016:0@lo:101: 00000100:00100000:2.0:1789265147.518881:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265147.518914:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000000fbee985 going to sleep for 11 seconds 00000100:00100000:3.0:1789265147.519044:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417382016 00000100:00100000:3.0:1789265147.519050:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417382016 00000100:00100000:3.0:1789265147.519087:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789265147.519101:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa3f598f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+10:6493:x1876180417382016:12345-0@lo:101: 00010000:00010000:3.0:1789265147.519111:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265147.519122:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000053508460/0x9272d942b4a961cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a961c6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.519138:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000053508460/0x9272d942b4a961cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a961c6 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.519146:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000053508460/0x9272d942b4a961cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a961c6 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.519153:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000053508460, rc 0) 00000100:00100000:3.0:1789265147.519186:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa3f598f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+11:6493:x1876180417382016:12345-0@lo:101: Request processed in 85us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265147.519192:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789265147.519317:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002237710d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417382016:0@lo:101: 00010000:00010000:2.0:1789265147.519330:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: 0000000003b67a21/0x9272d942b4a961c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a961cd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.519337:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: 0000000003b67a21/0x9272d942b4a961c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a961cd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265147.519452:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002237710d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417382144:0@lo:501: 00000100:00100000:2.0:1789265147.519478:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265147.519508:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000000fbee985 going to sleep for 11 seconds 00000100:00100000:3.0:1789265147.519622:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417382144 00000100:00100000:3.0:1789265147.519626:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417382144 00000100:00100000:3.0:1789265147.519654:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265147.519660:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000676c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+11:6493:x1876180417382144:12345-0@lo:501: 00000100:00100000:3.0:1789265147.519810:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000676c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+11:6493:x1876180417382144:12345-0@lo:501: Request processed in 150us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265147.519817:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789265147.520018:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002237710d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417382144:0@lo:501: 00000100:00100000:2.0:1789265147.520069:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002237710d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417382272:0@lo:503: 00000100:00100000:2.0:1789265147.520106:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265147.520121:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000000fbee985 going to sleep for 11 seconds 00000100:00100000:3.0:1789265147.520179:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417382272 00000100:00100000:3.0:1789265147.520184:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417382272 00000100:00100000:3.0:1789265147.520209:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789265147.520216:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca5269cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+11:6493:x1876180417382272:12345-0@lo:503: 00000040:00080000:3.0:1789265147.520262:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265147.520338:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca5269cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+11:6493:x1876180417382272:12345-0@lo:503: Request processed in 122us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265147.520359:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789265147.520560:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002237710d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417382272:0@lo:503: 00000040:00080000:0.0:1789265147.522187:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789265147.522469:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789265147.522489:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265147.522530:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: 0000000003b67a21/0x9272d942b4a961c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a961cd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.522541:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: 0000000003b67a21/0x9272d942b4a961c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a961cd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265147.522585:0:6493:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789265147.522587:0:6493:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fcc8a583000 10000000:01000000:2.0:1789265147.522590:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fcc8a583000 10000000:01000000:2.0:1789265147.522593:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789265147.522599:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fcc8a583000 from 1 10000000:01000000:2.0:1789265147.522601:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789265147.522628:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: 00000000060d94a4/0x9272d942b4a961d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.522635:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: 00000000060d94a4/0x9272d942b4a961d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.522644:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: 00000000060d94a4/0x9272d942b4a961d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265147.522660:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002237710d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417382400:0@lo:101: 00000100:00100000:2.0:1789265147.522713:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265147.522746:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000003c6fd4db going to sleep for 11 seconds 00000100:00100000:3.0:1789265147.522934:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417382400 00000100:00100000:3.0:1789265147.522941:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417382400 00000100:00100000:3.0:1789265147.522980:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789265147.522987:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4bc1893 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+11:6493:x1876180417382400:12345-0@lo:101: 00010000:00010000:3.0:1789265147.522998:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265147.523008:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eb74d500/0x9272d942b4a961db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a961d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.523057:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eb74d500/0x9272d942b4a961db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a961d4 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.523066:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eb74d500/0x9272d942b4a961db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a961d4 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.523074:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eb74d500, rc 0) 00000100:00100000:3.0:1789265147.523106:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4bc1893 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+12:6493:x1876180417382400:12345-0@lo:101: Request processed in 120us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265147.523112:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789265147.523302:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002237710d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417382400:0@lo:101: 00010000:00010000:2.0:1789265147.523314:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: 00000000060d94a4/0x9272d942b4a961d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a961db expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.523322:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: 00000000060d94a4/0x9272d942b4a961d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a961db expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265147.523430:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002237710d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417382528:0@lo:501: 00000100:00100000:2.0:1789265147.523453:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265147.523477:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000003c6fd4db going to sleep for 11 seconds 00000100:00100000:3.0:1789265147.523512:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417382528 00000100:00100000:3.0:1789265147.523516:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417382528 00000100:00100000:3.0:1789265147.523540:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789265147.523545:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d46d2477 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+12:6493:x1876180417382528:12345-0@lo:501: 00000100:00100000:3.0:1789265147.523700:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d46d2477 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+12:6493:x1876180417382528:12345-0@lo:501: Request processed in 154us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265147.523707:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789265147.523873:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002237710d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417382528:0@lo:501: 00000100:00100000:0.0:1789265147.523898:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005dd5f5e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417382656:0@lo:503: 00000100:00100000:0.0:1789265147.523935:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265147.523978:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000011bb2992 going to sleep for 11 seconds 00000100:00100000:1.0:1789265147.524004:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417382656 00000100:00100000:1.0:1789265147.524008:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417382656 00000100:00100000:1.0:1789265147.524155:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789265147.524162:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa0b8eab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+12:6493:x1876180417382656:12345-0@lo:503: 00000100:00100000:0.0:1789265147.524318:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005dd5f5e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417382656:0@lo:503: 00000100:00100000:1.0:1789265147.524459:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa0b8eab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+12:6493:x1876180417382656:12345-0@lo:503: Request processed in 296us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265147.524466:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789265147.524746:0:6543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005dd5f5e5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:6543:1876180417382784:0@lo:502: 00000100:00100000:0.0:1789265147.524847:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265147.524879:0:6543:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b5c9a2a0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265147.524918:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417382784 00000100:00100000:2.0:1789265147.524922:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417382784 00000100:00100000:2.0:1789265147.524954:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789265147.524961:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac400f4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+12:6543:x1876180417382784:12345-0@lo:502: 00000100:00100000:2.0:1789265147.525069:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac400f4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+12:6543:x1876180417382784:12345-0@lo:502: Request processed in 109us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265147.525076:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789265147.525150:0:6543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005dd5f5e5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:6543:1876180417382784:0@lo:502: 00000020:01000004:1.0:1789265147.525215:0:6543:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789265147.525229:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000921869f6) 00000020:00000080:1.0:1789265147.525260:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1789265147.525325:0:6543:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000491fdb6f from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789265147.525330:0:6543:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000491fdb6f from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789265147.525332:0:6543:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000491fdb6f 4 00010000:00080000:1.0:1789265147.525460:0:6543:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000024f7f8c6@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.149@tcp at head 00010000:00010000:1.0:1789265147.527713:0:6543:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1789265147.528050:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789265147.528091:0:6543:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789265147.528101:0:6543:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9272d942b4a961e9 00000100:00080000:1.0:1789265147.528110:0:6543:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789265147.528114:0:6543:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000024f7f8c6 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:1.0:1789265147.528145:0:6543:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000032babda4 x1876180417382912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265147.528170:0:6543:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789265147.528365:0:6543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004c8f1ac6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:6543:1876180417383040:0@lo:502: 00000100:00100000:1.0:1789265147.528435:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265147.528467:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417383040 00000100:00100000:1.0:1789265147.528472:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417383040 00000100:00100000:1.0:1789265147.528501:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789265147.528507:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080bb0d1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+12:6543:x1876180417383040:12345-0@lo:502: 00000100:00100000:1.0:1789265147.528599:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080bb0d1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+12:6543:x1876180417383040:12345-0@lo:502: Request processed in 91us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265147.528607:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789265147.528650:0:6543:0:(client.c:2715:ptlrpc_set_wait()) set 0000000047fddcf8 going to sleep for 11 seconds 00000100:00100000:1.0:1789265147.528673:0:6543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004c8f1ac6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:6543:1876180417383040:0@lo:502: 00000040:00080000:1.0:1789265147.528695:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:2.0:1789265147.529047:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032babda4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876180417382912:0@lo:38: 00000100:00100000:2.0:1789265147.529088:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1789265147.529126:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1789265147.529151:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789265147.529166:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: 00000000060d94a4/0x9272d942b4a961d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a961db expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.529176:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: 00000000060d94a4/0x9272d942b4a961d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a961db expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789265147.529246:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789265147.529248:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789265147.529250:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265147.529251:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265147.529252:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265147.529254:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265147.529255:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789265147.529256:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789265147.529258:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789265147.529259:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789265147.529260:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265147.529261:0:6493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789265147.529266:0:6493:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1789265147.529268:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789265147.529269:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789265147.529270:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265147.529271:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265147.529272:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265147.529273:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265147.529274:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789265147.529274:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789265147.529275:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789265147.529276:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789265147.529277:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265147.529278:0:6493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789265147.529292:0:6493:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789265147.529300:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000037337773 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417383168:0@lo:253: 00000100:00100000:2.0:1789265147.529329:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265147.529342:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000000fbee985 going to sleep for 11 seconds 00000100:00100000:0.0:1789265147.529609:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417382912 00000100:00100000:0.0:1789265147.529616:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417382912 00000100:00100000:0.0:1789265147.529648:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265147.529653:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f990840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1876180417382912:12345-0@lo:38: 00000100:00100000:0.0:1789265147.529698:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f990840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1876180417382912:12345-0@lo:38: Request processed in 44us (611us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789265147.529704:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265147.529724:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417383168 00000100:00100000:0.0:1789265147.529727:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417383168 00000100:00100000:0.0:1789265147.529750:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789265147.529756:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5294bcb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+12:6493:x1876180417383168:12345-0@lo:253: 20000000:01000000:0.0:1789265147.529774:0:6511:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789265147.529797:0:6511:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789265147.530486:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789265147.530495:0:3640:0:(import.c:65:import_set_state_nolock()) 0000000024f7f8c6 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789265147.530500:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789265147.530503:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032babda4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876180417382912:0@lo:38: 20000000:01000000:1.0:1789265147.544661:0:6511:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789265147.544717:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789265147.545166:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5294bcb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+12:6493:x1876180417383168:12345-0@lo:253: Request processed in 15405us (15831us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265147.545180:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 20000000:01000000:3.0:1789265147.545549:0:6532:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789265147.545555:0:6532:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789265147.545578:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000022b654d4/0x9272d942b4a961f0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.545593:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000059a2d81a/0x9272d942b4a961bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a961b8 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.545600:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000022b654d4/0x9272d942b4a961f0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.545638:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000059a2d81a/0x9272d942b4a961bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a961b8 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.545651:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000059a2d81a/0x9272d942b4a961bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a961b8 expref: 11 pid: 6508 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265147.545663:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005abf98a0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876180417383296:0@lo:104: 00000100:00100000:3.0:1789265147.545700:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265147.545748:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b5dbfdb1 going to sleep for 11 seconds 00000100:00100000:2.0:1789265147.545876:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417383296 00000100:00100000:2.0:1789265147.545889:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417383296 00000100:00100000:2.0:1789265147.545930:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265147.545937:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000203575b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+3:6532:x1876180417383296:12345-0@lo:104: 00010000:00010000:2.0:1789265147.545947:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: 0000000073ce4217/0x9272d942b4a961b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a961bf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265147.545997:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265147.546001:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000203575b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+3:6532:x1876180417383296:12345-0@lo:104: Request processed in 66us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265147.546007:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265147.546159:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005abf98a0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876180417383296:0@lo:104: 00010000:00010000:1.0:1789265147.546176:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000022b654d4/0x9272d942b4a961f0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.546228:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265147.546246:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: 0000000073ce4217/0x9272d942b4a961b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a961bf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.546253:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000073ce4217 already unused, calling callback (00000000b05a377f) 10000000:00010000:3.0:1789265147.546256:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: 0000000073ce4217/0x9272d942b4a961b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a961bf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.546262:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: 0000000073ce4217/0x9272d942b4a961b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a961bf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265147.546267:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: 0000000073ce4217/0x9272d942b4a961b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a961bf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265147.546282:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789265147.546354:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: 0000000073ce4217/0x9272d942b4a961b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a961bf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.546362:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265147.546384:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: 0000000073ce4217/0x9272d942b4a961b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a961bf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.546391:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: 0000000073ce4217/0x9272d942b4a961b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a961bf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.546408:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265147.546410:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265147.546411:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265147.546490:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c78bc247 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417383424:0@lo:103: 00000100:00100000:1.0:1789265147.546523:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265147.546677:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417383424 00000100:00100000:3.0:1789265147.546682:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417383424 00010000:00010000:3.0:1789265147.546699:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000059a2d81a/0x9272d942b4a961bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a961b8 expref: 12 pid: 6508 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265147.546729:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265147.546735:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c8f1ac6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+12:3642:x1876180417383424:12345-0@lo:103: 00010000:00010000:3.0:1789265147.546744:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265147.546748:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000059a2d81a/0x9272d942b4a961bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a961b8 expref: 12 pid: 6508 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.546755:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000059a2d81a/0x9272d942b4a961bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a961b8 expref: 12 pid: 6508 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.546767:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000059a2d81a/0x9272d942b4a961bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a961b8 expref: 12 pid: 6508 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.546795:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000022b654d4/0x9272d942b4a961f0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.546802:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000022b654d4/0x9272d942b4a961f0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789265147.546814:0:6501:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001260488s 00010000:00010000:3.0:1789265147.546818:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000022b654d4/0x9272d942b4a961f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.546824:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000022b654d4/0x9272d942b4a961f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.546830:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000022b654d4/0x9272d942b4a961f0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.546835:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000022b654d4/0x9272d942b4a961f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.546840:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000022b654d4 already unused, calling callback (00000000ff461ba4) 00010000:00010000:3.0:1789265147.546844:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000022b654d4/0x9272d942b4a961f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.546850:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000022b654d4/0x9272d942b4a961f0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.546860:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000022b654d4/0x9272d942b4a961f0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265147.546868:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265147.546900:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c8f1ac6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+11:3642:x1876180417383424:12345-0@lo:103: Request processed in 167us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265147.546907:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265147.547059:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c78bc247 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417383424:0@lo:103: 00010000:00010000:1.0:1789265147.547077:0:6532:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000022b654d4/0x9272d942b4a961f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265147.547083:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000022b654d4/0x9272d942b4a961f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265147.547088:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000022b654d4/0x9272d942b4a961f0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265147.547462:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000037337773 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:6493:1876180417383168:0@lo:253: 10000000:01000000:0.0:1789265147.547475:0:6493:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789265147.547478:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789265147.547480:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789265147.547482:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265147.547483:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265147.547491:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265147.547492:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265147.547494:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789265147.547495:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789265147.547497:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789265147.547498:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789265147.547499:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265147.547500:0:6493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789265147.547509:0:6493:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789265147.553774:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1789265147.554210:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789265147.554525:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1789265147.554672:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789265147.555256:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1789265147.555483:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1789265147.556205:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1789265147.556440:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1789265147.556631:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1789265147.556863:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1789265147.557184:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1789265147.557416:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1789265147.567482:0:6493:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1789265147.587920:0:6493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789265147.588058:0:6548:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1789265147.588062:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789265147.588294:0:6549:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789265147.590509:0:6493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789265147.590631:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789265147.591458:0:6493:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789265147.591468:0:6493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789265147.591617:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789265147.599132:0:6493:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789265147.600198:0:6549:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789265147.602139:0:6493:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789265147.602214:0:6493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789265147.604561:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789265147.605619:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:0.0:1789265147.608202:0:6549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789265147.608288:0:6549:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789265147.608292:0:6549:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:2.0:1789265147.608606:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1789265147.608968:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1789265147.609196:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1789265147.609618:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1789265147.609767:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1789265147.609973:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1789265147.610427:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1789265147.610580:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1789265147.610712:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1789265147.611169:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1789265147.611417:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1789265147.611562:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1789265147.611690:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1789265147.611894:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1789265147.612189:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1789265147.612342:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1789265147.612690:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1789265147.612901:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789265147.613277:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789265147.613482:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789265147.613623:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789265147.613882:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1789265147.614015:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1789265147.614294:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1789265147.614499:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1789265147.614649:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789265147.614838:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789265147.615289:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1789265147.615518:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789265147.615701:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789265147.615902:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789265147.616148:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789265147.616338:0:6493:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1789265147.619121:0:6493:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789265147.619155:0:6493:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbf45c19ab988 00100000:10000000:2.0:1789265147.619162:0:6493:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789265147.619754:0:6493:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789265147.619767:0:6493:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.149@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789265147.619792:0:6493:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789265147.619806:0:6493:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1789265147.622596:0:6493:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265147.622760:0:6493:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1789265148.228221:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265149.249388:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265150.280410:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265151.297464:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789265151.751748:0:6794:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg349-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789265152.322417:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789265152.642942:0:6846:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789265152.643306:0:6846:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789265153.026417:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f79ba545 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417383552:0@lo:400: 00000100:00100000:0.0:1789265153.026493:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265153.027293:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417383552 00000100:00100000:3.0:1789265153.027301:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417383552 00000100:00100000:3.0:1789265153.027352:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789265153.027361:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005876bcf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+11:3643:x1876180417383552:12345-0@lo:400: 00000100:00080000:2.0:1789265153.028051:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789265153.028057:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789265153.028060:0:8:0:(import.c:65:import_set_state_nolock()) 0000000024f7f8c6 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265153.028067:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000024f7f8c6 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265153.028095:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000017d4a85c x1876180417383680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265153.028136:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017d4a85c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876180417383680:0@lo:38: 00000100:00100000:2.0:1789265153.028175:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265153.028451:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417383680 00000100:00100000:1.0:1789265153.028458:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417383680 00000100:00100000:1.0:1789265153.028492:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265153.028497:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078152df7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1876180417383680:12345-0@lo:38: 00010000:00080000:1.0:1789265153.028517:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:1.0:1789265153.028558:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9272d942b4a961f7 00000004:00100000:1.0:1789265153.028599:0:6518:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789265153.028716:0:6518:0:(import.c:65:import_set_state_nolock()) 00000000fd7b8285 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265153.028762:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078152df7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876180417383680:12345-0@lo:38: Request processed in 264us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265153.028769:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789265153.028845:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000017d4a85c x1876180417383680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789265153.028872:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789265153.028878:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789265153.028882:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789265153.028884:0:3640:0:(import.c:65:import_set_state_nolock()) 0000000024f7f8c6 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789265153.028888:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017d4a85c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876180417383680:0@lo:38: 00000100:00100000:3.0:1789265153.029081:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005876bcf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+11:3643:x1876180417383552:12345-0@lo:400: Request processed in 1720us (2587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265153.029090:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789265153.029730:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f79ba545 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417383552:0@lo:400: 00010000:00010000:3.0:1789265153.345555:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265154.371664:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789265155.157253:0:6947:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265155.157495:0:6947:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789265155.393462:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789265156.097113:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789265156.097121:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fcc8a583000 from 3 10000000:01000000:2.0:1789265156.097126:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789265156.097173:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: 0000000028461d62/0x9272d942b4a961fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265156.097197:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: 0000000028461d62/0x9272d942b4a961fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265156.097207:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: 0000000028461d62/0x9272d942b4a961fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265156.097235:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017d4a85c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417383808:0@lo:101: 00000100:00100000:2.0:1789265156.097308:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265156.097576:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 000000007a345f10 going to sleep for 11 seconds 00000100:00100000:1.0:1789265156.098579:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417383808 00000100:00100000:1.0:1789265156.098588:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417383808 00000100:00100000:1.0:1789265156.098647:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789265156.098656:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f225c9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+11:6513:x1876180417383808:12345-0@lo:101: 00010000:00010000:1.0:1789265156.098669:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265156.098686:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000073ce4217/0x9272d942b4a96205 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a961fe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265156.098709:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000073ce4217/0x9272d942b4a96205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a961fe expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265156.098719:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000073ce4217/0x9272d942b4a96205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a961fe expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265156.098726:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000073ce4217, rc 0) 00000100:00100000:1.0:1789265156.098786:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f225c9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+12:6513:x1876180417383808:12345-0@lo:101: Request processed in 132us (1479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265156.098793:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789265156.098962:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017d4a85c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417383808:0@lo:101: 00010000:00010000:2.0:1789265156.099007:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: 0000000028461d62/0x9272d942b4a961fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96205 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265156.099016:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: 0000000028461d62/0x9272d942b4a961fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96205 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265156.099100:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017d4a85c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417383936:0@lo:256: 00000100:00100000:2.0:1789265156.099148:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265156.099172:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 000000007a345f10 going to sleep for 11 seconds 00000100:00100000:3.0:1789265156.099521:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417383936 00000100:00100000:3.0:1789265156.099527:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417383936 00000100:00100000:3.0:1789265156.099558:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789265156.099563:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d1d0474 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+12:6513:x1876180417383936:12345-0@lo:256: 20000000:01000000:3.0:1789265156.099577:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789265156.099594:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789265156.099597:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1789265156.099690:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d1d0474 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+12:6513:x1876180417383936:12345-0@lo:256: Request processed in 125us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265156.099705:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265156.099837:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017d4a85c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417383936:0@lo:256: 10000000:01000000:2.0:1789265156.099881:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789265156.099888:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: 0000000028461d62/0x9272d942b4a961fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96205 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265156.099896:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: 0000000028461d62/0x9272d942b4a961fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96205 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265156.419168:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265157.441366:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265158.153937:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b833e29 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417384064:0@lo:400: 00000100:00100000:1.0:1789265158.154067:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265158.154240:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417384064 00000100:00100000:0.0:1789265158.154252:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417384064 00000100:00100000:0.0:1789265158.154322:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265158.154332:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c6478c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+12:3644:x1876180417384064:12345-0@lo:400: 00000100:00100000:3.0:1789265158.154498:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007fd60b19 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417384192:0@lo:400: 00000100:00100000:3.0:1789265158.154545:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265158.154668:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417384192 00000100:00100000:3.0:1789265158.154673:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417384192 00000100:00100000:3.0:1789265158.154707:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265158.154713:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003bbf914e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417384192:12345-0@lo:400: 00000100:00100000:3.0:1789265158.154753:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003bbf914e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417384192:12345-0@lo:400: Request processed in 40us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265158.154761:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789265158.155253:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007fd60b19 x1876180417384192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265158.155271:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007fd60b19 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417384192:0@lo:400: 00000100:00100000:0.0:1789265158.155435:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c6478c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+12:3644:x1876180417384064:12345-0@lo:400: Request processed in 1103us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265158.155446:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789265158.155579:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b833e29 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417384064:0@lo:400: 00010000:00010000:0.0:1789265158.465412:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265159.489856:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265160.514492:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265161.538292:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265162.562159:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265163.267328:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265163.267353:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017d4a85c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417384320:0@lo:400: 00000100:00100000:2.0:1789265163.267423:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265163.267489:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025222265 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417384448:0@lo:400: 00000100:00100000:2.0:1789265163.267517:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265163.267565:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417384320 00000100:00100000:2.0:1789265163.267573:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417384320 00000100:00100000:2.0:1789265163.267615:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789265163.267623:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f159525f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+12:3641:x1876180417384320:12345-0@lo:400: 00000100:00100000:2.0:1789265163.267670:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f159525f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+12:3641:x1876180417384320:12345-0@lo:400: Request processed in 48us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265163.267690:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789265163.267737:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417384448 00000100:00100000:2.0:1789265163.267741:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417384448 00000100:00100000:2.0:1789265163.267767:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265163.267773:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003bd2d9c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417384448:12345-0@lo:400: 00000100:00100000:2.0:1789265163.267810:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003bd2d9c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417384448:12345-0@lo:400: Request processed in 37us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265163.267816:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789265163.267862:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000025222265 x1876180417384448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265163.267875:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025222265 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417384448:0@lo:400: 00000100:00100000:2.0:1789265163.267902:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017d4a85c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417384320:0@lo:400: 00010000:00010000:3.0:1789265163.588084:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789265164.352457:0:7446:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789265164.352462:0:7446:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789265164.352463:0:7446:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789265164.352594:0:7446:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000097b6b08c 00000020:01000004:2.0:1789265164.352612:0:7446:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1789265164.352622:0:7446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789265164.352635:0:7446:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000aa79f182) 00000020:00000080:2.0:1789265164.352649:0:7446:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789265164.406297:0:7446:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1789265164.406379:0:7446:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1789265164.450001:0:7446:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789265164.450269:0:7446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1789265164.450278:0:7446:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789265164.450290:0:7446:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9272d942b4a96213 00000020:01000004:2.0:1789265164.450296:0:7446:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789265164.450318:0:7446:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.149@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789265164.450321:0:7446:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.149@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789265164.450327:0:7446:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1789265164.450362:0:7446:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1789265164.450366:0:7446:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.149@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1789265164.471413:0:7446:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.149@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789265164.471451:0:7446:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.149@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1789265164.471454:0:7446:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789265164.471456:0:7446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789265164.471457:0:7446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265164.471458:0:7446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265164.471459:0:7446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265164.471464:0:7446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265164.471465:0:7446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789265164.471466:0:7446:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789265164.471468:0:7446:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789265164.471469:0:7446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265164.471470:0:7446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789265164.471473:0:7446:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1789265164.471475:0:7446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789265164.471476:0:7446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789265164.471477:0:7446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265164.471477:0:7446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265164.471478:0:7446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265164.471479:0:7446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265164.471480:0:7446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789265164.471480:0:7446:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789265164.471481:0:7446:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789265164.471482:0:7446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265164.471482:0:7446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789265164.471516:0:7446:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789265164.471531:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007fd60b19 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417384576:0@lo:253: 00000100:00100000:3.0:1789265164.471594:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265164.471658:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a91255d1 going to sleep for 11 seconds 00000100:00100000:0.0:1789265164.471975:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417384576 00000100:00100000:0.0:1789265164.471983:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417384576 00000100:00100000:0.0:1789265164.472060:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789265164.472068:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e8a5eeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+12:7446:x1876180417384576:12345-0@lo:253: 20000000:01000000:0.0:1789265164.472095:0:6510:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789265164.472099:0:6510:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1789265164.472104:0:6510:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1789265164.472106:0:6510:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1789265164.472150:0:6510:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1789265164.472336:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265164.472459:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1789265164.472472:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789265164.472736:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1789265164.472755:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1789265164.472767:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1789265164.472812:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1789265164.472819:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1789265164.472829:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1789265164.472834:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1789265164.472843:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1789265164.472847:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1789265164.472856:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1789265164.472867:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1789265164.472941:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1789265164.472948:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.149@tcp (null) (null) (null) 00000040:00080000:0.0:1789265164.472959:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1789265164.472964:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789265164.472973:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1789265164.472984:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.149@tcp (null) (null) 00000040:00080000:0.0:1789265164.472995:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1789265164.472999:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789265164.473009:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1789265164.473153:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1789265164.473166:0:6510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1789265164.473249:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1789265164.473259:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1789265164.473272:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1789265164.473289:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1789265164.473306:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1789265164.473312:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1789265164.473324:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1789265164.473345:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1789265164.473351:0:6510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1789265164.473377:0:6510:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789265164.473383:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1789265164.473858:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1789265164.474208:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789265164.474227:0:6510:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.149@tcp for mdt 20000000:01000000:0.0:1789265164.474229:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.149@tcp (null) (null) (null) 00000040:00080000:0.0:1789265164.474246:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789265164.474252:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789265164.474264:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789265164.474269:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.149@tcp (null) (null) 00000040:00080000:0.0:1789265164.474285:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789265164.474293:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1789265164.474305:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1789265164.474319:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1789265164.474360:0:6510:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1789265164.474366:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1789265164.474800:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1789265164.474920:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1789265164.474933:0:6510:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.149@tcp for mdt 20000000:01000000:0.0:1789265164.474935:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.149@tcp (null) (null) (null) 00000040:00080000:0.0:1789265164.474946:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1789265164.474950:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789265164.474968:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1789265164.474973:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.149@tcp (null) (null) 00000040:00080000:0.0:1789265164.474982:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1789265164.474987:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1789265164.474997:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1789265164.475008:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1789265164.475052:0:6510:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789265164.475056:0:6510:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789265164.475059:0:6510:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789265164.475099:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789265164.475100:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789265164.475597:0:7454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1789265164.475627:0:7454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1789265164.475639:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1789265164.475926:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1789265164.475944:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1789265164.475955:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1789265164.475963:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789265164.475964:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789265164.476313:0:7455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1789265164.476335:0:7455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1789265164.476350:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1789265164.476464:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1789265164.476480:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1789265164.476492:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1789265164.476499:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789265164.476500:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789265164.477228:0:7456:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1789265164.477255:0:7456:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1789265164.477271:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1789265164.477399:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1789265164.477416:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1789265164.477435:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1789265164.477445:0:6510:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789265164.477447:0:6510:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789265164.477452:0:6510:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789265164.477457:0:6510:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789265164.477829:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1789265164.477941:0:6510:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789265164.495349:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789265164.495723:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c555c898/0x9272d942b4a9621a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.495752:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000044ac9794/0x9272d942b4a9614f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96148 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.495759:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000ae68594/0x9272d942b4a9616b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96164 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.495765:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000eb74d500/0x9272d942b4a961db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a961d4 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.495771:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c555c898/0x9272d942b4a9621a lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.495806:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000eb74d500/0x9272d942b4a961db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a961d4 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.495818:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000eb74d500/0x9272d942b4a961db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a961d4 expref: 12 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265164.495830:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000000bdae4c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876180417384704:0@lo:104: 00000100:00100000:0.0:1789265164.495886:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789265164.495986:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000ae68594/0x9272d942b4a9616b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a96164 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.495994:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000ae68594/0x9272d942b4a9616b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a96164 expref: 12 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265164.496002:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e7af259e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876180417384832:0@lo:104: 00000100:00100000:0.0:1789265164.496047:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789265164.496500:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000044ac9794/0x9272d942b4a9614f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a96148 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.496514:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000044ac9794/0x9272d942b4a9614f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a96148 expref: 12 pid: 6510 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265164.496523:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000010e383ea pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876180417384960:0@lo:104: 00000100:00100000:0.0:1789265164.496557:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265164.496758:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417384704 00000100:00100000:3.0:1789265164.496765:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417384704 00000100:00100000:3.0:1789265164.496799:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417384832 00000100:00100000:3.0:1789265164.496806:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417384832 00000100:00100000:3.0:1789265164.496820:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789265164.496826:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec350571 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+4:6510:x1876180417384704:12345-0@lo:104: 00010000:00010000:3.0:1789265164.496836:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: 00000000060d94a4/0x9272d942b4a961d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a961db expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.496889:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789265164.496893:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec350571 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+4:6510:x1876180417384704:12345-0@lo:104: Request processed in 69us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265164.496900:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789265164.496915:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265164.496920:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000597d6ef3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+3:6510:x1876180417384832:12345-0@lo:104: 00010000:00010000:3.0:1789265164.496926:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: 000000008e09bcca/0x9272d942b4a96164 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9616b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.496952:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789265164.496955:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000597d6ef3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+3:6510:x1876180417384832:12345-0@lo:104: Request processed in 36us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265164.496960:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789265164.496973:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265164.496977:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: 00000000060d94a4/0x9272d942b4a961d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a961db expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.496984:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000060d94a4 already unused, calling callback (00000000b05a377f) 10000000:00010000:3.0:1789265164.496988:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: 00000000060d94a4/0x9272d942b4a961d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a961db expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.496995:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: 00000000060d94a4/0x9272d942b4a961d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a961db expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265164.497010:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: 00000000060d94a4/0x9272d942b4a961d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a961db expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265164.497016:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789265164.497058:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: 00000000060d94a4/0x9272d942b4a961d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a961db expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.497064:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265164.497078:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: 00000000060d94a4/0x9272d942b4a961d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a961db expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.497084:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: 00000000060d94a4/0x9272d942b4a961d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a961db expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.497095:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265164.497097:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: 000000008e09bcca/0x9272d942b4a96164 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9616b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.497102:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008e09bcca already unused, calling callback (00000000b05a377f) 10000000:00010000:3.0:1789265164.497104:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: 000000008e09bcca/0x9272d942b4a96164 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a9616b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.497109:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: 000000008e09bcca/0x9272d942b4a96164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a9616b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265164.497114:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: 000000008e09bcca/0x9272d942b4a96164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a9616b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265164.497118:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789265164.497147:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: 000000008e09bcca/0x9272d942b4a96164 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9616b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.497153:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265164.497164:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: 000000008e09bcca/0x9272d942b4a96164 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9616b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.497170:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: 000000008e09bcca/0x9272d942b4a96164 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9616b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.497266:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265164.497323:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265164.497327:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265164.497328:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265164.497336:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265164.497347:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008e15ac96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417385216:0@lo:103: 00000100:00100000:3.0:1789265164.497377:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265164.497483:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417385216 00000100:00100000:1.0:1789265164.497488:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417385216 00010000:00010000:1.0:1789265164.497509:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000ae68594/0x9272d942b4a9616b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96164 expref: 13 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265164.497530:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265164.497535:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057286701 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+13:3642:x1876180417385216:12345-0@lo:103: 00010000:00010000:1.0:1789265164.497557:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265164.497560:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000ae68594/0x9272d942b4a9616b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96164 expref: 13 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.497568:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000ae68594/0x9272d942b4a9616b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a96164 expref: 13 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.497583:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265164.497624:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057286701 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+13:3642:x1876180417385216:12345-0@lo:103: Request processed in 89us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265164.497630:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265164.497666:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008e15ac96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417385216:0@lo:103: 00000100:00100000:0.0:1789265164.497902:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cb58ae81 going to sleep for 11 seconds 00000100:00100000:0.0:1789265164.497917:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000000bdae4c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876180417384704:0@lo:104: 00010000:00010000:0.0:1789265164.497924:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000ae68594/0x9272d942b4a9616b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a96164 expref: 12 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265164.497934:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e7af259e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876180417384832:0@lo:104: 00000100:00100000:1.0:1789265164.497989:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417384960 00000100:00100000:1.0:1789265164.497993:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417384960 00000100:00100000:1.0:1789265164.498011:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265164.498017:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af31c4b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+3:6510:x1876180417384960:12345-0@lo:104: 00010000:00010000:1.0:1789265164.498148:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: 00000000ff86d7ac/0x9272d942b4a96148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9614f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.498475:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789265164.498490:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af31c4b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+3:6510:x1876180417384960:12345-0@lo:104: Request processed in 474us (1933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265164.498496:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789265164.498513:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265164.498517:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: 00000000ff86d7ac/0x9272d942b4a96148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9614f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.498523:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ff86d7ac already unused, calling callback (00000000b05a377f) 10000000:00010000:1.0:1789265164.498525:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: 00000000ff86d7ac/0x9272d942b4a96148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a9614f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.498532:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: 00000000ff86d7ac/0x9272d942b4a96148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a9614f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265164.498551:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: 00000000ff86d7ac/0x9272d942b4a96148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a9614f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265164.498556:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789265164.498574:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: 00000000ff86d7ac/0x9272d942b4a96148 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9614f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.498580:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265164.498590:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: 00000000ff86d7ac/0x9272d942b4a96148 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9614f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.498595:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: 00000000ff86d7ac/0x9272d942b4a96148 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9614f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.498607:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265164.498609:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265164.498610:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265164.498632:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005c9d534a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417385344:0@lo:103: 00000100:00100000:1.0:1789265164.498660:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265164.498698:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417385344 00000100:00100000:1.0:1789265164.498702:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417385344 00010000:00010000:1.0:1789265164.498717:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000044ac9794/0x9272d942b4a9614f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96148 expref: 12 pid: 6510 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265164.498742:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265164.498748:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b47b9342 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+12:3642:x1876180417385344:12345-0@lo:103: 00010000:00010000:1.0:1789265164.498757:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265164.498760:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000044ac9794/0x9272d942b4a9614f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96148 expref: 12 pid: 6510 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.498768:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000044ac9794/0x9272d942b4a9614f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a96148 expref: 12 pid: 6510 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.498781:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265164.498803:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b47b9342 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+12:3642:x1876180417385344:12345-0@lo:103: Request processed in 57us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265164.498809:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265164.498835:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005c9d534a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417385344:0@lo:103: 10000000:01000000:2.0:1789265164.498964:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789265164.498968:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fcc8a583000 from 21 10000000:01000000:2.0:1789265164.498970:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789265164.498993:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: 00000000ebabc64f/0x9272d942b4a96221 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.499000:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: 00000000ebabc64f/0x9272d942b4a96221 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.499007:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: 00000000ebabc64f/0x9272d942b4a96221 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265164.499019:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017d4a85c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417385472:0@lo:101: 00000100:00100000:2.0:1789265164.499077:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265164.499097:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d2d7615d going to sleep for 11 seconds 00000100:00100000:2.0:1789265164.499114:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008de4b511 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417385088:0@lo:103: 00000100:00100000:2.0:1789265164.499145:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265164.499194:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417385088 00000100:00100000:2.0:1789265164.499199:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417385088 00010000:00010000:2.0:1789265164.499213:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000eb74d500/0x9272d942b4a961db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a961d4 expref: 12 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265164.499232:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265164.499238:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025222265 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+12:3644:x1876180417385088:12345-0@lo:103: 00010000:00010000:2.0:1789265164.499245:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265164.499249:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000eb74d500/0x9272d942b4a961db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a961d4 expref: 12 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.499268:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000eb74d500/0x9272d942b4a961db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a961d4 expref: 12 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.499278:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000eb74d500/0x9272d942b4a961db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a961d4 expref: 12 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.499289:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c555c898/0x9272d942b4a9621a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.499296:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c555c898/0x9272d942b4a9621a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.499307:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c555c898/0x9272d942b4a9621a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.499312:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c555c898/0x9272d942b4a9621a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.499317:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c555c898/0x9272d942b4a9621a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.499323:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c555c898/0x9272d942b4a9621a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.499328:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c555c898 already unused, calling callback (00000000ff461ba4) 00010000:00010000:2.0:1789265164.499331:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c555c898/0x9272d942b4a9621a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.499337:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c555c898/0x9272d942b4a9621a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.499355:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c555c898/0x9272d942b4a9621a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.499364:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265164.499392:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025222265 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+11:3644:x1876180417385088:12345-0@lo:103: Request processed in 154us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265164.499399:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265164.499425:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008de4b511 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417385088:0@lo:103: 00010000:00010000:0.0:1789265164.499595:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000044ac9794/0x9272d942b4a9614f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a96148 expref: 10 pid: 6510 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265164.499607:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000010e383ea pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876180417384960:0@lo:104: 00010000:00010000:0.0:1789265164.499623:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c555c898/0x9272d942b4a9621a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.499632:0:6510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c555c898/0x9272d942b4a9621a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.499637:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c555c898/0x9272d942b4a9621a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.499642:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c555c898/0x9272d942b4a9621a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789265164.499658:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789265164.500132:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417385472 00000100:00100000:1.0:1789265164.500139:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417385472 00000100:00100000:1.0:1789265164.500176:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789265164.500277:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3ff11ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+10:6513:x1876180417385472:12345-0@lo:101: 00010000:00010000:1.0:1789265164.500290:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265164.500301:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a661c9c8/0x9272d942b4a96228 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96221 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.500331:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a661c9c8/0x9272d942b4a96228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96221 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.500340:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a661c9c8/0x9272d942b4a96228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96221 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.500347:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a661c9c8, rc 0) 00000100:00100000:1.0:1789265164.500400:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3ff11ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+11:6513:x1876180417385472:12345-0@lo:101: Request processed in 121us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265164.500496:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017d4a85c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417385472:0@lo:101: 00010000:00010000:0.0:1789265164.500514:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: 00000000ebabc64f/0x9272d942b4a96221 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96228 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.500522:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: 00000000ebabc64f/0x9272d942b4a96221 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96228 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265164.500592:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000010e383ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417385600:0@lo:501: 00000100:00100000:0.0:1789265164.500624:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265164.500644:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 000000003abc7de7 going to sleep for 11 seconds 00000100:00100000:2.0:1789265164.500791:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1789265164.500799:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:2.0:1789265164.500920:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417385600 00000100:00100000:2.0:1789265164.500925:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417385600 00000100:00100000:2.0:1789265164.500997:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789265164.501004:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a8e8c11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+12:6513:x1876180417385600:12345-0@lo:501: 00000100:00100000:0.0:1789265164.502046:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e8a5eeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+12:7446:x1876180417384576:12345-0@lo:253: Request processed in 29955us (30429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265164.502060:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789265164.502112:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007fd60b19 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417384576:0@lo:253: 10000000:01000000:0.0:1789265164.502138:0:7446:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789265164.502141:0:7446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789265164.502143:0:7446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789265164.502144:0:7446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265164.502145:0:7446:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1789265164.502146:0:7446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265164.502148:0:7446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265164.502149:0:7446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789265164.502150:0:7446:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789265164.502151:0:7446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265164.502152:0:7446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789265164.502169:0:7446:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000097b6b08c from lustre-MDT0001 00000100:00100000:1.0:1789265164.502290:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 10000000:01000000:0.0:1789265164.502369:0:7446:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1789265164.502372:0:7446:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789265164.502378:0:7446:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fcc83f119b8 local copy 10000000:01000000:0.0:1789265164.502382:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789265164.502408:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: 000000009c0e0c15/0x9272d942b4a9622f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.502425:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.149@tcp lock: 000000009c0e0c15/0x9272d942b4a9622f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.502433:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: 000000009c0e0c15/0x9272d942b4a9622f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265164.502449:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e7af259e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417385728:0@lo:101: 00000100:00100000:0.0:1789265164.502483:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265164.502520:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 000000004f0835ec going to sleep for 11 seconds 00000100:00100000:0.0:1789265164.502616:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417385728 00000100:00100000:0.0:1789265164.502622:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417385728 00000100:00100000:0.0:1789265164.502647:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265164.502654:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000488d02bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+11:7446:x1876180417385728:12345-0@lo:101: 00010000:00010000:0.0:1789265164.502780:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1789265164.502942:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a8e8c11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+11:6513:x1876180417385600:12345-0@lo:501: Request processed in 1939us (2318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265164.502951:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1789265164.503003:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000098a9c607/0x9272d942b4a96236 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9622f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.503059:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000098a9c607/0x9272d942b4a96236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9622f expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.503068:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000098a9c607/0x9272d942b4a96236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9622f expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.503077:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000098a9c607, rc 0) 00000100:00100000:1.0:1789265164.503168:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000010e383ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417385600:0@lo:501: 00000100:00100000:0.0:1789265164.503264:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000488d02bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+11:7446:x1876180417385728:12345-0@lo:101: Request processed in 610us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265164.503270:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265164.503297:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e7af259e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417385728:0@lo:101: 00010000:00010000:0.0:1789265164.503315:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: 000000009c0e0c15/0x9272d942b4a9622f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x9272d942b4a96236 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.503323:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: 000000009c0e0c15/0x9272d942b4a9622f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x9272d942b4a96236 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265164.503397:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e7af259e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417385856:0@lo:501: 00000100:00100000:0.0:1789265164.503426:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265164.503459:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 000000004f0835ec going to sleep for 11 seconds 00000100:00100000:0.0:1789265164.503479:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417385856 00000100:00100000:0.0:1789265164.503483:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417385856 00000100:00100000:0.0:1789265164.503507:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789265164.503513:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdd5852e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+11:7446:x1876180417385856:12345-0@lo:501: 00000100:00100000:1.0:1789265164.503756:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005c9d534a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417385984:0@lo:503: 00000100:00100000:1.0:1789265164.503814:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265164.503837:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 0000000055d57b44 going to sleep for 11 seconds 00000100:00100000:1.0:1789265164.503852:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417385984 00000100:00100000:1.0:1789265164.503856:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417385984 00000100:00100000:1.0:1789265164.503876:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789265164.503882:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078fc62e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+12:6513:x1876180417385984:12345-0@lo:503: 00000100:00100000:1.0:1789265164.503963:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078fc62e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+12:6513:x1876180417385984:12345-0@lo:503: Request processed in 81us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265164.503970:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789265164.504012:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005c9d534a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417385984:0@lo:503: 00000100:00100000:1.0:1789265164.504565:0:7459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005c9d534a pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:7459:1876180417386112:0@lo:502: 00000100:00100000:1.0:1789265164.504598:0:7459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265164.504632:0:7459:0:(client.c:2715:ptlrpc_set_wait()) set 00000000873c3798 going to sleep for 11 seconds 00000100:00100000:3.0:1789265164.504643:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417386112 00000100:00100000:3.0:1789265164.504650:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417386112 00000100:00100000:3.0:1789265164.504691:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789265164.504698:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000998a19b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+12:7459:x1876180417386112:12345-0@lo:502: 00000100:00100000:0.0:1789265164.504740:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdd5852e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+12:7446:x1876180417385856:12345-0@lo:501: Request processed in 1226us (1313us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789265164.504748:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789265164.504809:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000998a19b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+11:7459:x1876180417386112:12345-0@lo:502: Request processed in 112us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265164.504816:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789265164.504903:0:7459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005c9d534a pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:7459:1876180417386112:0@lo:502: 00000100:00100000:0.0:1789265164.504947:0:7459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000000bdae4c pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:7459:1876180417386240:0@lo:502: 00000100:00100000:0.0:1789265164.504981:0:7459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265164.505006:0:7459:0:(client.c:2715:ptlrpc_set_wait()) set 00000000873c3798 going to sleep for 11 seconds 00000100:00100000:3.0:1789265164.505156:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417386240 00000100:00100000:3.0:1789265164.505161:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417386240 00000100:00100000:3.0:1789265164.505283:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789265164.505291:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb5b5448 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+11:7459:x1876180417386240:12345-0@lo:502: 00000100:00100000:3.0:1789265164.505357:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb5b5448 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+11:7459:x1876180417386240:12345-0@lo:502: Request processed in 66us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265164.505373:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789265164.505442:0:7459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000000bdae4c pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:7459:1876180417386240:0@lo:502: 00000040:00080000:0.0:1789265164.505460:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789265164.505516:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789265164.505551:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789265164.505558:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: 00000000ebabc64f/0x9272d942b4a96221 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96228 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.505579:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: 00000000ebabc64f/0x9272d942b4a96221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96228 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265164.505587:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789265164.505590:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1789265164.505592:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789265164.505614:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: 0000000022ad6cb1/0x9272d942b4a9623d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.505621:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: 0000000022ad6cb1/0x9272d942b4a9623d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.505629:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: 0000000022ad6cb1/0x9272d942b4a9623d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265164.505640:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000000bdae4c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417386368:0@lo:101: 00000100:00100000:0.0:1789265164.505676:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265164.505867:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e7af259e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417385856:0@lo:501: 10000000:01000000:2.0:1789265164.505882:0:7446:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.149@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789265164.505916:0:7446:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.149@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789265164.505920:0:7446:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: 000000009c0e0c15/0x9272d942b4a9622f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x9272d942b4a96236 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.505927:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: 000000009c0e0c15/0x9272d942b4a9622f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000400000000 nid: local remote: 0x9272d942b4a96236 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.505933:0:7446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: 000000009c0e0c15/0x9272d942b4a9622f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000400000000 nid: local remote: 0x9272d942b4a96236 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.505955:0:7446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789265164.505973:0:7446:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fccad90a000 10000000:01000000:2.0:1789265164.505977:0:7446:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789265164.505982:0:7446:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9fcc83f119b8 10000000:01000000:2.0:1789265164.505985:0:7446:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789265164.505987:0:7446:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9fcc83f119b8 from 1 10000000:01000000:2.0:1789265164.505989:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789265164.506003:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: 0000000059a2d81a/0x9272d942b4a96244 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.506009:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: 0000000059a2d81a/0x9272d942b4a96244 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.506016:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: 0000000059a2d81a/0x9272d942b4a96244 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265164.506042:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000091ad8557 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417386496:0@lo:101: 00000100:00100000:2.0:1789265164.506070:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265164.506241:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 000000001b85fe64 going to sleep for 11 seconds 00000100:00100000:1.0:1789265164.506269:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417386368 00000100:00100000:1.0:1789265164.506274:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417386368 00000100:00100000:1.0:1789265164.506303:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789265164.506309:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6c74fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+11:6513:x1876180417386368:12345-0@lo:101: 00010000:00010000:1.0:1789265164.506317:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265164.506327:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004573311f/0x9272d942b4a9624b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9623d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.506345:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004573311f/0x9272d942b4a9624b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9623d expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.506354:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004573311f/0x9272d942b4a9624b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9623d expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.506361:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004573311f, rc 0) 00000100:00100000:1.0:1789265164.506391:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6c74fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+12:6513:x1876180417386368:12345-0@lo:101: Request processed in 83us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265164.506398:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789265164.506623:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417386496 00000100:00100000:1.0:1789265164.506627:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417386496 00000100:00100000:1.0:1789265164.506650:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789265164.506656:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5e78258 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+12:7446:x1876180417386496:12345-0@lo:101: 00010000:00010000:1.0:1789265164.506673:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265164.506681:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000312b19a9/0x9272d942b4a96252 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96244 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.506692:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000312b19a9/0x9272d942b4a96252 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96244 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.506699:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000312b19a9/0x9272d942b4a96252 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96244 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.506712:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000312b19a9, rc 0) 00000100:00100000:1.0:1789265164.506735:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5e78258 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+13:7446:x1876180417386496:12345-0@lo:101: Request processed in 80us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265164.506740:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789265164.506840:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d2d7615d going to sleep for 11 seconds 00000100:00100000:2.0:1789265164.506853:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000091ad8557 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417386496:0@lo:101: 00010000:00010000:2.0:1789265164.506865:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: 0000000059a2d81a/0x9272d942b4a96244 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96252 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.506873:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: 0000000059a2d81a/0x9272d942b4a96244 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96252 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265164.506888:0:7446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789265164.506891:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: 0000000059a2d81a/0x9272d942b4a96244 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96252 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.506904:0:7446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: 0000000059a2d81a/0x9272d942b4a96244 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96252 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265164.506912:0:7446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fccad90a000 10000000:01000000:2.0:1789265164.506915:0:7446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789265164.506919:0:7446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fccad90a000 from 1 10000000:01000000:2.0:1789265164.506921:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789265164.506935:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: 00000000e3e0acac/0x9272d942b4a96259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.506942:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: 00000000e3e0acac/0x9272d942b4a96259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.506948:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: 00000000e3e0acac/0x9272d942b4a96259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265164.506960:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000091ad8557 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417386624:0@lo:101: 00000100:00100000:2.0:1789265164.506987:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265164.507009:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d2d7615d going to sleep for 11 seconds 00010000:00010000:2.0:1789265164.507061:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265164.507067:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: 000000009c0e0c15/0x9272d942b4a9622f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x9272d942b4a96236 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.507074:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009c0e0c15 already unused, calling callback (00000000b05a377f) 10000000:00010000:2.0:1789265164.507077:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: 000000009c0e0c15/0x9272d942b4a9622f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x9272d942b4a96236 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.507084:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: 000000009c0e0c15/0x9272d942b4a9622f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0x9272d942b4a96236 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265164.507096:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: 000000009c0e0c15/0x9272d942b4a9622f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0x9272d942b4a96236 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265164.507102:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265164.507118:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: 000000009c0e0c15/0x9272d942b4a9622f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x9272d942b4a96236 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.507135:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265164.507148:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: 000000009c0e0c15/0x9272d942b4a9622f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x9272d942b4a96236 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.507154:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: 000000009c0e0c15/0x9272d942b4a9622f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x9272d942b4a96236 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.507164:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265164.507175:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265164.507177:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265164.507244:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000019bcd999 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417386752:0@lo:103: 00000100:00100000:2.0:1789265164.507271:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265164.507307:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417386752 00000100:00100000:2.0:1789265164.507311:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417386752 00000100:00100000:2.0:1789265164.507339:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265164.507345:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3b98457 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+13:3643:x1876180417386752:12345-0@lo:103: 00010000:00010000:2.0:1789265164.507354:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265164.507364:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000098a9c607/0x9272d942b4a96236 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a9622f expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.507373:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265164.507404:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3b98457 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+12:3643:x1876180417386752:12345-0@lo:103: Request processed in 60us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265164.507411:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265164.507436:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000019bcd999 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417386752:0@lo:103: 00000100:00100000:1.0:1789265164.507495:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417386624 00000100:00100000:1.0:1789265164.507499:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417386624 00000100:00100000:1.0:1789265164.507531:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789265164.507536:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086d37cf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+12:7446:x1876180417386624:12345-0@lo:101: 00010000:00010000:1.0:1789265164.507553:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265164.507561:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007d51dde2/0x9272d942b4a96260 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96259 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.507574:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007d51dde2/0x9272d942b4a96260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96259 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.507581:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007d51dde2/0x9272d942b4a96260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96259 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.507587:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007d51dde2, rc 0) 00000100:00100000:1.0:1789265164.507612:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086d37cf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+13:7446:x1876180417386624:12345-0@lo:101: Request processed in 77us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265164.507618:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789265164.507830:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000091ad8557 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417386624:0@lo:101: 00010000:00010000:2.0:1789265164.507840:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: 00000000e3e0acac/0x9272d942b4a96259 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96260 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.507847:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: 00000000e3e0acac/0x9272d942b4a96259 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96260 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265164.507856:0:7446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789265164.507859:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: 00000000e3e0acac/0x9272d942b4a96259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96260 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.507865:0:7446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: 00000000e3e0acac/0x9272d942b4a96259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96260 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265164.507871:0:7446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789265164.507874:0:7446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789265164.507878:0:7446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fccad90a000 10000000:01000000:2.0:1789265164.507880:0:7446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789265164.507882:0:7446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789265164.507885:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789265164.507896:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: 00000000060d94a4/0x9272d942b4a96267 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.507902:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: 00000000060d94a4/0x9272d942b4a96267 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.507919:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: 00000000060d94a4/0x9272d942b4a96267 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265164.507930:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000091ad8557 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417386880:0@lo:101: 00000100:00100000:2.0:1789265164.507957:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265164.507975:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d2d7615d going to sleep for 11 seconds 00000100:00100000:2.0:1789265164.507990:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417386880 00000100:00100000:2.0:1789265164.507993:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417386880 00000100:00100000:2.0:1789265164.508011:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789265164.508017:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6619ed7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+13:7446:x1876180417386880:12345-0@lo:101: 00010000:00010000:2.0:1789265164.508040:0:7458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265164.508047:0:7458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000ae68594/0x9272d942b4a9626e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96267 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.508061:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000ae68594/0x9272d942b4a9626e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96267 expref: 14 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.508067:0:7458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000ae68594/0x9272d942b4a9626e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96267 expref: 14 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.508072:0:7458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000ae68594, rc 0) 00000100:00100000:2.0:1789265164.508099:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6619ed7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+14:7446:x1876180417386880:12345-0@lo:101: Request processed in 83us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265164.508105:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789265164.508141:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000091ad8557 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417386880:0@lo:101: 00010000:00010000:2.0:1789265164.508150:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: 00000000060d94a4/0x9272d942b4a96267 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9626e expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.508167:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: 00000000060d94a4/0x9272d942b4a96267 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9626e expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265164.508578:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000091ad8557 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417387008:0@lo:501: 00000100:00100000:2.0:1789265164.508605:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265164.508614:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d2d7615d going to sleep for 11 seconds 00000100:00100000:2.0:1789265164.508633:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417387008 00000100:00100000:2.0:1789265164.508637:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417387008 00000100:00100000:2.0:1789265164.508653:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789265164.508658:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8ae42b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+14:7446:x1876180417387008:12345-0@lo:501: 00000100:00100000:2.0:1789265164.508857:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8ae42b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+14:7446:x1876180417387008:12345-0@lo:501: Request processed in 199us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265164.508863:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789265164.508887:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000091ad8557 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417387008:0@lo:501: 00000100:00100000:2.0:1789265164.508924:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000091ad8557 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417387136:0@lo:503: 00000100:00100000:2.0:1789265164.508962:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265164.508971:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d2d7615d going to sleep for 11 seconds 00000100:00100000:2.0:1789265164.508989:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417387136 00000100:00100000:2.0:1789265164.508992:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417387136 00000100:00100000:2.0:1789265164.509009:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789265164.509014:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc2baa3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+14:7446:x1876180417387136:12345-0@lo:503: 00000100:00100000:2.0:1789265164.509103:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc2baa3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+14:7446:x1876180417387136:12345-0@lo:503: Request processed in 90us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265164.509110:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789265164.509150:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000091ad8557 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417387136:0@lo:503: 00000040:00080000:2.0:1789265164.509425:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789265164.509496:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000091ad8557 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417387264:0@lo:502: 00000100:00100000:2.0:1789265164.509525:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265164.509534:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 0000000095b84b1b going to sleep for 11 seconds 00000100:00100000:2.0:1789265164.509622:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417387264 00000100:00100000:2.0:1789265164.509626:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417387264 00000100:00100000:2.0:1789265164.509644:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789265164.509648:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c01e88a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+14:7446:x1876180417387264:12345-0@lo:502: 00000100:00100000:2.0:1789265164.509789:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c01e88a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+14:7446:x1876180417387264:12345-0@lo:502: Request processed in 140us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265164.509796:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789265164.509827:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000091ad8557 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417387264:0@lo:502: 00000040:00080000:2.0:1789265164.509995:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789265164.510049:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1789265164.510068:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1789265164.510082:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1789265164.510095:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1789265164.510110:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1789265164.510137:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1789265164.510153:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1789265164.510168:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1789265164.510348:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1789265164.510369:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1789265164.510383:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1789265164.510397:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1789265164.510411:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1789265164.510424:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1789265164.510438:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1789265164.510470:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1789265164.510494:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1789265164.510509:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1789265164.510523:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1789265164.510537:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1789265164.510747:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1789265164.510764:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1789265164.510791:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000091ad8557 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417387392:0@lo:502: 00000100:00100000:2.0:1789265164.510840:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265164.510911:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 0000000095b84b1b going to sleep for 11 seconds 00000100:00100000:2.0:1789265164.510936:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417387392 00000100:00100000:2.0:1789265164.510941:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417387392 00000100:00100000:0.0:1789265164.511058:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789265164.511067:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000737b72e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+14:7446:x1876180417387392:12345-0@lo:502: 00000100:00100000:0.0:1789265164.511169:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000737b72e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+14:7446:x1876180417387392:12345-0@lo:502: Request processed in 104us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265164.511177:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789265164.511299:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000091ad8557 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417387392:0@lo:502: 00000040:00080000:3.0:1789265164.511345:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1789265164.511354:0:7446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1789265164.511910:0:7460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265164.511920:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265164.511922:0:7460:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789265164.511928:0:7460:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1789265164.511931:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789265164.511943:0:7460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000004c454d15) 00000020:00000080:1.0:1789265164.511966:0:7460:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1789265164.511972:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1789265164.512088:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000000bdae4c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417386368:0@lo:101: 00010000:00010000:3.0:1789265164.512105:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: 0000000022ad6cb1/0x9272d942b4a9623d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9624b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.512117:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: 0000000022ad6cb1/0x9272d942b4a9623d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9624b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265164.512189:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000882982e4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417387520:0@lo:501: 00000100:00100000:3.0:1789265164.512225:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265164.512250:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 000000007008192f going to sleep for 11 seconds 00000100:00100000:3.0:1789265164.512263:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417387520 00000100:00100000:3.0:1789265164.512267:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417387520 00000100:00100000:3.0:1789265164.512295:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789265164.512301:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006becd6e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+14:6513:x1876180417387520:12345-0@lo:501: 00000100:00100000:3.0:1789265164.512383:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006becd6e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+14:6513:x1876180417387520:12345-0@lo:501: Request processed in 82us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265164.512391:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789265164.512422:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000882982e4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417387520:0@lo:501: 00000100:00100000:3.0:1789265164.512445:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000882982e4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417387648:0@lo:503: 00000100:00100000:3.0:1789265164.512480:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265164.512492:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 000000007008192f going to sleep for 11 seconds 00000100:00100000:3.0:1789265164.512509:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417387648 00000100:00100000:3.0:1789265164.512513:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417387648 00000100:00100000:3.0:1789265164.512530:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789265164.512536:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000547258a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+14:6513:x1876180417387648:12345-0@lo:503: 00000100:00100000:3.0:1789265164.512609:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000547258a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+14:6513:x1876180417387648:12345-0@lo:503: Request processed in 74us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265164.512616:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789265164.512649:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000882982e4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417387648:0@lo:503: 00080000:01000000:1.0:1789265164.513077:0:7460:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789265164.513084:0:7460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9272d942b4a9627c 00000020:00000080:1.0:1789265164.513334:0:7460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789265164.513341:0:7460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265164.513345:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265164.513346:0:7460:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789265164.513349:0:7460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265164.513352:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265164.513354:0:7460:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1789265164.513357:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789265164.513365:0:7460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000524649d8) 00000020:00000080:1.0:1789265164.513376:0:7460:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1789265164.513380:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789265164.513381:0:7460:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1789265164.513383:0:7460:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1789265164.513389:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789265164.513437:0:7460:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000097b6b08c from lustre-MDT0001, refs=2 00000020:00000080:1.0:1789265164.513456:0:7460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000f527c7ef) 00000020:00000080:1.0:1789265164.513464:0:7460:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1789265164.513525:0:7460:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789265164.513529:0:7460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9272d942b4a96291 00000020:00000080:1.0:1789265164.513720:0:7460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1789265164.513726:0:7460:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789265164.513730:0:7460:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x9272d942b4a96298 00080000:01000000:1.0:1789265164.513735:0:7460:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789265164.513738:0:7460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9272d942b4a9629f 00080000:10000000:1.0:1789265164.514112:0:7460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1789265164.514348:0:7460:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00000100:00100000:3.0:1789265164.516590:0:7461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000882982e4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:7461:1876180417387776:0@lo:502: 00000100:00100000:3.0:1789265164.516691:0:7461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265164.516738:0:7461:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a9458074 going to sleep for 11 seconds 00000100:00100000:2.0:1789265164.516863:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417387776 00000100:00100000:2.0:1789265164.516871:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417387776 00000100:00100000:2.0:1789265164.516920:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789265164.516929:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005bfd2fac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+14:7461:x1876180417387776:12345-0@lo:502: 00000100:00100000:2.0:1789265164.517091:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005bfd2fac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+14:7461:x1876180417387776:12345-0@lo:502: Request processed in 162us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265164.517099:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789265164.517164:0:7461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000882982e4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:7461:1876180417387776:0@lo:502: 00000020:01000000:2.0:1789265164.517206:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265164.517218:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265164.517221:0:7461:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1789265164.517224:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789265164.517227:0:7461:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.149@tcp to nid 0x20000c0a8cb95 (192.168.203.149@tcp) 00000020:00000080:2.0:1789265164.517251:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789265164.517267:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (0000000081f60b29) 00000020:00000080:2.0:1789265164.517290:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1789265164.517296:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789265164.517395:0:7461:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1789265164.517401:0:7461:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789265164.517413:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9272d942b4a962ad 00010000:00080000:2.0:1789265164.517443:0:7461:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004df54d3c@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.149@tcp at head 00010000:00010000:2.0:1789265164.519743:0:7461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-2 is initialized 00000020:00000080:1.0:1789265164.533874:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789265164.533889:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789265164.533934:0:7461:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789265164.533962:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9272d942b4a962b4 00000100:00080000:1.0:1789265164.533972:0:7461:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789265164.533977:0:7461:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000004df54d3c using connection 192.168.203.149@tcp/0@lo 00000100:00100000:1.0:1789265164.534013:0:7461:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000cd1038a x1876180417387904/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265164.534062:0:7461:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1789265164.534101:0:7461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1789265164.534643:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cd1038a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417387904:0@lo:38: 00000100:00100000:2.0:1789265164.534770:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265164.535732:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054ebbc81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417388032:0@lo:400: 00000100:00100000:2.0:1789265164.535774:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265164.536225:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417388032 00000100:00100000:1.0:1789265164.536234:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417388032 00000100:00100000:1.0:1789265164.536280:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265164.536288:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008fae4cec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417388032:12345-0@lo:400: 00000100:00100000:1.0:1789265164.536350:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008fae4cec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417388032:12345-0@lo:400: Request processed in 63us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265164.536357:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789265164.536652:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000054ebbc81 x1876180417388032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265164.536731:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054ebbc81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417388032:0@lo:400: 00000100:00100000:2.0:1789265164.536754:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417387904 00000100:00100000:2.0:1789265164.536758:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417387904 00000100:00100000:2.0:1789265164.536792:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265164.536797:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019bcd999 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1876180417387904:12345-0@lo:38: 00010000:02000000:2.0:1789265164.536811:0:6521:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (not set up) 00000020:01000000:1.0:1789265164.536824:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265164.536830:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265164.536832:0:7461:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789265164.536834:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265164.536838:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265164.536839:0:7461:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789265164.536842:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789265164.536843:0:7461:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789265164.536870:0:7461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc238ecc pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:7461:1876180417388160:0@lo:502: 00000100:00100000:1.0:1789265164.536915:0:7461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265164.536939:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417388160 00000100:00100000:1.0:1789265164.536943:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417388160 00000100:00100000:1.0:1789265164.536971:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789265164.536978:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043d88110 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+14:7461:x1876180417388160:12345-0@lo:502: 00000100:00100000:1.0:1789265164.537093:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043d88110 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+14:7461:x1876180417388160:12345-0@lo:502: Request processed in 116us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265164.537107:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789265164.537157:0:7461:0:(client.c:2715:ptlrpc_set_wait()) set 0000000012534972 going to sleep for 11 seconds 00000100:00100000:1.0:1789265164.537170:0:7461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc238ecc pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:7461:1876180417388160:0@lo:502: 00000020:01000000:1.0:1789265164.537190:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265164.537194:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265164.537196:0:7461:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789265164.537199:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00080000:1.0:1789265164.537364:0:7464:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000bc238ecc x1876180417388288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265164.537374:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d086a5dd going to sleep for 0 seconds 00000020:01000000:3.0:1789265164.538073:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1789265164.538098:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789265164.538107:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: 0000000022ad6cb1/0x9272d942b4a9623d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9624b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.538117:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: 0000000022ad6cb1/0x9272d942b4a9623d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9624b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265164.538136:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789265164.538139:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fcc83f119b8 from 1 10000000:01000000:3.0:1789265164.538141:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789265164.538165:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: 0000000001664e76/0x9272d942b4a962bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.538172:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: 0000000001664e76/0x9272d942b4a962bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.538616:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: 0000000001664e76/0x9272d942b4a962bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265164.538641:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8ab9510 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417388416:0@lo:101: 00000100:00100000:3.0:1789265164.538754:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265164.538797:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a9458074 going to sleep for 11 seconds 00000100:00100000:1.0:1789265164.538800:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417388416 00000100:00100000:1.0:1789265164.538805:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417388416 00000100:00100000:1.0:1789265164.538844:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789265164.538852:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc6c929c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+14:6513:x1876180417388416:12345-0@lo:101: 00010000:00010000:1.0:1789265164.538863:0:7458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265164.538874:0:7458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006527398e/0x9272d942b4a962c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a962bb expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.538897:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006527398e/0x9272d942b4a962c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a962bb expref: 15 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.538907:0:7458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006527398e/0x9272d942b4a962c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a962bb expref: 15 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.538914:0:7458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006527398e, rc 0) 00000100:00100000:1.0:1789265164.538956:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc6c929c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+15:6513:x1876180417388416:12345-0@lo:101: Request processed in 105us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265164.538962:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789265164.538980:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8ab9510 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417388416:0@lo:101: 00010000:00010000:3.0:1789265164.538991:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: 0000000001664e76/0x9272d942b4a962bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a962c2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.538999:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: 0000000001664e76/0x9272d942b4a962bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a962c2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265164.539072:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8ab9510 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417388544:0@lo:501: 00000100:00100000:3.0:1789265164.539096:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265164.539133:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a9458074 going to sleep for 11 seconds 00000100:00100000:1.0:1789265164.539149:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417388544 00000100:00100000:1.0:1789265164.539153:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417388544 00000100:00100000:1.0:1789265164.539182:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789265164.539188:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012eff7aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+15:6513:x1876180417388544:12345-0@lo:501: 00000100:00100000:1.0:1789265164.539262:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012eff7aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+15:6513:x1876180417388544:12345-0@lo:501: Request processed in 74us (164us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789265164.539269:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789265164.540307:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8ab9510 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417388544:0@lo:501: 10000000:01000000:3.0:1789265164.540347:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789265164.540353:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: 0000000001664e76/0x9272d942b4a962bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a962c2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.540361:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: 0000000001664e76/0x9272d942b4a962bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a962c2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265164.546129:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019bcd999 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1876180417387904:12345-0@lo:38: Request processed in 9315us (11344us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789265164.546145:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789265164.549097:0:3640:0:(import.c:65:import_set_state_nolock()) 000000004df54d3c lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789265164.549110:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789265164.549114:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cd1038a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417387904:0@lo:38: 00010000:00010000:3.0:1789265164.587436:0:7460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1789265164.587658:0:7460:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1789265164.592138:0:7460:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789265164.592496:0:7460:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789265164.600854:0:7460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1789265164.600867:0:7460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265164.600874:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265164.600876:0:7460:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1789265164.600879:0:7460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265164.600885:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265164.600886:0:7460:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1789265164.600891:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789265164.600896:0:7460:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.149@tcp to nid 0x20000c0a8cb95 (192.168.203.149@tcp) 00000020:00000080:1.0:1789265164.601063:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789265164.601078:0:7460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000007267a884) 00000020:00000080:1.0:1789265164.601100:0:7460:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osp with refcount 2 00000020:00000080:1.0:1789265164.601108:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789265164.601443:0:7460:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1789265164.601450:0:7460:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789265164.601458:0:7460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9272d942b4a962d0 00010000:00080000:1.0:1789265164.601492:0:7460:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004f372f98@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.149@tcp at head 00010000:00010000:0.0:1789265164.604552:0:7460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-3 is initialized 00000020:00000080:3.0:1789265164.607826:0:7460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789265164.607841:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789265164.607879:0:7460:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789265164.607905:0:7460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9272d942b4a962d7 00000100:00080000:3.0:1789265164.607913:0:7460:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789265164.607916:0:7460:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000004f372f98 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:3.0:1789265164.607942:0:7460:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e8ab9510 x1876180417388672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265164.607962:0:7460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789265164.608001:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8ab9510 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417388672:0@lo:38: 00000020:01000000:3.0:1789265164.608085:0:7460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265164.608089:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265164.608090:0:7460:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1789265164.608093:0:7460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789265164.608095:0:7460:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789265164.608097:0:7460:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789265164.608098:0:7460:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789265164.608100:0:7460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789265164.608102:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:2.0:1789265164.608102:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1789265164.608103:0:7460:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789265164.608106:0:7460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265164.608110:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265164.608112:0:7460:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1789265164.608115:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789265164.608157:0:7460:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789265164.608173:0:7460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265164.608176:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265164.608177:0:7460:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1789265164.608179:0:7460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265164.608189:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265164.608191:0:7460:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789265164.608194:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789265164.608195:0:7460:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789265164.608225:0:7460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265164.608228:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265164.608229:0:7460:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789265164.608232:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:1.0:1789265164.608363:0:7446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:1.0:1789265164.608398:0:7446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00000100:00100000:2.0:1789265164.608448:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417388672 00010000:00010000:1.0:1789265164.608454:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: 00000000060d94a4/0x9272d942b4a96267 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9626e expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265164.608456:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417388672 00010000:00010000:1.0:1789265164.608468:0:7446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: 00000000060d94a4/0x9272d942b4a96267 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9626e expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265164.608484:0:7446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fccad90a000 from 1 10000000:01000000:1.0:1789265164.608487:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00100000:2.0:1789265164.608492:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265164.608500:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a171f3b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1876180417388672:12345-0@lo:38: 00010000:00080000:2.0:1789265164.608522:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00010000:00010000:1.0:1789265164.608522:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: 00000000cbd5197a/0x9272d942b4a962de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.608534:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: 00000000cbd5197a/0x9272d942b4a962de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.608543:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: 00000000cbd5197a/0x9272d942b4a962de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789265164.608559:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9272d942b4a962e5 00000100:00100000:1.0:1789265164.608569:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff1317d5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417388800:0@lo:101: 00000004:00100000:2.0:1789265164.608575:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789265164.608587:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1789265164.608609:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265164.608636:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000147cd938 going to sleep for 11 seconds 00000100:00100000:0.0:1789265164.608665:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417388800 00000100:00100000:0.0:1789265164.608671:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417388800 00000100:00100000:0.0:1789265164.608752:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789265164.608760:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018be9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+15:7446:x1876180417388800:12345-0@lo:101: 00010000:00010000:0.0:1789265164.608777:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265164.608788:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c555c898/0x9272d942b4a962ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a962de expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.608808:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c555c898/0x9272d942b4a962ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a962de expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.608818:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c555c898/0x9272d942b4a962ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a962de expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.608825:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c555c898, rc 0) 00000100:00100000:0.0:1789265164.608872:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018be9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+16:7446:x1876180417388800:12345-0@lo:101: Request processed in 113us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265164.608878:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789265164.608941:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff1317d5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417388800:0@lo:101: 00010000:00010000:3.0:1789265164.608954:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: 00000000cbd5197a/0x9272d942b4a962de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a962ec expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.608962:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: 00000000cbd5197a/0x9272d942b4a962de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a962ec expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.609152:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265164.609682:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4bd1125 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417388928:0@lo:256: 00000100:00100000:3.0:1789265164.609721:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265164.609751:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e196793 going to sleep for 11 seconds 00000100:00100000:0.0:1789265164.609796:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417388928 00000100:00100000:0.0:1789265164.609800:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417388928 00000100:00100000:0.0:1789265164.609831:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789265164.609836:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd94b18a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+16:7446:x1876180417388928:12345-0@lo:256: 20000000:01000000:0.0:1789265164.609848:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789265164.609862:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789265164.609865:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789265164.609949:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd94b18a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+16:7446:x1876180417388928:12345-0@lo:256: Request processed in 111us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265164.609956:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789265164.610073:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4bd1125 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417388928:0@lo:256: 10000000:01000000:3.0:1789265164.610768:0:7446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789265164.610788:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: 00000000cbd5197a/0x9272d942b4a962de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a962ec expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.610797:0:7446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: 00000000cbd5197a/0x9272d942b4a962de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a962ec expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265164.610805:0:7446:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fccad90a000 from 1 10000000:01000000:3.0:1789265164.610808:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789265164.610829:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: 0000000022b654d4/0x9272d942b4a962f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.610845:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: 0000000022b654d4/0x9272d942b4a962f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.610853:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: 0000000022b654d4/0x9272d942b4a962f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265164.610865:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4bd1125 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417389056:0@lo:101: 00000100:00100000:3.0:1789265164.610893:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265164.610947:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e196793 going to sleep for 11 seconds 00000100:00100000:1.0:1789265164.610979:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417389056 00000100:00100000:1.0:1789265164.610983:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417389056 00000100:00100000:1.0:1789265164.611113:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789265164.611130:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea882f5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+16:7446:x1876180417389056:12345-0@lo:101: 00010000:00010000:1.0:1789265164.611139:0:7458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265164.611149:0:7458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cb8f3154/0x9272d942b4a962fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a962f3 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.611168:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cb8f3154/0x9272d942b4a962fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a962f3 expref: 17 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.611176:0:7458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cb8f3154/0x9272d942b4a962fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a962f3 expref: 17 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.611194:0:7458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cb8f3154, rc 0) 00000100:00100000:1.0:1789265164.611230:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea882f5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+17:7446:x1876180417389056:12345-0@lo:101: Request processed in 111us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265164.611235:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789265164.611286:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4bd1125 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417389056:0@lo:101: 00010000:00010000:3.0:1789265164.611296:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: 0000000022b654d4/0x9272d942b4a962f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a962fa expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.611303:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: 0000000022b654d4/0x9272d942b4a962f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a962fa expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265164.611380:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4bd1125 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417389184:0@lo:501: 00000100:00100000:3.0:1789265164.611401:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265164.611472:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e196793 going to sleep for 11 seconds 00000100:00100000:0.0:1789265164.611499:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417389184 00000100:00100000:0.0:1789265164.611503:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417389184 00000100:00100000:0.0:1789265164.611624:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789265164.611631:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000773e1089 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+17:7446:x1876180417389184:12345-0@lo:501: 00000100:00100000:0.0:1789265164.611719:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000773e1089 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+17:7446:x1876180417389184:12345-0@lo:501: Request processed in 88us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265164.611732:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789265164.611808:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4bd1125 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417389184:0@lo:501: 00000100:00100000:3.0:1789265164.611834:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4bd1125 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417389312:0@lo:503: 00000100:00100000:3.0:1789265164.611869:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265164.611887:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e196793 going to sleep for 11 seconds 00000100:00100000:0.0:1789265164.611918:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417389312 00000100:00100000:0.0:1789265164.611921:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417389312 00000100:00100000:0.0:1789265164.611935:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789265164.611940:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2380a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+17:7446:x1876180417389312:12345-0@lo:503: 00000040:00080000:0.0:1789265164.611967:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789265164.612147:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2380a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+17:7446:x1876180417389312:12345-0@lo:503: Request processed in 206us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265164.612154:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1789265164.613258:0:6522:0:(import.c:65:import_set_state_nolock()) 00000000436a9a5b : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265164.613372:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a171f3b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1876180417388672:12345-0@lo:38: Request processed in 4871us (5269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265164.613379:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789265164.613455:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4bd1125 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417389312:0@lo:503: 00000040:00080000:3.0:1789265164.613678:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265164.613730:0:7446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1789265164.613794:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789265164.614301:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789265164.614310:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789265164.614318:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789265164.614323:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789265164.614325:0:3640:0:(import.c:65:import_set_state_nolock()) 000000004f372f98 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789265164.614382:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8ab9510 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417388672:0@lo:38: 00000100:00100000:2.0:1789265164.614614:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cde2813a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417389440:0@lo:41: 00000100:00100000:2.0:1789265164.614656:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265164.614782:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417389440 00000100:00100000:0.0:1789265164.614787:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417389440 00000100:00100000:0.0:1789265164.614850:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789265164.614857:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c81eae6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1876180417389440:12345-0@lo:41: 00000004:00000024:0.0:1789265164.614880:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789265164.614923:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c81eae6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1876180417389440:12345-0@lo:41: Request processed in 67us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265164.614929:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265164.614979:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cde2813a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417389440:0@lo:41: 00000040:00080000:3.0:1789265164.615271:0:7469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1789265164.615412:0:7446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1789265164.615437:0:7446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789265164.615496:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: 0000000022b654d4/0x9272d942b4a962f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a962fa expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.615514:0:7446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: 0000000022b654d4/0x9272d942b4a962f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a962fa expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265164.615565:0:7446:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789265164.615568:0:7446:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fccad90a000 10000000:01000000:0.0:1789265164.615571:0:7446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fccad90a000 10000000:01000000:0.0:1789265164.615575:0:7446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789265164.615580:0:7446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fccad90a000 from 1 10000000:01000000:0.0:1789265164.615583:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789265164.615610:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: 00000000f59a89bc/0x9272d942b4a96301 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.615618:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: 00000000f59a89bc/0x9272d942b4a96301 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.615627:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: 00000000f59a89bc/0x9272d942b4a96301 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265164.615640:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003e58645 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417389568:0@lo:101: 00000100:00100000:0.0:1789265164.615667:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265164.615728:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 000000001065005a going to sleep for 11 seconds 00000100:00100000:1.0:1789265164.615764:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417389568 00000100:00100000:1.0:1789265164.615767:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417389568 00000100:00100000:1.0:1789265164.615801:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789265164.615808:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b576994 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+17:7446:x1876180417389568:12345-0@lo:101: 00010000:00010000:1.0:1789265164.615816:0:7458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265164.615827:0:7458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009b88e39d/0x9272d942b4a96308 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96301 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.615847:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009b88e39d/0x9272d942b4a96308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96301 expref: 18 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.615856:0:7458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009b88e39d/0x9272d942b4a96308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96301 expref: 18 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.615864:0:7458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009b88e39d, rc 0) 00000100:00100000:1.0:1789265164.615902:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b576994 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+18:7446:x1876180417389568:12345-0@lo:101: Request processed in 95us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265164.615909:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789265164.615950:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003e58645 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417389568:0@lo:101: 00010000:00010000:0.0:1789265164.615962:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: 00000000f59a89bc/0x9272d942b4a96301 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96308 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.615968:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: 00000000f59a89bc/0x9272d942b4a96301 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96308 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265164.616059:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003e58645 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417389696:0@lo:501: 00000100:00100000:0.0:1789265164.616083:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265164.616109:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 000000001065005a going to sleep for 11 seconds 00000100:00100000:2.0:1789265164.616175:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417389696 00000100:00100000:2.0:1789265164.616179:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417389696 00000100:00100000:2.0:1789265164.616203:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789265164.616209:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001fb52d8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+18:7446:x1876180417389696:12345-0@lo:501: 00000100:00100000:2.0:1789265164.616341:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001fb52d8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+18:7446:x1876180417389696:12345-0@lo:501: Request processed in 132us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265164.616349:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789265164.616778:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003e58645 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417389696:0@lo:501: 00000100:00100000:0.0:1789265164.616807:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003e58645 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417389824:0@lo:503: 00000100:00100000:0.0:1789265164.616850:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265164.616874:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 000000001065005a going to sleep for 11 seconds 00000100:00100000:3.0:1789265164.616930:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417389824 00000100:00100000:3.0:1789265164.616935:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417389824 00000100:00100000:3.0:1789265164.616978:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789265164.616987:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e76be614 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+18:7446:x1876180417389824:12345-0@lo:503: 00000100:00100000:3.0:1789265164.617143:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e76be614 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+18:7446:x1876180417389824:12345-0@lo:503: Request processed in 158us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265164.617153:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789265164.617158:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003e58645 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417389824:0@lo:503: 00000040:00080000:0.0:1789265164.617404:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789265164.617600:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003e58645 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417389952:0@lo:502: 00000100:00100000:0.0:1789265164.617631:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265164.617705:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 000000001065005a going to sleep for 11 seconds 00000100:00100000:3.0:1789265164.617792:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417389952 00000100:00100000:3.0:1789265164.617796:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417389952 00000100:00100000:3.0:1789265164.617868:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789265164.617876:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000093afc4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+18:7446:x1876180417389952:12345-0@lo:502: 00000100:00100000:3.0:1789265164.617962:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000093afc4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+18:7446:x1876180417389952:12345-0@lo:502: Request processed in 87us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265164.617969:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789265164.618047:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003e58645 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417389952:0@lo:502: 00000040:00080000:0.0:1789265164.618231:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789265164.618256:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789265164.618269:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789265164.618283:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789265164.618295:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789265164.618309:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789265164.618322:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789265164.618336:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789265164.618348:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789265164.618360:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789265164.618372:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789265164.618384:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789265164.618408:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789265164.618442:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789265164.618456:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789265164.618469:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789265164.618481:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789265164.618493:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789265164.618505:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789265164.618529:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789265164.618545:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789265164.618557:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789265164.618570:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789265164.618584:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789265164.618597:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1789265164.618609:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789265164.618622:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789265164.618635:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1789265164.618724:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003e58645 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417390080:0@lo:502: 00000100:00100000:0.0:1789265164.618769:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265164.618789:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417390080 00000100:00100000:0.0:1789265164.618792:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 000000001065005a going to sleep for 11 seconds 00000100:00100000:2.0:1789265164.618796:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417390080 00000100:00100000:2.0:1789265164.618832:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789265164.618839:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032e6f7d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+18:7446:x1876180417390080:12345-0@lo:502: 00000100:00100000:2.0:1789265164.618962:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032e6f7d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+18:7446:x1876180417390080:12345-0@lo:502: Request processed in 124us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265164.618971:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789265164.618996:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003e58645 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417390080:0@lo:502: 00000040:00080000:0.0:1789265164.619053:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789265164.619060:0:7446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789265164.620013:0:7470:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789265164.620051:0:7470:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000004495fda1) 00000020:00000080:0.0:1789265164.620071:0:7470:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type lwp with refcount 2 00000020:01000004:0.0:1789265164.620151:0:7470:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000097b6b08c from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789265164.620155:0:7470:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000097b6b08c from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789265164.620158:0:7470:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000097b6b08c 3 00010000:00080000:0.0:1789265164.620182:0:7470:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009ea9a9b4@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.149@tcp at head 00010000:00010000:0.0:1789265164.624057:0:7470:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-4 is initialized 00000020:00000080:0.0:1789265164.624265:0:7470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1789265164.624327:0:7470:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789265164.624344:0:7470:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x9272d942b4a96316 00000100:00080000:0.0:1789265164.624355:0:7470:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789265164.624359:0:7470:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000009ea9a9b4 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:0.0:1789265164.624389:0:7470:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000003e58645 x1876180417390208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265164.624909:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003e58645 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876180417390208:0@lo:38: 00000100:00100000:2.0:1789265164.625294:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789265164.625390:0:7470:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:2.0:1789265164.626279:0:7470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:3.0:1789265164.626597:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417390208 00000100:00100000:3.0:1789265164.626607:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417390208 00000100:00100000:2.0:1789265164.626702:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265164.626709:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000971c2771 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1876180417390208:12345-0@lo:38: 00010000:00080000:2.0:1789265164.626733:0:6517:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:2.0:1789265164.626772:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x9272d942b4a9631d 00000004:00100000:2.0:1789265164.626786:0:6517:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789265164.626812:0:6517:0:(import.c:65:import_set_state_nolock()) 00000000bee90a7b : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265164.626880:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000971c2771 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876180417390208:12345-0@lo:38: Request processed in 171us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265164.626888:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789265164.626924:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000003e58645 x1876180417390208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265164.626935:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789265164.626943:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789265164.626959:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789265164.626963:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789265164.626965:0:3640:0:(import.c:65:import_set_state_nolock()) 000000009ea9a9b4 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789265164.626970:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003e58645 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876180417390208:0@lo:38: 40000000:00080000:0.0:1789265164.627243:0:7471:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:0.0:1789265164.628329:0:7446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1789265164.628369:0:7446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789265164.628392:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: 00000000f59a89bc/0x9272d942b4a96301 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96308 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265164.628403:0:7446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: 00000000f59a89bc/0x9272d942b4a96301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96308 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789265164.628465:0:7446:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789265164.628468:0:7446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789265164.628469:0:7446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265164.628470:0:7446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265164.628471:0:7446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265164.628473:0:7446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265164.628474:0:7446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789265164.628475:0:7446:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789265164.628477:0:7446:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789265164.628478:0:7446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265164.628479:0:7446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789265164.628483:0:7446:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1789265164.628485:0:7446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789265164.628486:0:7446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789265164.628487:0:7446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265164.628488:0:7446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265164.628489:0:7446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265164.628495:0:7446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265164.628496:0:7446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789265164.628497:0:7446:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789265164.628498:0:7446:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789265164.628498:0:7446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265164.628499:0:7446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789265164.628530:0:7446:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789265164.628547:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009728c49f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417390336:0@lo:253: 00000100:00100000:0.0:1789265164.628602:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265164.628643:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417390336 00000100:00100000:0.0:1789265164.628649:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417390336 00000100:00100000:0.0:1789265164.628833:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789265164.628841:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000249eca16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+18:7446:x1876180417390336:12345-0@lo:253: 20000000:01000000:0.0:1789265164.628864:0:7458:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789265164.628876:0:7458:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789265164.629468:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 000000000351209c going to sleep for 11 seconds 00000001:00100000:3.0:1789265164.633083:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1789265164.633619:0:7458:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789265164.633638:0:7458:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1789265164.633770:0:6532:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789265164.633775:0:6532:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789265164.633792:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d05b2bd7/0x9272d942b4a96324 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.633810:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000073ce4217/0x9272d942b4a96205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a961fe expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.633816:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c555c898/0x9272d942b4a962ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a962de expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.633832:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d05b2bd7/0x9272d942b4a96324 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.633865:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c555c898/0x9272d942b4a962ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a962de expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.633876:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c555c898/0x9272d942b4a962ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a962de expref: 18 pid: 6508 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265164.633889:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4bd1125 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876180417390464:0@lo:104: 00000100:00100000:3.0:1789265164.633946:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265164.634000:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000073ce4217/0x9272d942b4a96205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a961fe expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.634007:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000073ce4217/0x9272d942b4a96205 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a961fe expref: 18 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265164.634014:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d6e4ec6e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876180417390592:0@lo:104: 00000100:00100000:3.0:1789265164.634055:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265164.634078:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e196793 going to sleep for 11 seconds 00000100:00100000:2.0:1789265164.634154:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417390464 00000100:00100000:2.0:1789265164.634162:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417390464 00000100:00100000:2.0:1789265164.634196:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417390592 00000100:00100000:2.0:1789265164.634199:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417390592 00000100:00100000:2.0:1789265164.634216:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789265164.634224:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ae68bf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+4:6532:x1876180417390464:12345-0@lo:104: 00010000:00010000:2.0:1789265164.634236:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: 00000000cbd5197a/0x9272d942b4a962de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a962ec expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.634405:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265164.634446:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ae68bf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+4:6532:x1876180417390464:12345-0@lo:104: Request processed in 188us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265164.634447:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000249eca16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+18:7446:x1876180417390336:12345-0@lo:253: Request processed in 5463us (5701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265164.634459:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789265164.634462:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789265164.634487:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265164.634494:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007da24b09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+3:6532:x1876180417390592:12345-0@lo:104: 00010000:00010000:2.0:1789265164.634501:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: 0000000028461d62/0x9272d942b4a961fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96205 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.634547:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789265164.634551:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007da24b09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+3:6532:x1876180417390592:12345-0@lo:104: Request processed in 60us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265164.634557:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789265164.634576:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265164.634580:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: 00000000cbd5197a/0x9272d942b4a962de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a962ec expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.634587:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cbd5197a already unused, calling callback (00000000b05a377f) 10000000:00010000:2.0:1789265164.634590:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: 00000000cbd5197a/0x9272d942b4a962de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a962ec expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.634594:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265164.634598:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: 00000000cbd5197a/0x9272d942b4a962de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a962ec expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265164.634607:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: 00000000cbd5197a/0x9272d942b4a962de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a962ec expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265164.634613:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1789265164.634649:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4bd1125 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876180417390464:0@lo:104: 00010000:00010000:2.0:1789265164.634650:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: 00000000cbd5197a/0x9272d942b4a962de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a962ec expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265164.634660:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d6e4ec6e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876180417390592:0@lo:104: 00010000:00010000:2.0:1789265164.634669:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265164.634680:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d05b2bd7/0x9272d942b4a96324 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265164.634708:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009728c49f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:7446:1876180417390336:0@lo:253: 10000000:01000000:0.0:1789265164.634716:0:7446:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789265164.634719:0:7446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789265164.634721:0:7446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789265164.634722:0:7446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265164.634723:0:7446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265164.634724:0:7446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265164.634725:0:7446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265164.634726:0:7446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789265164.634733:0:7446:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789265164.634734:0:7446:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789265164.634736:0:7446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265164.634737:0:7446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789265164.634746:0:7446:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789265164.635429:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1789265164.635450:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: 00000000cbd5197a/0x9272d942b4a962de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a962ec expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.635470:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: 00000000cbd5197a/0x9272d942b4a962de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a962ec expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.635482:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265164.635484:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265164.635487:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265164.635804:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054e2a440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417390720:0@lo:103: 00000100:00100000:3.0:1789265164.635853:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265164.635962:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265164.635965:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265164.635966:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265164.638087:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: 0000000028461d62/0x9272d942b4a961fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96205 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.638130:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000028461d62 already unused, calling callback (00000000b05a377f) 10000000:00010000:1.0:1789265164.638134:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: 0000000028461d62/0x9272d942b4a961fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a96205 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.638144:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: 0000000028461d62/0x9272d942b4a961fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a96205 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265164.638151:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: 0000000028461d62/0x9272d942b4a961fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a96205 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265164.638156:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789265164.638207:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: 0000000028461d62/0x9272d942b4a961fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96205 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.638215:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265164.638249:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: 0000000028461d62/0x9272d942b4a961fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96205 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.638256:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: 0000000028461d62/0x9272d942b4a961fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96205 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265164.638285:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265164.638288:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265164.638290:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265164.638825:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417390720 00000100:00100000:2.0:1789265164.638835:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417390720 00010000:00010000:2.0:1789265164.638878:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c555c898/0x9272d942b4a962ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a962de expref: 18 pid: 6508 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265164.638973:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789265164.638983:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a456d5f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+18:3641:x1876180417390720:12345-0@lo:103: 00010000:00010000:2.0:1789265164.638996:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265164.639001:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c555c898/0x9272d942b4a962ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a962de expref: 18 pid: 6508 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.639036:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c555c898/0x9272d942b4a962ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a962de expref: 18 pid: 6508 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.639059:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c555c898/0x9272d942b4a962ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a962de expref: 18 pid: 6508 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.639080:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265164.639166:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a456d5f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+17:3641:x1876180417390720:12345-0@lo:103: Request processed in 185us (3312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265164.639173:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789265164.639335:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cde2813a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417390848:0@lo:103: 00000100:00100000:2.0:1789265164.639394:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265164.639507:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054e2a440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417390720:0@lo:103: 00000100:00100000:3.0:1789265164.639554:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417390848 00000100:00100000:3.0:1789265164.639565:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417390848 00010000:00010000:3.0:1789265164.639581:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000073ce4217/0x9272d942b4a96205 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a961fe expref: 17 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265164.639645:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789265164.639652:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a38130e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+17:3643:x1876180417390848:12345-0@lo:103: 00010000:00010000:3.0:1789265164.639669:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265164.639672:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000073ce4217/0x9272d942b4a96205 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a961fe expref: 17 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.639686:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000073ce4217/0x9272d942b4a96205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a961fe expref: 17 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.639696:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000073ce4217/0x9272d942b4a96205 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a961fe expref: 17 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.639707:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d05b2bd7/0x9272d942b4a96324 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.639723:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d05b2bd7/0x9272d942b4a96324 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789265164.639736:0:6502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005962423s 00010000:00010000:3.0:1789265164.639741:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d05b2bd7/0x9272d942b4a96324 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.639746:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d05b2bd7/0x9272d942b4a96324 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.639752:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d05b2bd7/0x9272d942b4a96324 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.639766:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d05b2bd7/0x9272d942b4a96324 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.639771:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d05b2bd7 already unused, calling callback (00000000ff461ba4) 00010000:00010000:3.0:1789265164.639773:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d05b2bd7/0x9272d942b4a96324 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.639780:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d05b2bd7/0x9272d942b4a96324 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.639802:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d05b2bd7/0x9272d942b4a96324 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265164.639812:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265164.639857:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a38130e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+16:3643:x1876180417390848:12345-0@lo:103: Request processed in 206us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265164.639864:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265164.639953:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cde2813a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417390848:0@lo:103: 00010000:00010000:2.0:1789265164.639977:0:6532:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d05b2bd7/0x9272d942b4a96324 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.639984:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d05b2bd7/0x9272d942b4a96324 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265164.639988:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d05b2bd7/0x9272d942b4a96324 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1789265164.641301:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1789265164.641429:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789265164.641676:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1789265164.641850:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789265164.642182:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1789265164.642290:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1789265164.642988:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1789265164.643248:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1789265164.643425:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1789265164.643582:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1789265164.643759:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1789265164.643962:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:0.0:1789265164.648799:0:7446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1789265164.649243:0:7477:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1789265164.649295:0:7477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054e2a440 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7477:1876180417390976:0@lo:700: 00000100:00100000:2.0:1789265164.649356:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265164.649407:0:7477:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b740f781 going to sleep for 11 seconds 00000100:00100000:3.0:1789265164.649465:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417390976 00000100:00100000:3.0:1789265164.649472:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417390976 00000100:00100000:3.0:1789265164.649517:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265164.649525:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000868d6134 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7477:x1876180417390976:12345-0@lo:700: 00000040:01000000:0.0:1789265164.649944:0:7446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000020:00080000:1.0:1789265164.650287:0:7476:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1789265164.650291:0:7476:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:2.0:1789265164.650445:0:7478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025222265 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1876180417391104:0@lo:1000: 00000100:00100000:2.0:1789265164.650487:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265164.650520:0:7478:0:(client.c:2715:ptlrpc_set_wait()) set 00000000acc27c7e going to sleep for 11 seconds 00000100:00100000:1.0:1789265164.650622:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417391104 00000100:00100000:1.0:1789265164.650627:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417391104 00000100:00100000:1.0:1789265164.650771:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265164.650780:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3b98457 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7478:x1876180417391104:12345-0@lo:1000: 00000100:00100000:1.0:1789265164.650856:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3b98457 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7478:x1876180417391104:12345-0@lo:1000: Request processed in 78us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265164.650863:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:01000000:0.0:1789265164.651277:0:7446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1789265164.651426:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265164.651824:0:7478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025222265 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1876180417391104:0@lo:1000: 00000040:01000000:3.0:1789265164.651855:0:7478:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1789265164.651883:0:7478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057286701 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1876180417391232:0@lo:700: 00000100:00100000:3.0:1789265164.651922:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265164.651950:0:7478:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cb80472c going to sleep for 11 seconds 00000100:00100000:1.0:1789265164.652090:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417391232 00000100:00100000:1.0:1789265164.652096:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417391232 00000100:00100000:1.0:1789265164.652137:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265164.652144:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a456d5f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7478:x1876180417391232:12345-0@lo:700: 00000100:00100000:1.0:1789265164.652204:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a456d5f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7478:x1876180417391232:12345-0@lo:700: Request processed in 60us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265164.652211:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265164.652266:0:7478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057286701 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1876180417391232:0@lo:700: 00000100:00100000:2.0:1789265164.652303:0:7478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000091ad8557 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7478:1876180417391360:0@lo:900: 00000100:00100000:2.0:1789265164.652328:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265164.652359:0:7478:0:(client.c:2715:ptlrpc_set_wait()) set 000000000329bc21 going to sleep for 11 seconds 00000100:00100000:1.0:1789265164.652825:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417391360 00000100:00100000:1.0:1789265164.652840:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417391360 00000100:00100000:1.0:1789265164.652874:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265164.652880:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017d4a85c pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7478:x1876180417391360:12345-0@lo:900: 00000004:00000080:0.0:1789265164.653182:0:7446:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789265164.653191:0:7446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1789265164.653409:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789265164.653770:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017d4a85c pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7478:x1876180417391360:12345-0@lo:900: Request processed in 888us (1439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265164.653778:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789265164.657159:0:7478:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000091ad8557 x1876180417391360/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789265180 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265164.657292:0:7478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000091ad8557 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7478:1876180417391360:0@lo:900: 00000040:00080000:0.0:1789265164.657302:0:7446:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1789265164.657453:0:7478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000091ad8557 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1876180417391488:0@lo:1000: 00000100:00100000:2.0:1789265164.657720:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265164.657769:0:7478:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a34f439f going to sleep for 11 seconds 00000100:00100000:1.0:1789265164.658073:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417391488 00000100:00100000:1.0:1789265164.658080:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417391488 00000100:00100000:1.0:1789265164.658134:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789265164.658143:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1789265164.658144:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f79ba545 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7478:x1876180417391488:12345-0@lo:1000: 00000100:00100000:2.0:1789265164.658153:0:6521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1789265164.658252:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f79ba545 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7478:x1876180417391488:12345-0@lo:1000: Request processed in 109us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265164.658261:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789265164.658297:0:7478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000091ad8557 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1876180417391488:0@lo:1000: 00000004:00080000:2.0:1789265164.658341:0:7478:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000000329bc21 with version 0 00000020:00100000:2.0:1789265164.658356:0:7478:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789265164.658362:0:7478:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000091ad8557 x1876180417391744/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265164.658388:0:7478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000091ad8557 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1876180417391744:0@lo:1000: 00000100:00100000:2.0:1789265164.658424:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265164.658450:0:7478:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cdd2e2bf going to sleep for 11 seconds 00000100:00100000:1.0:1789265164.658568:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417391744 00000100:00100000:1.0:1789265164.658573:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417391744 00000100:00100000:1.0:1789265164.658591:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265164.658597:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037337773 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7478:x1876180417391744:12345-0@lo:1000: 00000040:00080000:0.0:1789265164.658899:0:7446:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789265164.659197:0:7446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1789265164.659674:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789265164.659915:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1789265164.661350:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1789265164.661909:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1789265164.662156:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1789265164.662545:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789265164.662858:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789265164.663183:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789265164.663507:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789265164.663649:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789265164.663824:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789265164.663972:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789265164.664193:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789265164.664336:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789265164.664518:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789265164.664651:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789265164.664813:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789265164.664943:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 40000000:02000000:3.0:1789265164.665220:0:6523:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:0.0:1789265164.665285:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789265164.665428:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789265164.665576:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789265164.665735:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789265164.665885:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789265164.666020:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789265164.666183:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789265164.666345:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789265164.666480:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789265164.666612:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789265164.666758:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789265164.666917:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789265164.667083:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789265164.667242:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789265164.667521:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789265164.667618:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789265164.667852:0:7446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1789265164.672652:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000868d6134 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7477:x1876180417390976:12345-0@lo:700: Request processed in 23119us (23288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265164.672668:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789265164.672691:0:7477:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000054e2a440 x1876180417390976/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789265180 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265164.672709:0:7477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054e2a440 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7477:1876180417390976:0@lo:700: 40000000:02000000:2.0:1789265164.672723:0:7477:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:0.0:1789265164.678925:0:7446:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789265164.678967:0:7446:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbf45c19c3988 00100000:10000000:0.0:1789265164.678976:0:7446:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000001:00080000:1.0:1789265164.680150:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:0.0:1789265164.680304:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037337773 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7478:x1876180417391744:12345-0@lo:1000: Request processed in 21704us (21876us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789265164.680317:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000004:00080000:2.0:1789265164.680542:0:7478:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1789265164.680547:0:7478:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789265164.680561:0:7478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000091ad8557 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1876180417391744:0@lo:1000: 00000100:00100000:2.0:1789265164.680767:0:7478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000091ad8557 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1876180417391872:0@lo:1000: 00000100:00100000:2.0:1789265164.680805:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265164.680848:0:7478:0:(client.c:2715:ptlrpc_set_wait()) set 000000008dfba867 going to sleep for 11 seconds 00000100:00100000:2.0:1789265164.680864:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417391872 00000100:00100000:2.0:1789265164.680870:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417391872 00000100:00100000:2.0:1789265164.680919:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265164.680926:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054e2a440 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7478:x1876180417391872:12345-0@lo:1000: 00000100:00100000:2.0:1789265164.680991:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054e2a440 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7478:x1876180417391872:12345-0@lo:1000: Request processed in 66us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265164.680998:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265164.681052:0:7478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000091ad8557 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1876180417391872:0@lo:1000: 00000040:00080000:2.0:1789265164.681069:0:7478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1789265164.681096:0:7478:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000000329bc21 with version 1 00000040:00080000:2.0:1789265164.687561:0:7478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789265164.687646:0:7478:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000020:01000004:0.0:1789265164.689595:0:7446:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789265164.689632:0:7446:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.149@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789265164.689653:0:7446:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000004:00080000:2.0:1789265164.690893:0:7467:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000873c3798 version 1 rpc_version 1 00000020:00100000:2.0:1789265164.690937:0:7467:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789265164.690950:0:7467:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000091ad8557 x1876180417392128/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265164.690973:0:7467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000091ad8557 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7467:1876180417392128:0@lo:1000: 00000100:00100000:2.0:1789265164.691057:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265164.691113:0:7467:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cdd2e2bf going to sleep for 11 seconds 00000080:00000004:0.0:1789265164.691190:0:7446:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000100:00100000:3.0:1789265164.691751:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417392128 00000100:00100000:3.0:1789265164.691760:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417392128 00000100:00100000:3.0:1789265164.691813:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789265164.691823:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002237710d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1876180417392128:12345-0@lo:1000: 00000020:00000004:0.0:1789265164.691986:0:7446:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789265164.692232:0:7446:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000001:00080000:2.0:1789265164.708391:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1789265164.708515:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002237710d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1876180417392128:12345-0@lo:1000: Request processed in 16691us (17456us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789265164.708528:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00080000:2.0:1789265164.708584:0:7467:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1789265164.708589:0:7467:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789265164.708606:0:7467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000091ad8557 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7467:1876180417392128:0@lo:1000: 00000040:00080000:2.0:1789265164.721729:0:7477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789265164.739292:0:7477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789265164.739379:0:7477:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789265164.739391:0:7477:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000100:00100000:1.0:1789265165.569554:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d086a5dd going to sleep for 0 seconds 00010000:00010000:2.0:1789265165.634796:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265166.596519:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d086a5dd going to sleep for 0 seconds 00010000:00010000:1.0:1789265166.657466:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265167.626501:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d086a5dd going to sleep for 0 seconds 00010000:00010000:2.0:1789265167.683251:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265168.643217:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d086a5dd going to sleep for 0 seconds 00010000:00010000:2.0:1789265168.709727:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789265168.733672:0:7723:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg349-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:1.0:1789265169.591938:0:7775:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789265169.592297:0:7775:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789265169.666076:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d086a5dd going to sleep for 0 seconds 00010000:00010000:0.0:1789265169.729528:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789265169.921391:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789265169.921405:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789265169.921408:0:37:0:(import.c:65:import_set_state_nolock()) 000000004df54d3c lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265169.921420:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 215 00000100:00080000:2.0:1789265169.921428:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789265169.921436:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000004df54d3c using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265169.921465:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000025222265 x1876180417392512/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789265169.921558:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f1a8abf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417392384:0@lo:400: 00000100:00100000:2.0:1789265169.921558:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025222265 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417392512:0@lo:38: 00000100:00100000:0.0:1789265169.921689:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000091ad8557 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417392256:0@lo:400: 00000100:00100000:1.0:1789265169.921779:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ceba97f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417392768:0@lo:400: 00000100:00100000:3.0:1789265169.931269:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265169.931446:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265169.931484:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417392256 00000100:00100000:3.0:1789265169.931495:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417392256 00000100:00100000:3.0:1789265169.931554:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789265169.931563:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aac27132 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+16:3644:x1876180417392256:12345-0@lo:400: 00000100:00100000:1.0:1789265169.931759:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ba9b6ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417392640:0@lo:400: 00000100:00100000:1.0:1789265169.931805:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265169.932113:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417392384 00000100:00100000:1.0:1789265169.932119:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417392384 00000100:00100000:1.0:1789265169.932161:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265169.932167:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c13dd9a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417392384:12345-0@lo:400: 00000100:00100000:1.0:1789265169.932234:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c13dd9a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417392384:12345-0@lo:400: Request processed in 68us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265169.932242:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789265169.932433:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000004f1a8abf x1876180417392384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265169.932450:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f1a8abf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417392384:0@lo:400: 00000100:00100000:1.0:1789265169.932500:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265169.932612:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265169.932620:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001c0f3c96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417392896:0@lo:41: 00000100:00100000:1.0:1789265169.932652:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265169.932684:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417392768 00000100:00100000:1.0:1789265169.932688:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417392768 00000100:00100000:1.0:1789265169.932713:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265169.932719:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002514c954 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417392768:12345-0@lo:400: 00000100:00100000:3.0:1789265169.932749:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aac27132 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+16:3644:x1876180417392256:12345-0@lo:400: Request processed in 1188us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265169.932750:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002514c954 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417392768:12345-0@lo:400: Request processed in 32us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265169.932756:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789265169.932758:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1789265169.932783:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ceba97f3 x1876180417392768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265169.932793:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ceba97f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417392768:0@lo:400: 00000100:00100000:3.0:1789265169.932797:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417392640 00000100:00100000:3.0:1789265169.932800:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417392640 00000100:00100000:3.0:1789265169.932826:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417392896 00000100:00100000:3.0:1789265169.932829:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417392896 00000100:00100000:3.0:1789265169.932841:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265169.932846:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2394204 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1876180417392640:12345-0@lo:400: 00000100:00100000:3.0:1789265169.932900:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2394204 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1876180417392640:12345-0@lo:400: Request processed in 54us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265169.932907:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265169.932918:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265169.932924:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a008e82 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417392896:12345-0@lo:41: 00000004:00000024:3.0:1789265169.933145:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789265169.933151:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000091ad8557 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417392256:0@lo:400: 00000100:00100000:3.0:1789265169.933189:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a008e82 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417392896:12345-0@lo:41: Request processed in 265us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265169.933195:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265169.933202:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001c0f3c96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417392896:0@lo:41: 00000100:00100000:2.0:1789265169.933408:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265169.933642:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417392512 00000100:00100000:0.0:1789265169.933648:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417392512 00000100:00100000:0.0:1789265169.933718:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265169.933728:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af441392 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1876180417392512:12345-0@lo:38: 00010000:00080000:0.0:1789265169.933755:0:7479:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 221 last 0 00000100:00100000:1.0:1789265169.933763:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ba9b6ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417392640:0@lo:400: 00000020:00000080:0.0:1789265169.933797:0:7479:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9272d942b4a9632b 00000004:00100000:0.0:1789265169.933816:0:7479:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789265169.933823:0:7479:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1789265169.968389:0:7479:0:(import.c:65:import_set_state_nolock()) 000000000dbcf8af : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265169.968552:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af441392 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1876180417392512:12345-0@lo:38: Request processed in 34820us (35265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265169.968565:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789265169.968754:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789265169.968766:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789265169.968777:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789265169.968783:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789265169.968785:0:3640:0:(import.c:65:import_set_state_nolock()) 000000004df54d3c lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1789265169.968809:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000d086a5dd): req@00000000bc238ecc x1876180417388288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265169.968838:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025222265 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417392512:0@lo:38: 00000100:00100000:1.0:1789265169.968976:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265169.968994:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000005415b5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417393024:0@lo:41: 00000100:00100000:1.0:1789265169.969092:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265169.969160:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417393024 00000100:00100000:1.0:1789265169.969168:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417393024 00000100:00100000:1.0:1789265169.969209:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265169.969219:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000396076c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180417393024:12345-0@lo:41: 00000004:00000024:1.0:1789265169.969255:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789265169.969297:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000396076c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180417393024:12345-0@lo:41: Request processed in 80us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265169.969304:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265169.969352:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000005415b5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417393024:0@lo:41: 00000100:00100000:3.0:1789265169.969617:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265169.969650:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d086a5dd going to sleep for 11 seconds 00000100:00100000:1.0:1789265169.969912:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417388288 00000100:00100000:1.0:1789265169.969918:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417388288 00000100:00100000:1.0:1789265169.969965:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789265169.969973:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057286701 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7464:x1876180417388288:12345-0@lo:1000: 00000100:00100000:1.0:1789265169.970080:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057286701 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7464:x1876180417388288:12345-0@lo:1000: Request processed in 108us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265169.970098:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789265169.970130:0:7464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc238ecc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7464:1876180417388288:0@lo:1000: 00000040:01000000:1.0:1789265169.970176:0:7464:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789265169.970214:0:7464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc238ecc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7464:1876180417393152:0@lo:1000: 00000100:00100000:1.0:1789265169.970250:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265169.970274:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set 0000000012534972 going to sleep for 11 seconds 00000100:00100000:1.0:1789265169.970286:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417393152 00000100:00100000:1.0:1789265169.970290:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417393152 00000100:00100000:1.0:1789265169.970306:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265169.970311:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005415b5e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7464:x1876180417393152:12345-0@lo:1000: 00000100:00100000:1.0:1789265169.970422:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005415b5e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7464:x1876180417393152:12345-0@lo:1000: Request processed in 110us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265169.970429:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265169.970454:0:7464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc238ecc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7464:1876180417393152:0@lo:1000: 00000100:00100000:1.0:1789265169.970496:0:7464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc238ecc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7464:1876180417393280:0@lo:700: 00000100:00100000:1.0:1789265169.970522:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265169.970538:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set 0000000052d078b0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265169.970551:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417393280 00000100:00100000:1.0:1789265169.970554:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417393280 00000100:00100000:1.0:1789265169.970609:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265169.970615:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d1700bd pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7464:x1876180417393280:12345-0@lo:700: 00000100:00100000:1.0:1789265169.970798:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d1700bd pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7464:x1876180417393280:12345-0@lo:700: Request processed in 183us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265169.970805:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265169.970832:0:7464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc238ecc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7464:1876180417393280:0@lo:700: 00000100:00100000:1.0:1789265169.970937:0:7464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc238ecc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7464:1876180417393408:0@lo:1000: 00000100:00100000:1.0:1789265169.971050:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265169.971067:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e8cb4f3c going to sleep for 11 seconds 00000100:00100000:1.0:1789265169.971163:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417393408 00000100:00100000:1.0:1789265169.971167:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417393408 00000100:00100000:1.0:1789265169.971186:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789265169.971192:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f780a350 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7464:x1876180417393408:12345-0@lo:1000: 00000100:00100000:1.0:1789265169.971249:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f780a350 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7464:x1876180417393408:12345-0@lo:1000: Request processed in 57us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265169.971256:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789265169.971279:0:7464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc238ecc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7464:1876180417393408:0@lo:1000: 00000004:00080000:1.0:1789265169.971323:0:7464:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000052d078b0 with version 0 00000020:00100000:1.0:1789265169.971338:0:7464:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789265169.971346:0:7464:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000bc238ecc x1876180417393664/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265169.971361:0:7464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc238ecc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7464:1876180417393664:0@lo:1000: 00000100:00100000:1.0:1789265169.971385:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265169.971399:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set 000000000a64ea21 going to sleep for 11 seconds 00000100:00100000:1.0:1789265169.971409:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417393664 00000100:00100000:1.0:1789265169.971412:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417393664 00000100:00100000:1.0:1789265169.971441:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789265169.971446:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b4093a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7464:x1876180417393664:12345-0@lo:1000: 00000001:00080000:0.0:1789265169.981517:0:7448:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1789265169.981536:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789265169.996954:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b4093a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7464:x1876180417393664:12345-0@lo:1000: Request processed in 25495us (25555us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789265169.996987:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1789265169.997094:0:7464:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1789265169.997116:0:7464:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789265169.997135:0:7464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc238ecc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7464:1876180417393664:0@lo:1000: 00000100:00100000:2.0:1789265169.997247:0:7464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b81d853 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7464:1876180417393792:0@lo:1000: 00000100:00100000:2.0:1789265169.997291:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265169.997318:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set 000000004148a756 going to sleep for 11 seconds 00000100:00100000:2.0:1789265169.997343:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417393792 00000100:00100000:2.0:1789265169.997350:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417393792 00000100:00100000:2.0:1789265169.997721:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789265169.997733:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a584f3bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7464:x1876180417393792:12345-0@lo:1000: 00000100:00100000:2.0:1789265169.997829:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a584f3bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7464:x1876180417393792:12345-0@lo:1000: Request processed in 98us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265169.997836:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789265169.997872:0:7464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b81d853 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7464:1876180417393792:0@lo:1000: 00000040:00080000:2.0:1789265169.997894:0:7464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1789265169.997933:0:7464:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000005f7f4993 with version 1 00000004:00080000:3.0:1789265170.003092:0:7462:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000713a09dc version 1 rpc_version 1 00000020:00100000:3.0:1789265170.003157:0:7462:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789265170.003172:0:7462:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000d6e4ec6e x1876180417394048/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789265170.003203:0:7462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d6e4ec6e pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7462:1876180417394048:0@lo:1000: 00000100:00100000:3.0:1789265170.003294:0:7462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265170.003341:0:7462:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fca0e0da going to sleep for 11 seconds 00000100:00100000:0.0:1789265170.003430:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417394048 00000100:00100000:0.0:1789265170.003442:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417394048 00000100:00100000:0.0:1789265170.003515:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789265170.003525:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4bd1125 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7462:x1876180417394048:12345-0@lo:1000: 00000001:00080000:0.0:1789265170.006751:0:7448:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1789265170.006925:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4bd1125 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7462:x1876180417394048:12345-0@lo:1000: Request processed in 3396us (3626us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789265170.006941:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:3.0:1789265170.007110:0:7462:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1789265170.007116:0:7462:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789265170.007140:0:7462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d6e4ec6e pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7462:1876180417394048:0@lo:1000: 00000040:00080000:2.0:1789265170.010205:0:7464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789265170.010313:0:7464:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 6, retries 0 00000004:00080000:2.0:1789265170.010319:0:7464:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1789265170.754055:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789265170.946454:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789265170.946467:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fccad90a000 from 4 10000000:01000000:2.0:1789265170.946473:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789265170.946532:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: 0000000012970f0f/0x9272d942b4a96332 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265170.946548:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: 0000000012970f0f/0x9272d942b4a96332 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265170.946586:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: 0000000012970f0f/0x9272d942b4a96332 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265170.947468:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b81d853 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417394176:0@lo:101: 00000100:00100000:2.0:1789265170.947555:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265170.947619:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 000000008b149404 going to sleep for 11 seconds 00000100:00100000:1.0:1789265170.947779:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417394176 00000100:00100000:1.0:1789265170.947789:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417394176 00000100:00100000:1.0:1789265170.947861:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789265170.947870:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000889cb594 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+16:6513:x1876180417394176:12345-0@lo:101: 00010000:00010000:1.0:1789265170.947890:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265170.947910:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000778841a/0x9272d942b4a96339 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96332 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265170.947940:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000778841a/0x9272d942b4a96339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96332 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265170.947952:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000778841a/0x9272d942b4a96339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96332 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265170.947970:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000778841a, rc 0) 00000100:00100000:1.0:1789265170.948052:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000889cb594 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417394176:12345-0@lo:101: Request processed in 182us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265170.948060:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789265170.948557:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b81d853 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417394176:0@lo:101: 00010000:00010000:2.0:1789265170.948598:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: 0000000012970f0f/0x9272d942b4a96332 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96339 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265170.948610:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: 0000000012970f0f/0x9272d942b4a96332 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96339 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265170.948746:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b81d853 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417394304:0@lo:256: 00000100:00100000:2.0:1789265170.948789:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265170.948822:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 000000008b149404 going to sleep for 11 seconds 00000100:00100000:3.0:1789265170.949145:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417394304 00000100:00100000:3.0:1789265170.949153:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417394304 00000100:00100000:3.0:1789265170.949206:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789265170.949214:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f5b0ff3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417394304:12345-0@lo:256: 20000000:01000000:3.0:1789265170.949243:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789265170.949265:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789265170.949268:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789265170.949589:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f5b0ff3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417394304:12345-0@lo:256: Request processed in 375us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265170.949837:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b81d853 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417394304:0@lo:256: 10000000:01000000:2.0:1789265170.949897:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789265170.949904:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: 0000000012970f0f/0x9272d942b4a96332 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96339 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265170.949914:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: 0000000012970f0f/0x9272d942b4a96332 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96339 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265170.949925:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789265170.949928:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fcc8a583000 from 4 10000000:01000000:2.0:1789265170.949935:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789265170.949962:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: 0000000028461d62/0x9272d942b4a96340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265170.949969:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: 0000000028461d62/0x9272d942b4a96340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265170.949978:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: 0000000028461d62/0x9272d942b4a96340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265170.949990:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b81d853 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417394432:0@lo:101: 00000100:00100000:3.0:1789265170.950434:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789265170.950523:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265170.950564:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 000000008b149404 going to sleep for 11 seconds 00000100:00100000:1.0:1789265170.950595:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417394432 00000100:00100000:1.0:1789265170.950604:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417394432 00000100:00100000:1.0:1789265170.950653:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789265170.950661:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ceaf8429 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417394432:12345-0@lo:101: 00010000:00010000:1.0:1789265170.950673:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265170.950687:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000044ac9794/0x9272d942b4a96347 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96340 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265170.950711:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000044ac9794/0x9272d942b4a96347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96340 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265170.950733:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000044ac9794/0x9272d942b4a96347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96340 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265170.950743:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000044ac9794, rc 0) 00000100:00100000:1.0:1789265170.950789:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ceaf8429 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+18:6513:x1876180417394432:12345-0@lo:101: Request processed in 129us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265170.950795:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789265170.950869:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b81d853 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417394432:0@lo:101: 00010000:00010000:2.0:1789265170.950890:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: 0000000028461d62/0x9272d942b4a96340 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96347 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265170.950899:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: 0000000028461d62/0x9272d942b4a96340 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96347 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265170.950944:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b81d853 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417394560:0@lo:256: 00000100:00100000:2.0:1789265170.950975:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265170.950995:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 000000008b149404 going to sleep for 11 seconds 00000100:00100000:0.0:1789265170.951040:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417394560 00000100:00100000:0.0:1789265170.951046:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417394560 00000100:00100000:0.0:1789265170.951092:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789265170.951098:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c23e2d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+18:6513:x1876180417394560:12345-0@lo:256: 20000000:01000000:0.0:1789265170.951113:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789265170.951128:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789265170.951131:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789265170.951216:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c23e2d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+18:6513:x1876180417394560:12345-0@lo:256: Request processed in 118us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265170.951223:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789265170.951512:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b81d853 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417394560:0@lo:256: 10000000:01000000:2.0:1789265170.951561:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789265170.951568:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: 0000000028461d62/0x9272d942b4a96340 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96347 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265170.951576:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: 0000000028461d62/0x9272d942b4a96340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96347 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265171.778455:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789265172.337895:0:7877:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789265172.338532:0:7877:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789265172.801235:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789265173.302850:0:7925:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe39340ae0 20000000:00000080:3.0:1789265173.302871:0:7925:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fccb4fcb400 uarg=0000000000000000 20000000:01000000:3.0:1789265173.302909:0:7925:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789265173.302915:0:7925:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789265173.302920:0:7925:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789265173.302994:0:7925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1789265173.303006:0:7925:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1789265173.307854:0:7925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265173.308281:0:7925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789265173.308310:0:7925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1789265173.308339:0:7925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1789265173.308354:0:7925:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789265173.308371:0:7925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c603346b/0x9272d942b4a9634e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265173.308388:0:7925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000053508460/0x9272d942b4a961cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a961c6 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265173.308395:0:7925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cb8f3154/0x9272d942b4a962fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a962f3 expref: 17 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265173.308401:0:7925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c603346b/0x9272d942b4a9634e lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265173.308438:0:7925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cb8f3154/0x9272d942b4a962fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a962f3 expref: 17 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265173.308451:0:7925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cb8f3154/0x9272d942b4a962fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a962f3 expref: 17 pid: 7458 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265173.308465:0:7925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d6e4ec6e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7925:1876180417394688:0@lo:104: 00000100:00100000:3.0:1789265173.308527:0:7925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265173.308585:0:7925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000053508460/0x9272d942b4a961cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a961c6 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265173.308598:0:7925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000053508460/0x9272d942b4a961cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a961c6 expref: 17 pid: 6508 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265173.308782:0:7925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8ab9510 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7925:1876180417394816:0@lo:104: 00000100:00100000:3.0:1789265173.308804:0:7925:0:(client.c:2715:ptlrpc_set_wait()) set 00000000af71fced going to sleep for 11 seconds 00000100:00100000:0.0:1789265173.308867:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789265173.308887:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265173.308911:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417394688 00000100:00100000:0.0:1789265173.308918:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417394688 00000100:00100000:0.0:1789265173.308956:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417394816 00000100:00100000:0.0:1789265173.308965:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417394816 00000100:00100000:0.0:1789265173.308980:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265173.308986:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a095e6bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+4:7925:x1876180417394688:12345-0@lo:104: 00010000:00010000:0.0:1789265173.308997:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: 0000000022b654d4/0x9272d942b4a962f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a962fa expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.309087:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789265173.309091:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a095e6bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+4:7925:x1876180417394688:12345-0@lo:104: Request processed in 106us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265173.309098:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265173.309132:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265173.309137:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009728c49f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+3:7925:x1876180417394816:12345-0@lo:104: 00010000:00010000:0.0:1789265173.309144:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: 0000000003b67a21/0x9272d942b4a961c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a961cd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.309174:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789265173.309178:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009728c49f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+3:7925:x1876180417394816:12345-0@lo:104: Request processed in 42us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265173.309183:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1789265173.309199:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265173.309203:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: 0000000022b654d4/0x9272d942b4a962f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a962fa expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.309209:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000022b654d4 already unused, calling callback (00000000b05a377f) 10000000:00010000:0.0:1789265173.309212:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: 0000000022b654d4/0x9272d942b4a962f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a962fa expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.309219:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: 0000000022b654d4/0x9272d942b4a962f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a962fa expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265173.309236:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: 0000000022b654d4/0x9272d942b4a962f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a962fa expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265173.309241:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789265173.309269:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: 0000000022b654d4/0x9272d942b4a962f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a962fa expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.309276:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265173.309292:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: 0000000022b654d4/0x9272d942b4a962f3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a962fa expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.309298:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: 0000000022b654d4/0x9272d942b4a962f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a962fa expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265173.309476:0:7925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d6e4ec6e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7925:1876180417394688:0@lo:104: 00000100:00100000:3.0:1789265173.309486:0:7925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8ab9510 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7925:1876180417394816:0@lo:104: 00010000:00010000:3.0:1789265173.309502:0:7925:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c603346b/0x9272d942b4a9634e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.309579:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265173.309582:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: 0000000003b67a21/0x9272d942b4a961c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a961cd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.309588:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000003b67a21 already unused, calling callback (00000000b05a377f) 10000000:00010000:0.0:1789265173.309590:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: 0000000003b67a21/0x9272d942b4a961c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a961cd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.309596:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: 0000000003b67a21/0x9272d942b4a961c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a961cd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265173.309600:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: 0000000003b67a21/0x9272d942b4a961c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a961cd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265173.309730:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789265173.309751:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: 0000000003b67a21/0x9272d942b4a961c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a961cd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.309758:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789265173.309800:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000597d6ef3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417395072:0@lo:103: 00000100:00100000:1.0:1789265173.309834:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265173.309910:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417395072 00000100:00100000:3.0:1789265173.309914:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417395072 00010000:00010000:3.0:1789265173.309931:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000053508460/0x9272d942b4a961cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a961c6 expref: 18 pid: 6508 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265173.309956:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789265173.309961:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc238ecc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+18:3643:x1876180417395072:12345-0@lo:103: 00010000:00010000:3.0:1789265173.309972:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265173.309976:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000053508460/0x9272d942b4a961cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a961c6 expref: 18 pid: 6508 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265173.309984:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000053508460/0x9272d942b4a961cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a961c6 expref: 18 pid: 6508 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265173.309995:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000053508460/0x9272d942b4a961cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a961c6 expref: 18 pid: 6508 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265173.310007:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265173.310708:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: 0000000003b67a21/0x9272d942b4a961c6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a961cd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.310717:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: 0000000003b67a21/0x9272d942b4a961c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a961cd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.310732:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265173.310733:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265173.310735:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265173.310741:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265173.310760:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ec350571 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417394944:0@lo:103: 00000100:00100000:0.0:1789265173.310795:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265173.310850:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789265173.310859:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1789265173.310951:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417394944 00000100:00100000:0.0:1789265173.310956:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417394944 00010000:00010000:0.0:1789265173.310974:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cb8f3154/0x9272d942b4a962fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a962f3 expref: 18 pid: 7458 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265173.310990:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789265173.310997:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265173.311003:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af31c4b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+18:3642:x1876180417394944:12345-0@lo:103: 00010000:00010000:0.0:1789265173.311011:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265173.311013:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cb8f3154/0x9272d942b4a962fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a962f3 expref: 18 pid: 7458 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.311042:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cb8f3154/0x9272d942b4a962fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a962f3 expref: 18 pid: 7458 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.311075:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cb8f3154/0x9272d942b4a962fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a962f3 expref: 18 pid: 7458 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.311086:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c603346b/0x9272d942b4a9634e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.311093:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c603346b/0x9272d942b4a9634e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.311104:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c603346b/0x9272d942b4a9634e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.311109:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c603346b/0x9272d942b4a9634e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.311114:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c603346b/0x9272d942b4a9634e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.311120:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c603346b/0x9272d942b4a9634e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.311125:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c603346b already unused, calling callback (00000000ff461ba4) 00010000:00010000:0.0:1789265173.311128:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c603346b/0x9272d942b4a9634e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.311134:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c603346b/0x9272d942b4a9634e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.311146:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c603346b/0x9272d942b4a9634e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.311164:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265173.311192:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af31c4b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+17:3642:x1876180417394944:12345-0@lo:103: Request processed in 190us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265173.311199:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265173.311228:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ec350571 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417394944:0@lo:103: 00010000:00010000:0.0:1789265173.311356:0:7925:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c603346b/0x9272d942b4a9634e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.311364:0:7925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c603346b/0x9272d942b4a9634e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.311369:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c603346b/0x9272d942b4a9634e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265173.316243:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc238ecc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+16:3643:x1876180417395072:12345-0@lo:103: Request processed in 6275us (6401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265173.316259:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265173.316759:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000597d6ef3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417395072:0@lo:103: 00010000:00010000:0.0:1789265173.826107:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265174.849607:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265175.041535:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265175.041572:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001c0f3c96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417395200:0@lo:41: 00000100:00100000:1.0:1789265175.041670:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265175.041753:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417395200 00000100:00100000:1.0:1789265175.041762:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417395200 00000100:00100000:1.0:1789265175.041823:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789265175.042005:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8ab9510 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417395328:0@lo:41: 00000100:00100000:3.0:1789265175.042082:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265175.042133:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417395328 00000100:00100000:3.0:1789265175.042137:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417395328 00000100:00100000:1.0:1789265175.042201:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cde2813a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417395200:12345-0@lo:41: 00000004:00000024:1.0:1789265175.042259:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1789265175.042318:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cde2813a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417395200:12345-0@lo:41: Request processed in 120us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265175.051649:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001c0f3c96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417395200:0@lo:41: 00000100:00100000:0.0:1789265175.052066:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d8b90191 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417395712:0@lo:400: 00000100:00100000:0.0:1789265175.052158:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265175.052203:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265175.052209:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ec350571 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417395584:0@lo:400: 00000100:00100000:0.0:1789265175.052244:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265175.052398:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417395712 00000100:00100000:0.0:1789265175.052407:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417395712 00000100:00100000:0.0:1789265175.052462:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417395584 00000100:00100000:0.0:1789265175.052465:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417395584 00000100:00100000:0.0:1789265175.052483:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265175.052512:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b813b512 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417395712:12345-0@lo:400: 00000100:00100000:0.0:1789265175.052571:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b813b512 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417395712:12345-0@lo:400: Request processed in 61us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265175.052579:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265175.052598:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265175.052603:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075dda884 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417395584:12345-0@lo:400: 00000100:00100000:0.0:1789265175.052631:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075dda884 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417395584:12345-0@lo:400: Request processed in 29us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265175.052637:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789265175.053138:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ec350571 x1876180417395584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265175.053155:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ec350571 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417395584:0@lo:400: 00010000:00080000:0.0:1789265175.053175:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d8b90191 x1876180417395712/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265175.053184:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d8b90191 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417395712:0@lo:400: 00000100:00100000:0.0:1789265175.053250:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000597d6ef3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417395456:0@lo:400: 00000100:00100000:0.0:1789265175.053294:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265175.053369:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417395456 00000100:00100000:0.0:1789265175.053373:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417395456 00000100:00100000:0.0:1789265175.053403:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789265175.053408:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042e34b86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+16:3642:x1876180417395456:12345-0@lo:400: 00000100:00100000:0.0:1789265175.053454:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042e34b86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+16:3642:x1876180417395456:12345-0@lo:400: Request processed in 46us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265175.053459:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789265175.053492:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000597d6ef3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417395456:0@lo:400: 00000100:00100000:1.0:1789265175.056222:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789265175.056268:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789265175.056291:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6e4ec6e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417395328:12345-0@lo:41: 00000004:00000024:3.0:1789265175.056352:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789265175.056473:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6e4ec6e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417395328:12345-0@lo:41: Request processed in 194us (14390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265175.056482:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789265175.056604:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8ab9510 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417395328:0@lo:41: 00010000:00010000:2.0:1789265175.880241:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265176.897220:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265177.922137:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265178.947369:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265179.969183:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265180.161252:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000882982e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417395840:0@lo:41: 00000100:00100000:1.0:1789265180.161357:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265180.161490:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417395840 00000100:00100000:3.0:1789265180.161501:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417395840 00000100:00100000:3.0:1789265180.161575:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789265180.161585:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c8f1ac6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417395840:12345-0@lo:41: 00000004:00000024:3.0:1789265180.161628:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789265180.161687:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c8f1ac6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417395840:12345-0@lo:41: Request processed in 104us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265180.161695:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789265180.161848:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000882982e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417395840:0@lo:41: 00000100:00100000:1.0:1789265180.162134:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265180.162143:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b47b9342 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417395968:0@lo:41: 00000100:00100000:1.0:1789265180.162176:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265180.162320:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417395968 00000100:00100000:3.0:1789265180.162324:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417395968 00000100:00100000:3.0:1789265180.162353:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789265180.162359:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff1317d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417395968:12345-0@lo:41: 00000004:00000024:3.0:1789265180.162382:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1789265180.162416:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff1317d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417395968:12345-0@lo:41: Request processed in 58us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265180.162432:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789265180.162485:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007fd60b19 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417396096:0@lo:400: 00000100:00100000:1.0:1789265180.162522:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265180.162567:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265180.162573:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008de4b511 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417396224:0@lo:400: 00000100:00100000:1.0:1789265180.162602:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265180.162631:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417396224 00000100:00100000:1.0:1789265180.162636:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417396224 00000100:00100000:1.0:1789265180.162669:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789265180.162675:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000cd1038a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417396224:12345-0@lo:400: 00000100:00100000:1.0:1789265180.162713:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000cd1038a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417396224:12345-0@lo:400: Request processed in 38us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265180.162719:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789265180.162760:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000008de4b511 x1876180417396224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265180.162774:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008de4b511 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417396224:0@lo:400: 00000100:00100000:1.0:1789265180.162801:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008e15ac96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417396352:0@lo:400: 00000100:00100000:1.0:1789265180.162825:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265180.162850:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b47b9342 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417395968:0@lo:41: 00000100:00100000:3.0:1789265180.162967:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417396096 00000100:00100000:3.0:1789265180.162972:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417396096 00000100:00100000:3.0:1789265180.163053:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789265180.163060:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8ba883 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+16:3643:x1876180417396096:12345-0@lo:400: 00000100:00100000:3.0:1789265180.163103:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8ba883 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+16:3643:x1876180417396096:12345-0@lo:400: Request processed in 45us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265180.163110:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789265180.163197:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417396352 00000100:00100000:0.0:1789265180.163202:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417396352 00000100:00100000:0.0:1789265180.163239:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789265180.163245:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c9d534a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417396352:12345-0@lo:400: 00000100:00100000:0.0:1789265180.163283:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c9d534a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417396352:12345-0@lo:400: Request processed in 38us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265180.163289:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265180.163373:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007fd60b19 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417396096:0@lo:400: 00010000:00080000:1.0:1789265180.163404:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000008e15ac96 x1876180417396352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265180.163413:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008e15ac96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417396352:0@lo:400: 00010000:00010000:3.0:1789265180.993323:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789265181.185287:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789265181.185296:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fccad90a000 from 1 10000000:01000000:1.0:1789265181.185301:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789265181.185355:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: 00000000cbd5197a/0x9272d942b4a96355 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265181.185370:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: 00000000cbd5197a/0x9272d942b4a96355 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265181.185384:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: 00000000cbd5197a/0x9272d942b4a96355 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265181.185484:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b47b9342 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417396480:0@lo:101: 00000100:00100000:1.0:1789265181.185580:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265181.185669:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 000000001a263c6b going to sleep for 11 seconds 00000100:00100000:0.0:1789265181.189226:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417396480 00000100:00100000:0.0:1789265181.189247:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417396480 00000100:00100000:0.0:1789265181.189363:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789265181.189373:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6874101 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+16:6513:x1876180417396480:12345-0@lo:101: 00010000:00010000:0.0:1789265181.189397:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265181.189431:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000097a9b2fb/0x9272d942b4a9635c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96355 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265181.189468:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000097a9b2fb/0x9272d942b4a9635c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96355 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265181.189482:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000097a9b2fb/0x9272d942b4a9635c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96355 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265181.189491:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000097a9b2fb, rc 0) 00000100:00100000:0.0:1789265181.189603:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6874101 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417396480:12345-0@lo:101: Request processed in 231us (4024us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265181.189610:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789265181.189706:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b47b9342 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417396480:0@lo:101: 00010000:00010000:3.0:1789265181.189727:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: 00000000cbd5197a/0x9272d942b4a96355 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9635c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265181.189738:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: 00000000cbd5197a/0x9272d942b4a96355 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9635c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265181.189839:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b833e29 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417396608:0@lo:501: 00000100:00100000:3.0:1789265181.189880:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265181.193983:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 000000008278e7e3 going to sleep for 11 seconds 00000100:00100000:1.0:1789265181.194141:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417396608 00000100:00100000:1.0:1789265181.194153:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417396608 00000100:00100000:1.0:1789265181.194230:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789265181.194240:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4ac175d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417396608:12345-0@lo:501: 00000100:00100000:1.0:1789265181.194530:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4ac175d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417396608:12345-0@lo:501: Request processed in 291us (4649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265181.194540:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789265181.196725:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b833e29 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417396608:0@lo:501: 00000100:00100000:3.0:1789265181.196815:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b833e29 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417396736:0@lo:503: 00000100:00100000:3.0:1789265181.196920:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265181.196979:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 000000008278e7e3 going to sleep for 11 seconds 00000100:00100000:0.0:1789265181.197154:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417396736 00000100:00100000:0.0:1789265181.197164:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417396736 00000100:00100000:0.0:1789265181.197232:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789265181.197243:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af77bd01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417396736:12345-0@lo:503: 00000100:00100000:0.0:1789265181.197386:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af77bd01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417396736:12345-0@lo:503: Request processed in 146us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265181.197395:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789265181.197585:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b833e29 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417396736:0@lo:503: 00000100:00100000:3.0:1789265181.197968:0:8344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b833e29 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:8344:1876180417396864:0@lo:502: 00000100:00100000:3.0:1789265181.198057:0:8344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265181.198090:0:8344:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042b4ba61 going to sleep for 11 seconds 00000100:00100000:0.0:1789265181.198145:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417396864 00000100:00100000:0.0:1789265181.198150:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417396864 00000100:00100000:0.0:1789265181.198189:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789265181.198197:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a476917e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+17:8344:x1876180417396864:12345-0@lo:502: 00000100:00100000:0.0:1789265181.198293:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a476917e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+17:8344:x1876180417396864:12345-0@lo:502: Request processed in 97us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265181.198300:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789265181.199566:0:8344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b833e29 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:8344:1876180417396864:0@lo:502: 00000020:01000000:3.0:1789265181.199627:0:8344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265181.199644:0:8344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265181.199647:0:8344:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789265181.199674:0:8344:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fccad90a000 00000020:00000080:3.0:1789265181.199677:0:8344:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789265181.199745:0:8344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:8344:1876180417396992:0@lo:502: 00000100:00100000:3.0:1789265181.199824:0:8344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265181.199870:0:8344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3e2240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265181.199956:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417396992 00000100:00100000:0.0:1789265181.199966:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417396992 00000100:00100000:0.0:1789265181.200059:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789265181.200071:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+17:8344:x1876180417396992:12345-0@lo:502: 00000100:00100000:0.0:1789265181.200196:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+17:8344:x1876180417396992:12345-0@lo:502: Request processed in 126us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265181.200203:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789265181.200574:0:8344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:8344:1876180417396992:0@lo:502: 00000020:01000000:3.0:1789265181.200602:0:8344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265181.200610:0:8344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265181.200612:0:8344:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789265181.200627:0:8344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789265181.201388:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789265181.201477:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789265181.201492:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81692200/0x9272d942b4a96355 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9635c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265181.201506:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc81692200/0x9272d942b4a96355 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9635c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265181.201518:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789265181.201529:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fcc8a583000 from 1 10000000:01000000:0.0:1789265181.201533:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789265181.201579:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6000/0x9272d942b4a96363 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265181.201587:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6000/0x9272d942b4a96363 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265181.201598:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6000/0x9272d942b4a96363 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265181.201617:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417397120:0@lo:101: 00000100:00100000:0.0:1789265181.201675:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265181.201704:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc9977b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265181.201846:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417397120 00000100:00100000:3.0:1789265181.201854:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417397120 00000100:00100000:3.0:1789265181.201900:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789265181.201909:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417397120:12345-0@lo:101: 00010000:00010000:3.0:1789265181.201922:0:7458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265181.201938:0:7458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc81491600/0x9272d942b4a9636a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96363 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265181.201964:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81491600/0x9272d942b4a9636a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96363 expref: 18 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265181.201977:0:7458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc81491600/0x9272d942b4a9636a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96363 expref: 18 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265181.201997:0:7458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81491600, rc 0) 00000100:00100000:3.0:1789265181.202062:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+18:6513:x1876180417397120:12345-0@lo:101: Request processed in 154us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265181.202069:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789265181.202115:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417397120:0@lo:101: 00010000:00010000:3.0:1789265181.202131:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6000/0x9272d942b4a96363 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9636a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265181.202141:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6000/0x9272d942b4a96363 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9636a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265181.202205:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417397248:0@lo:501: 00000100:00100000:3.0:1789265181.202230:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265181.202244:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3e2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265181.202255:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417397248 00000100:00100000:3.0:1789265181.202258:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417397248 00000100:00100000:3.0:1789265181.202280:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789265181.202286:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+18:6513:x1876180417397248:12345-0@lo:501: 00000100:00100000:3.0:1789265181.202395:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+18:6513:x1876180417397248:12345-0@lo:501: Request processed in 109us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265181.202402:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789265181.203578:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417397248:0@lo:501: 00000100:00100000:3.0:1789265181.203629:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417397376:0@lo:503: 00000100:00100000:3.0:1789265181.203695:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265181.203738:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3e2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265181.203856:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417397376 00000100:00100000:2.0:1789265181.203863:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417397376 00000100:00100000:2.0:1789265181.203906:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789265181.203915:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+18:6513:x1876180417397376:12345-0@lo:503: 00000100:00100000:2.0:1789265181.204220:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+18:6513:x1876180417397376:12345-0@lo:503: Request processed in 306us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265181.204230:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789265181.204359:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417397376:0@lo:503: 00000100:00100000:2.0:1789265181.205886:0:8345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa290380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:8345:1876180417397504:0@lo:502: 00000100:00100000:2.0:1789265181.205971:0:8345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265181.206145:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417397504 00000100:00100000:3.0:1789265181.206154:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417397504 00000100:00100000:3.0:1789265181.206205:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789265181.206216:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+18:8345:x1876180417397504:12345-0@lo:502: 00000100:00100000:3.0:1789265181.206342:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+18:8345:x1876180417397504:12345-0@lo:502: Request processed in 128us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265181.206350:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789265181.206683:0:8345:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccae763540 going to sleep for 11 seconds 00000100:00100000:2.0:1789265181.206749:0:8345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa290380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:8345:1876180417397504:0@lo:502: 00000020:01000000:2.0:1789265181.206781:0:8345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265181.206794:0:8345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265181.206796:0:8345:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789265181.206804:0:8345:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fcc8a583000 00000020:00000080:2.0:1789265181.206807:0:8345:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789265181.206830:0:8345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa290380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:8345:1876180417397632:0@lo:502: 00000100:00100000:2.0:1789265181.206871:0:8345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265181.206934:0:8345:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccae763540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265181.209731:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417397632 00000100:00100000:3.0:1789265181.209752:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417397632 00000100:00100000:3.0:1789265181.209834:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789265181.209846:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+18:8345:x1876180417397632:12345-0@lo:502: 00000100:00100000:3.0:1789265181.213765:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+18:8345:x1876180417397632:12345-0@lo:502: Request processed in 3907us (6879us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265181.213783:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789265181.213925:0:8345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa290380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:8345:1876180417397632:0@lo:502: 00000020:01000000:2.0:1789265181.213975:0:8345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265181.213986:0:8345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265181.213999:0:8345:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789265181.214005:0:8345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789265181.214490:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789265181.214516:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265181.214528:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6000/0x9272d942b4a96363 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9636a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265181.214541:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6000/0x9272d942b4a96363 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9636a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265182.024770:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789265182.602336:0:8426:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789265182.602341:0:8426:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789265182.602343:0:8426:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789265182.602501:0:8426:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fccbd2a9800 00000020:01000004:1.0:1789265182.602520:0:8426:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789265182.602535:0:8426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789265182.602562:0:8426:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9fccbc5819b8) 00000020:00000080:1.0:1789265182.602581:0:8426:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789265182.641308:0:8426:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1789265182.641384:0:8426:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1789265182.656128:0:8426:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789265182.656387:0:8426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789265182.656404:0:8426:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789265182.656418:0:8426:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9272d942b4a96378 00000020:01000004:0.0:1789265182.656426:0:8426:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789265182.656453:0:8426:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.149@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789265182.656456:0:8426:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.149@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789265182.656462:0:8426:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789265182.656467:0:8426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789265182.656480:0:8426:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9fcc83f10000) 00000020:00000080:0.0:1789265182.656490:0:8426:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1789265182.661836:0:8426:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265182.662395:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789265182.662404:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789265182.664044:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789265182.664064:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789265182.667850:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789265182.667937:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789265182.671302:0:8426:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265182.671546:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789265182.671554:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789265182.672355:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789265182.672365:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789265182.699905:0:8426:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265182.700502:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789265182.700510:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789265182.701692:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789265182.701708:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789265182.703147:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789265182.703165:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789265182.705698:0:8426:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265182.706317:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789265182.706325:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789265182.706908:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789265182.706917:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789265182.758694:0:8426:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265182.759107:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789265182.759125:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789265182.762464:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789265182.762484:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789265182.763275:0:8426:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789265182.763313:0:8426:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1789265182.763320:0:8426:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.149@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789265182.784968:0:8426:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.149@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789265182.785073:0:8426:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.149@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1789265182.785079:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789265182.785081:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789265182.785083:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265182.785084:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265182.785085:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265182.785087:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265182.785089:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265182.785091:0:8426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789265182.785092:0:8426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789265182.785094:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265182.785096:0:8426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789265182.785101:0:8426:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1789265182.785104:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789265182.785106:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789265182.785107:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265182.785113:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265182.785115:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265182.785116:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265182.785117:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265182.785118:0:8426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789265182.785119:0:8426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789265182.785120:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265182.785121:0:8426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789265182.785169:0:8426:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789265182.785196:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417397760:0@lo:253: 00000100:00100000:1.0:1789265182.785298:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265182.785350:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb09a7840 going to sleep for 11 seconds 00000100:00100000:3.0:1789265182.785416:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417397760 00000100:00100000:3.0:1789265182.785427:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417397760 00000100:00100000:3.0:1789265182.785500:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789265182.785512:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+18:8426:x1876180417397760:12345-0@lo:253: 20000000:01000000:3.0:1789265182.785555:0:6510:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789265182.785568:0:6510:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789265182.785575:0:6510:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789265182.785579:0:6510:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789265182.785856:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265182.786070:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789265182.786089:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789265182.786109:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789265182.786117:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789265182.786129:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789265182.786144:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789265182.786273:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789265182.786293:0:6510:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.149@tcp 20000000:01000000:3.0:1789265182.786295:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.149@tcp (null) (null) (null) 00000040:00080000:3.0:1789265182.786309:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789265182.787740:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789265182.787814:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789265182.788665:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.149@tcp (null) (null) 00000040:00080000:3.0:1789265182.788905:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789265182.788921:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789265182.788935:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789265182.788953:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789265182.789146:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1789265182.789171:0:6510:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.149@tcp 20000000:01000000:3.0:1789265182.789173:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.149@tcp (null) (null) (null) 00000040:00080000:3.0:1789265182.789186:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1789265182.789384:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789265182.789411:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1789265182.789416:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.149@tcp (null) (null) 00000040:00080000:3.0:1789265182.789428:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1789265182.789434:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789265182.789445:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1789265182.789477:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1789265182.790739:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1789265182.790842:0:6510:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.149@tcp 20000000:01000000:3.0:1789265182.790845:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.149@tcp (null) (null) (null) 00000040:00080000:3.0:1789265182.790865:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1789265182.790873:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789265182.790888:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1789265182.790895:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.149@tcp (null) (null) 00000040:00080000:3.0:1789265182.790912:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1789265182.790920:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789265182.790962:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1789265182.790980:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1789265182.791007:0:6510:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789265182.791010:0:6510:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789265182.791015:0:6510:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789265182.791167:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789265182.791170:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789265182.791783:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1789265182.791815:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1789265182.791832:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1789265182.792086:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1789265182.792113:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1789265182.792129:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:3.0:1789265182.792137:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789265182.792139:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789265182.793190:0:8446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1789265182.793245:0:8446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1789265182.793263:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1789265182.793460:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1789265182.793487:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1789265182.793504:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:0.0:1789265182.793515:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789265182.793518:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789265182.798818:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1789265182.798910:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1789265182.798930:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1789265182.799145:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1789265182.799173:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1789265182.799190:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1789265182.799203:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789265182.799206:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789265182.799729:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1789265182.799934:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1789265182.799957:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1789265182.799969:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:0.0:1789265182.799983:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789265182.800230:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fcc882b6e00/0x9272d942b4a96386 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.800262:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc81692000/0x9272d942b4a96228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96221 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.800271:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a9624b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9623d expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.800277:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc8152e200/0x9272d942b4a9626e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96267 expref: 18 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.800283:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc81692600/0x9272d942b4a962c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a962bb expref: 18 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.800305:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc81692e00/0x9272d942b4a96308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96301 expref: 18 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.800312:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fcc882b6e00/0x9272d942b4a96386 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.800363:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc81692e00/0x9272d942b4a96308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a96301 expref: 18 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.800379:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc81692e00/0x9272d942b4a96308 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a96301 expref: 18 pid: 7458 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265182.800397:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876180417397888:0@lo:104: 00000100:00100000:0.0:1789265182.800479:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789265182.800543:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc81692600/0x9272d942b4a962c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a962bb expref: 18 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.800551:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc81692600/0x9272d942b4a962c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a962bb expref: 18 pid: 7458 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265182.800559:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876180417398016:0@lo:104: 00000100:00100000:0.0:1789265182.800590:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789265182.800618:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc8152e200/0x9272d942b4a9626e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a96267 expref: 18 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.800625:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc8152e200/0x9272d942b4a9626e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a96267 expref: 18 pid: 7458 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265182.800632:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876180417398144:0@lo:104: 00000100:00100000:0.0:1789265182.800659:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789265182.800674:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a9624b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a9623d expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.800681:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a9624b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a9623d expref: 18 pid: 6510 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265182.800690:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876180417398272:0@lo:104: 00000100:00100000:0.0:1789265182.800709:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265182.800723:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417397888 00010000:00010000:0.0:1789265182.800724:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc81692000/0x9272d942b4a96228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a96221 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.800731:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc81692000/0x9272d942b4a96228 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a96221 expref: 18 pid: 6508 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265182.800732:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417397888 00000100:00100000:0.0:1789265182.800738:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876180417398400:0@lo:104: 00000100:00100000:0.0:1789265182.800754:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265182.800775:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417398016 00000100:00100000:1.0:1789265182.800778:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417398016 00000100:00100000:1.0:1789265182.800789:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417398144 00000100:00100000:1.0:1789265182.800792:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417398144 00000100:00100000:1.0:1789265182.800800:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417398272 00000100:00100000:1.0:1789265182.800802:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417398272 00000100:00100000:1.0:1789265182.800810:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417398400 00000100:00100000:1.0:1789265182.800812:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417398400 00000100:00100000:1.0:1789265182.800824:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265182.800834:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+7:6510:x1876180417397888:12345-0@lo:104: 00010000:00010000:1.0:1789265182.800848:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6400/0x9272d942b4a96301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96308 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265182.800909:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789265182.800915:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+7:6510:x1876180417397888:12345-0@lo:104: Request processed in 83us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265182.800932:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265182.800950:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789265182.800956:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+6:6510:x1876180417398016:12345-0@lo:104: 00010000:00010000:1.0:1789265182.800964:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc81491e00/0x9272d942b4a962bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a962c2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265182.800971:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacd3c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265182.801148:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876180417397888:0@lo:104: 00010000:00010000:1.0:1789265182.801650:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789265182.801654:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876180417398016:0@lo:104: 00000100:00100000:1.0:1789265182.801658:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+6:6510:x1876180417398016:12345-0@lo:104: Request processed in 702us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265182.801664:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789265182.801695:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265182.801702:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+5:6510:x1876180417398144:12345-0@lo:104: 00010000:00010000:1.0:1789265182.801712:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc8152e800/0x9272d942b4a96267 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9626e expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265182.801839:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876180417398144:0@lo:104: 00010000:00010000:3.0:1789265182.801887:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789265182.801897:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6400/0x9272d942b4a96301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96308 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.801914:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6400 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:3.0:1789265182.801919:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6400/0x9272d942b4a96301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a96308 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.801929:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6400/0x9272d942b4a96301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a96308 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265182.801937:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6400/0x9272d942b4a96301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a96308 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265182.801947:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789265182.801960:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789265182.801966:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+5:6510:x1876180417398144:12345-0@lo:104: Request processed in 265us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265182.801972:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265182.801986:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789265182.801992:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6400/0x9272d942b4a96301 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96308 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265182.801992:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+4:6510:x1876180417398272:12345-0@lo:104: 00010000:00010000:3.0:1789265182.802010:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265182.802011:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7000/0x9272d942b4a9623d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9624b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.802074:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6400/0x9272d942b4a96301 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96308 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.802082:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6400/0x9272d942b4a96301 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96308 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.802091:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265182.802094:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc81491e00/0x9272d942b4a962bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a962c2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.802100:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81491e00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:3.0:1789265182.802103:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81491e00/0x9272d942b4a962bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a962c2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.802119:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc81491e00/0x9272d942b4a962bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a962c2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265182.802126:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81491e00/0x9272d942b4a962bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a962c2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265182.802131:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265182.802139:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265182.802146:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc8152e800/0x9272d942b4a96267 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9626e expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.802147:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc81491e00/0x9272d942b4a962bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a962c2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.802153:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265182.802153:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc8152e800 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265182.802156:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc8152e800/0x9272d942b4a96267 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a9626e expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265182.802163:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc8152e800/0x9272d942b4a96267 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a9626e expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.802170:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc81491e00/0x9272d942b4a962bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a962c2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265182.802170:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc8152e800/0x9272d942b4a96267 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a9626e expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265182.802176:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789265182.802177:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc81491e00/0x9272d942b4a962bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a962c2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.802187:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265182.802189:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265182.802190:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc8152e800/0x9272d942b4a96267 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9626e expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.802191:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265182.802196:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265182.802201:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc8152e800/0x9272d942b4a96267 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9626e expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265182.802205:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417398528:0@lo:103: 00010000:00010000:2.0:1789265182.802207:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc8152e800/0x9272d942b4a96267 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9626e expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265182.802218:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265182.802220:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265182.802221:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265182.802477:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265182.802477:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789265182.802483:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+4:6510:x1876180417398272:12345-0@lo:104: Request processed in 492us (1773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265182.802496:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265182.802509:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789265182.802515:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+3:6510:x1876180417398400:12345-0@lo:104: 00010000:00010000:1.0:1789265182.802523:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f600/0x9272d942b4a96221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96228 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265182.802534:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417398656:0@lo:103: 00010000:00010000:1.0:1789265182.802553:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789265182.802557:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265182.802558:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+3:6510:x1876180417398400:12345-0@lo:104: Request processed in 44us (1803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265182.802564:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789265182.802575:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265182.802581:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417398784:0@lo:103: 00000100:00100000:3.0:1789265182.802601:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265182.802632:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417398528 00000100:00100000:3.0:1789265182.802643:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417398528 00010000:00010000:3.0:1789265182.802672:0:7926:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc81692e00/0x9272d942b4a96308 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96301 expref: 19 pid: 7458 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265182.802918:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876180417398272:0@lo:104: 00000100:00100000:0.0:1789265182.802927:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1876180417398400:0@lo:104: 00010000:00010000:0.0:1789265182.802957:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fcc882b6e00/0x9272d942b4a96386 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265182.803178:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265182.803203:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7000/0x9272d942b4a9623d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9624b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265182.803210:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7000 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265182.803213:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7000/0x9272d942b4a9623d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a9624b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265182.803220:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7000/0x9272d942b4a9623d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a9624b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265182.803226:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7000/0x9272d942b4a9623d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a9624b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265182.803231:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789265182.803916:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417398656 00000100:00100000:3.0:1789265182.803923:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417398656 00010000:00010000:3.0:1789265182.803953:0:7926:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc81692600/0x9272d942b4a962c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a962bb expref: 20 pid: 7458 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265182.804080:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417398784 00000100:00100000:0.0:1789265182.804085:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417398784 00010000:00010000:0.0:1789265182.804112:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc8152e200/0x9272d942b4a9626e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96267 expref: 21 pid: 7458 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265182.804133:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789265182.804142:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+21:3642:x1876180417398528:12345-0@lo:103: 00010000:00010000:1.0:1789265182.804154:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265182.804157:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265182.804166:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f600/0x9272d942b4a96221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96228 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.804167:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc81692e00/0x9272d942b4a96308 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96301 expref: 21 pid: 7458 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265182.804188:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc8152f600 already unused, calling callback (ffffffffc1191c20) 00010000:00010000:0.0:1789265182.804192:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc81692e00/0x9272d942b4a96308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a96301 expref: 21 pid: 7458 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265182.804195:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f600/0x9272d942b4a96221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a96228 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265182.804213:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f600/0x9272d942b4a96221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a96228 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265182.804221:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f600/0x9272d942b4a96221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a96228 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.804223:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81692e00/0x9272d942b4a96308 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a96301 expref: 21 pid: 7458 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265182.804238:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789265182.804252:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265182.804283:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f600/0x9272d942b4a96221 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96228 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265182.804291:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265182.804321:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f600/0x9272d942b4a96221 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96228 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265182.804331:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+20:3642:x1876180417398528:12345-0@lo:103: Request processed in 188us (1852us total) trans 0 rc 0/0 00010000:00010000:1.0:1789265182.804332:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f600/0x9272d942b4a96221 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96228 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265182.804345:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789265182.804353:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265182.804357:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265182.804360:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265182.804368:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265182.804377:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+19:3643:x1876180417398656:12345-0@lo:103: 00010000:00010000:0.0:1789265182.804385:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265182.804390:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc81692600/0x9272d942b4a962c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a962bb expref: 19 pid: 7458 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.804400:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc81692600/0x9272d942b4a962c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a962bb expref: 19 pid: 7458 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.804411:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81692600/0x9272d942b4a962c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a962bb expref: 19 pid: 7458 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.804430:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265182.804469:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+18:3643:x1876180417398656:12345-0@lo:103: Request processed in 95us (1911us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265182.804475:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265182.804488:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265182.804495:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+17:3643:x1876180417398784:12345-0@lo:103: 00010000:00010000:0.0:1789265182.804502:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265182.804506:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc8152e200/0x9272d942b4a9626e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96267 expref: 17 pid: 7458 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.804514:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc8152e200/0x9272d942b4a9626e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a96267 expref: 17 pid: 7458 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.804523:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc8152e200/0x9272d942b4a9626e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a96267 expref: 17 pid: 7458 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.804534:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265182.804555:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+16:3643:x1876180417398784:12345-0@lo:103: Request processed in 62us (1954us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265182.804560:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265182.804832:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417398784:0@lo:103: 00000100:00100000:1.0:1789265182.804847:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417398656:0@lo:103: 00010000:00010000:2.0:1789265182.805077:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7000/0x9272d942b4a9623d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9624b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265182.805086:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265182.805094:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7000/0x9272d942b4a9623d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9624b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265182.805100:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7000/0x9272d942b4a9623d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9624b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265182.805115:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265182.805117:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265182.805119:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265182.805126:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265182.805184:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417398912:0@lo:103: 00000100:00100000:3.0:1789265182.805234:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265182.805302:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789265182.805308:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417399040:0@lo:103: 00000100:00100000:3.0:1789265182.805397:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265182.805512:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417398528:0@lo:103: 00000100:00100000:0.0:1789265182.805552:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417398912 00000100:00100000:0.0:1789265182.805558:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417398912 00010000:00010000:0.0:1789265182.805587:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc81692000/0x9272d942b4a96228 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96221 expref: 16 pid: 6508 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265182.805619:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417399040 00000100:00100000:1.0:1789265182.805623:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417399040 00010000:00010000:1.0:1789265182.805639:0:7926:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a9624b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9623d expref: 17 pid: 6510 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265182.805663:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265182.805670:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c287aa82-1100-4c72-b927-3b8d47a88a15+17:3641:x1876180417398912:12345-0@lo:103: 00010000:00010000:1.0:1789265182.805688:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265182.805693:0:7926:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc81692000/0x9272d942b4a96228 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96221 expref: 17 pid: 6508 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265182.805701:0:7926:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc81692000/0x9272d942b4a96228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a96221 expref: 17 pid: 6508 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265182.805713:0:7926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81692000/0x9272d942b4a96228 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a96221 expref: 17 pid: 6508 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265182.805724:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265182.805871:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789265182.805881:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb09a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+16:3641:x1876180417399040:12345-0@lo:103: 00010000:00010000:3.0:1789265182.805888:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265182.805893:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a9624b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9623d expref: 16 pid: 6510 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.805902:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a9624b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a9623d expref: 16 pid: 6510 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.805912:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a9624b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a9623d expref: 16 pid: 6510 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.805925:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fcc882b6e00/0x9272d942b4a96386 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.805944:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc882b6e00/0x9272d942b4a96386 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.805960:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fcc882b6e00/0x9272d942b4a96386 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.805967:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fcc882b6e00/0x9272d942b4a96386 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.805974:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fcc882b6e00/0x9272d942b4a96386 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.805981:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fcc882b6e00/0x9272d942b4a96386 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.805986:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6e00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265182.805991:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fcc882b6e00/0x9272d942b4a96386 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.806010:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fcc882b6e00/0x9272d942b4a96386 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.806052:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fcc882b6e00/0x9272d942b4a96386 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.806064:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265182.806095:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb09a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+15:3641:x1876180417399040:12345-0@lo:103: Request processed in 217us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265182.806101:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789265182.806132:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417399040:0@lo:103: 00000100:00100000:1.0:1789265182.806219:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c287aa82-1100-4c72-b927-3b8d47a88a15+14:3641:x1876180417398912:12345-0@lo:103: Request processed in 548us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265182.806225:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789265182.806300:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417398912:0@lo:103: 00010000:00010000:2.0:1789265182.806455:0:6510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fcc882b6e00/0x9272d942b4a96386 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265182.806465:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fcc882b6e00/0x9272d942b4a96386 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265182.806477:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b6e00/0x9272d942b4a96386 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789265182.806492:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789265182.809881:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+13:8426:x1876180417397760:12345-0@lo:253: Request processed in 24358us (24570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265182.809899:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789265182.810007:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417397760:0@lo:253: 10000000:01000000:1.0:1789265182.810071:0:8426:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789265182.810076:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789265182.810078:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789265182.810079:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265182.810080:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1789265182.810081:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265182.810083:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265182.810085:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265182.810087:0:8426:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789265182.810089:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265182.810090:0:8426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789265182.810117:0:8426:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fccbd2a9800 from lustre-OST0000 10000000:01000000:1.0:1789265182.810156:0:8426:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789265182.810159:0:8426:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789265182.810170:0:8426:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fcc83f119b8 local copy 10000000:01000000:1.0:1789265182.810175:0:8426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789265182.810218:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a9638d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265182.810230:0:8426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a9638d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265182.810240:0:8426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a9638d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265182.810270:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417399168:0@lo:101: 00000100:00100000:1.0:1789265182.810321:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265182.810361:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdf2180 going to sleep for 11 seconds 00000100:00100000:2.0:1789265182.810411:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417399168 00000100:00100000:2.0:1789265182.810419:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417399168 00000100:00100000:2.0:1789265182.810503:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789265182.810514:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+13:8426:x1876180417399168:12345-0@lo:101: 00010000:00010000:2.0:1789265182.810530:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265182.810547:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccb520be00/0x9272d942b4a96394 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9638d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265182.810573:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccb520be00/0x9272d942b4a96394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9638d expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265182.810595:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccb520be00/0x9272d942b4a96394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9638d expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265182.810605:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520be00, rc 0) 00000100:00100000:2.0:1789265182.810647:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+14:8426:x1876180417399168:12345-0@lo:101: Request processed in 135us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265182.810652:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789265182.810714:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417399168:0@lo:101: 00010000:00010000:1.0:1789265182.810743:0:8426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a9638d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9272d942b4a96394 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265182.810752:0:8426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a9638d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9272d942b4a96394 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265182.811758:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417399296:0@lo:501: 00000100:00100000:1.0:1789265182.811824:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265182.812345:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdf2180 going to sleep for 11 seconds 00000100:00100000:3.0:1789265182.814268:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417399296 00000100:00100000:3.0:1789265182.814643:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417399296 00000100:00100000:3.0:1789265182.814731:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789265182.814744:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+14:8426:x1876180417399296:12345-0@lo:501: 00000100:00100000:1.0:1789265182.815177:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417399296:0@lo:501: 10000000:01000000:1.0:1789265182.815206:0:8426:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.149@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789265182.815233:0:8426:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.149@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789265182.815242:0:8426:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a9638d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9272d942b4a96394 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265182.815255:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a9638d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9272d942b4a96394 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265182.815262:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a9638d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9272d942b4a96394 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265182.815296:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265182.815393:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265182.815401:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a9638d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x9272d942b4a96394 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265182.815432:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81692000 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265182.815437:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a9638d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x9272d942b4a96394 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265182.815447:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a9638d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x9272d942b4a96394 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265182.815455:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a9638d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x9272d942b4a96394 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265182.815462:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265182.815493:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a9638d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9272d942b4a96394 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265182.815500:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265182.815525:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a9638d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9272d942b4a96394 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265182.815532:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a9638d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9272d942b4a96394 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265182.815551:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265182.815553:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265182.815555:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265182.815570:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417399424:0@lo:103: 00000100:00100000:3.0:1789265182.815665:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+14:8426:x1876180417399296:12345-0@lo:501: Request processed in 923us (3840us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789265182.815676:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 10000000:01000000:1.0:1789265182.815852:0:8426:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fccbd2a9800 10000000:01000000:1.0:1789265182.815860:0:8426:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789265182.815866:0:8426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789265182.815869:0:8426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789265182.815874:0:8426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789265182.815877:0:8426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789265182.815912:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a9639b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265182.815921:0:8426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a9639b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265182.815933:0:8426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a9639b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265182.815949:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417399552:0@lo:101: 00000100:00100000:1.0:1789265182.815995:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265182.816149:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417399552 00000100:00100000:0.0:1789265182.816156:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417399552 00000100:00100000:2.0:1789265182.816180:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265182.816204:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789265182.816214:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+14:8426:x1876180417399552:12345-0@lo:101: 00010000:00010000:0.0:1789265182.816232:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265182.816249:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc882b6e00/0x9272d942b4a963a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9639b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.816275:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc882b6e00/0x9272d942b4a963a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9639b expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.816287:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc882b6e00/0x9272d942b4a963a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9639b expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.816297:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6e00, rc 0) 00000100:00100000:0.0:1789265182.816391:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+15:8426:x1876180417399552:12345-0@lo:101: Request processed in 179us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265182.816398:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789265182.816412:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417399424 00000100:00100000:3.0:1789265182.816416:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417399424 00000100:00100000:3.0:1789265182.816452:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789265182.816459:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa291880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+15:3643:x1876180417399424:12345-0@lo:103: 00010000:00010000:3.0:1789265182.816468:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265182.816483:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccb520be00/0x9272d942b4a96394 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a9638d expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.816494:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265182.816530:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa291880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+14:3643:x1876180417399424:12345-0@lo:103: Request processed in 71us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265182.816536:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265182.816684:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdf2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265182.816771:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417399424:0@lo:103: 00000100:00100000:1.0:1789265182.816870:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417399552:0@lo:101: 00010000:00010000:1.0:1789265182.816885:0:8426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a9639b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a963a2 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265182.816896:0:8426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a9639b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a963a2 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265182.816990:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417399680:0@lo:501: 00000100:00100000:1.0:1789265182.817229:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265182.817294:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdf2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265182.817475:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417399680 00000100:00100000:3.0:1789265182.817481:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417399680 00000100:00100000:3.0:1789265182.817549:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789265182.817558:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+14:8426:x1876180417399680:12345-0@lo:501: 00000100:00100000:3.0:1789265182.817706:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+14:8426:x1876180417399680:12345-0@lo:501: Request processed in 150us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265182.817713:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789265182.817808:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417399680:0@lo:501: 00000100:00100000:1.0:1789265182.817843:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417399808:0@lo:503: 00000100:00100000:1.0:1789265182.817889:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265182.818224:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdf2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265182.818268:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417399808 00000100:00100000:2.0:1789265182.818398:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417399808 00000100:00100000:2.0:1789265182.818478:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789265182.818486:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+14:8426:x1876180417399808:12345-0@lo:503: 00000100:00100000:2.0:1789265182.818606:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+14:8426:x1876180417399808:12345-0@lo:503: Request processed in 120us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265182.818613:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789265182.818765:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417399808:0@lo:503: 00000040:00080000:1.0:1789265182.819120:0:8426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789265182.819252:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417399936:0@lo:502: 00000100:00100000:1.0:1789265182.819331:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265182.819355:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdf2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265182.819380:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417399936 00000100:00100000:1.0:1789265182.819384:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417399936 00000100:00100000:1.0:1789265182.819410:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789265182.819417:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+14:8426:x1876180417399936:12345-0@lo:502: 00000100:00100000:1.0:1789265182.819520:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+14:8426:x1876180417399936:12345-0@lo:502: Request processed in 102us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265182.819528:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789265182.819575:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417399936:0@lo:502: 00000040:00080000:1.0:1789265182.819812:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789265182.819842:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789265182.819855:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789265182.819867:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789265182.819878:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789265182.819890:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789265182.819911:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417400064:0@lo:502: 00000100:00100000:1.0:1789265182.819956:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265182.819973:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417400064 00000100:00100000:1.0:1789265182.819975:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdf2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265182.819979:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417400064 00000100:00100000:2.0:1789265182.820034:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789265182.820043:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+14:8426:x1876180417400064:12345-0@lo:502: 00000100:00100000:2.0:1789265182.820140:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+14:8426:x1876180417400064:12345-0@lo:502: Request processed in 99us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265182.820148:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789265182.820565:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417400064:0@lo:502: 00000040:00080000:1.0:1789265182.820619:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789265182.820629:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1789265182.821447:0:8449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789265182.821459:0:8449:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1789265182.821466:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265182.821468:0:8449:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789265182.821474:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789265182.821493:0:8449:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9fccb08b3370) 00000020:00000080:2.0:1789265182.821519:0:8449:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789265182.821524:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789265182.821600:0:8449:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fccbd2a9800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789265182.821609:0:8449:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789265182.821617:0:8449:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9272d942b4a963b0 00010000:00010000:2.0:1789265182.834258:0:8449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1789265182.834897:0:8449:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1789265182.838714:0:8449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789265182.839292:0:8449:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1789265182.848219:0:8449:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1789265182.848459:0:8449:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1789265182.856231:0:8449:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1789265182.857942:0:8449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789265182.857960:0:8449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265182.858243:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265182.858246:0:8449:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789265182.858253:0:8449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265182.858258:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265182.858259:0:8449:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789265182.858263:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789265182.858265:0:8449:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789265182.858842:0:8449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265182.858851:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265182.858853:0:8449:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789265182.858858:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789265182.860474:0:8426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1789265182.860522:0:8426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789265182.860546:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a9639b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a963a2 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265182.860573:0:8426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a9639b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a963a2 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265182.860582:0:8426:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fccbd2a9800 from 1 10000000:01000000:1.0:1789265182.860585:0:8426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789265182.860631:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a963b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265182.860641:0:8426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a963b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265182.860654:0:8426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a963b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265182.860683:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417400192:0@lo:101: 00000100:00100000:1.0:1789265182.860841:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265182.860891:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdf2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265182.861549:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417400192 00000100:00100000:3.0:1789265182.861561:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417400192 00000100:00100000:3.0:1789265182.861622:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789265182.861633:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+14:8426:x1876180417400192:12345-0@lo:101: 00010000:00010000:3.0:1789265182.861651:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265182.861668:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc81491e00/0x9272d942b4a963be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a963b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.861698:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81491e00/0x9272d942b4a963be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a963b7 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.861710:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc81491e00/0x9272d942b4a963be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a963b7 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.861720:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81491e00, rc 0) 00000100:00100000:3.0:1789265182.861936:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+15:8426:x1876180417400192:12345-0@lo:101: Request processed in 303us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265182.861943:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789265182.862079:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417400192:0@lo:101: 00010000:00010000:1.0:1789265182.862100:0:8426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a963b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a963be expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265182.862111:0:8426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a963b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a963be expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265182.862238:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417400320:0@lo:501: 00000100:00100000:1.0:1789265182.862279:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265182.863472:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417400320 00000100:00100000:3.0:1789265182.863486:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417400320 00000100:00100000:3.0:1789265182.863542:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789265182.863552:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+15:8426:x1876180417400320:12345-0@lo:501: 00000100:00100000:3.0:1789265182.863724:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+15:8426:x1876180417400320:12345-0@lo:501: Request processed in 173us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265182.863731:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789265182.863951:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdf2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265182.863994:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417400320:0@lo:501: 00000100:00100000:1.0:1789265182.864072:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417400448:0@lo:503: 00000100:00100000:1.0:1789265182.864124:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265182.864143:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdf2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265182.864259:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417400448 00000100:00100000:2.0:1789265182.864266:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417400448 00000100:00100000:2.0:1789265182.864313:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789265182.864322:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+15:8426:x1876180417400448:12345-0@lo:503: 00000100:00100000:2.0:1789265182.864698:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+15:8426:x1876180417400448:12345-0@lo:503: Request processed in 376us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265182.864707:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789265182.864862:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417400448:0@lo:503: 00000040:00080000:1.0:1789265182.865188:0:8426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789265182.865265:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417400576:0@lo:502: 00000100:00100000:1.0:1789265182.867927:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265182.868007:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdf2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265182.868275:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417400576 00000100:00100000:3.0:1789265182.868287:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417400576 00000100:00100000:3.0:1789265182.868369:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789265182.868382:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+15:8426:x1876180417400576:12345-0@lo:502: 00000100:00100000:3.0:1789265182.868585:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+15:8426:x1876180417400576:12345-0@lo:502: Request processed in 205us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265182.868594:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789265182.868951:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417400576:0@lo:502: 00000040:00080000:1.0:1789265182.869272:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789265182.869374:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789265182.869417:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417400704:0@lo:502: 00000100:00100000:1.0:1789265182.869476:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265182.869520:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdf2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265182.869726:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417400704 00000100:00100000:3.0:1789265182.869732:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417400704 00000100:00100000:3.0:1789265182.869852:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789265182.869863:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+15:8426:x1876180417400704:12345-0@lo:502: 00000100:00100000:3.0:1789265182.869969:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+15:8426:x1876180417400704:12345-0@lo:502: Request processed in 109us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265182.869976:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789265182.870104:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417400704:0@lo:502: 00000040:00080000:1.0:1789265182.870154:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789265182.870163:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789265182.871916:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265182.871931:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265182.871934:0:8453:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789265182.871943:0:8453:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fccbd2a9800 00000020:00000080:1.0:1789265182.871947:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789265182.871959:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265182.871962:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265182.871964:0:8453:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789265182.871967:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789265182.876210:0:8426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789265182.876387:0:8426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265182.876515:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a963b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a963be expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.876531:0:8426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a963b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a963be expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265182.876666:0:8426:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789265182.876670:0:8426:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fccbd2a9800 10000000:01000000:3.0:1789265182.876673:0:8426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fccbd2a9800 10000000:01000000:3.0:1789265182.876678:0:8426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789265182.876684:0:8426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fccbd2a9800 from 1 10000000:01000000:3.0:1789265182.876688:0:8426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789265182.876735:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81490200/0x9272d942b4a963c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.876745:0:8426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc81490200/0x9272d942b4a963c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.876843:0:8426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc81490200/0x9272d942b4a963c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265182.876872:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417400832:0@lo:101: 00000100:00100000:3.0:1789265182.876959:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265182.877097:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd377840 going to sleep for 11 seconds 00000100:00100000:0.0:1789265182.877215:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417400832 00000100:00100000:0.0:1789265182.877224:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417400832 00000100:00100000:0.0:1789265182.877324:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789265182.877335:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+15:8426:x1876180417400832:12345-0@lo:101: 00010000:00010000:0.0:1789265182.877352:0:7458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265182.877369:0:7458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc882b7000/0x9272d942b4a963cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a963c5 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.877400:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc882b7000/0x9272d942b4a963cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a963c5 expref: 16 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.877414:0:7458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc882b7000/0x9272d942b4a963cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a963c5 expref: 16 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.877424:0:7458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b7000, rc 0) 00000100:00100000:0.0:1789265182.877493:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+16:8426:x1876180417400832:12345-0@lo:101: Request processed in 160us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265182.877502:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789265182.877600:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417400832:0@lo:101: 00010000:00010000:3.0:1789265182.877615:0:8426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc81490200/0x9272d942b4a963c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a963cc expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.877626:0:8426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc81490200/0x9272d942b4a963c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a963cc expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265182.877734:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417400960:0@lo:501: 00000100:00100000:3.0:1789265182.877778:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265182.879903:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417400960 00000100:00100000:1.0:1789265182.879926:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417400960 00000100:00100000:1.0:1789265182.880009:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789265182.880034:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+16:8426:x1876180417400960:12345-0@lo:501: 00000100:00100000:1.0:1789265182.880247:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+16:8426:x1876180417400960:12345-0@lo:501: Request processed in 227us (2466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265182.880256:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789265182.880687:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd377840 going to sleep for 11 seconds 00000100:00100000:3.0:1789265182.880722:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417400960:0@lo:501: 00000100:00100000:3.0:1789265182.880858:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417401088:0@lo:503: 00000100:00100000:3.0:1789265182.880925:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265182.880995:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd377840 going to sleep for 11 seconds 00000100:00100000:1.0:1789265182.882146:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417401088 00000100:00100000:1.0:1789265182.882156:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417401088 00000100:00100000:1.0:1789265182.882216:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789265182.882226:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+16:8426:x1876180417401088:12345-0@lo:503: 00000100:00100000:1.0:1789265182.882648:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+16:8426:x1876180417401088:12345-0@lo:503: Request processed in 422us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265182.882658:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789265182.882840:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417401088:0@lo:503: 00000040:00080000:3.0:1789265182.883412:0:8426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265182.883530:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417401216:0@lo:502: 00000100:00100000:3.0:1789265182.883674:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265182.883776:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc906d46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265182.884013:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417401216 00000100:00100000:0.0:1789265182.884182:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417401216 00000100:00100000:0.0:1789265182.884285:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789265182.884296:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+16:8426:x1876180417401216:12345-0@lo:502: 00000100:00100000:0.0:1789265182.884453:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+16:8426:x1876180417401216:12345-0@lo:502: Request processed in 158us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265182.884462:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789265182.884557:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417401216:0@lo:502: 00000040:00080000:1.0:1789265182.884815:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789265182.884847:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789265182.884861:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789265182.884873:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789265182.884885:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789265182.884897:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789265182.884909:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789265182.884922:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789265182.884934:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789265182.884946:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789265182.884958:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789265182.884971:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789265182.884983:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789265182.885005:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789265182.885053:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789265182.885068:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789265182.885082:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789265182.885096:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789265182.885123:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789265182.885140:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789265182.885154:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789265182.885166:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789265182.885178:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789265182.885191:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789265182.885203:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789265182.885215:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789265182.885226:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789265182.885238:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1789265182.885250:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789265182.885262:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1789265182.885274:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1789265182.885287:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1789265182.885300:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1789265182.885313:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1789265182.885339:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1789265182.885354:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1789265182.885367:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1789265182.885405:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417401344:0@lo:502: 00000100:00100000:1.0:1789265182.885467:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265182.886235:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdf2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265182.886476:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417401344 00000100:00100000:3.0:1789265182.886486:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417401344 00000100:00100000:3.0:1789265182.886659:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789265182.886671:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+16:8426:x1876180417401344:12345-0@lo:502: 00000100:00100000:3.0:1789265182.886920:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+16:8426:x1876180417401344:12345-0@lo:502: Request processed in 251us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265182.886929:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789265182.887141:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417401344:0@lo:502: 00000040:00080000:1.0:1789265182.887232:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1789265182.887248:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1789265182.890201:0:8454:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789265182.890227:0:8454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9fccbc584d28) 00000020:00000080:1.0:1789265182.890271:0:8454:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1789265182.890480:0:8454:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fccbd2a9800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789265182.890485:0:8454:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fccbd2a9800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789265182.890488:0:8454:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fccbd2a9800 3 00010000:00080000:1.0:1789265182.890525:0:8454:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fcb8223f800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.149@tcp at head 00010000:00010000:1.0:1789265182.894252:0:8454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1789265182.894916:0:8454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789265182.894973:0:8454:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789265182.894991:0:8454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9272d942b4a963da 00000100:00080000:1.0:1789265182.895013:0:8454:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789265182.895020:0:8454:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fcb8223f800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:1.0:1789265182.895097:0:8454:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fccb0a64380 x1876180417401472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789265182.895186:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1876180417401472:0@lo:38: 00000100:00100000:3.0:1789265182.895289:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789265182.897708:0:8454:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:01000004:1.0:1789265182.898012:0:8454:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789265182.898066:0:8454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9fcb829f8000) 00000020:00000080:1.0:1789265182.898096:0:8454:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1789265182.898197:0:8454:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fccbd2a9800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789265182.898202:0:8454:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fccbd2a9800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789265182.898205:0:8454:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fccbd2a9800 3 00010000:00080000:1.0:1789265182.898245:0:8454:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fcb8223e000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.149@tcp at head 00000100:00100000:2.0:1789265182.899413:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417401984:0@lo:400: 00000100:00100000:3.0:1789265182.900451:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417401600:0@lo:400: 00010000:00010000:1.0:1789265182.901709:0:8454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1789265182.901983:0:8454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789265182.902071:0:8454:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789265182.902088:0:8454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x9272d942b4a963e8 00000100:00080000:1.0:1789265182.902101:0:8454:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789265182.902108:0:8454:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9fcb8223e000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:1.0:1789265182.902151:0:8454:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fccb0a67b80 x1876180417402112/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265182.902179:0:8454:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1789265182.905114:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417401472 00000100:00100000:1.0:1789265182.905131:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417401472 00000100:00100000:1.0:1789265182.905188:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265182.905197:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1876180417401472:12345-0@lo:38: 00010000:00080000:1.0:1789265182.905234:0:6517:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:1.0:1789265182.905290:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9272d942b4a963ef 00000100:00100000:3.0:1789265182.905465:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265182.905621:0:6516:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789265182.905630:0:6516:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789265182.905682:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1876180417402112:0@lo:38: 00000100:00100000:3.0:1789265182.905738:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265182.906196:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417401856:0@lo:400: 00000100:00100000:0.0:1789265182.906242:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265182.906270:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265182.906277:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417401728:0@lo:400: 00000100:00100000:0.0:1789265182.906304:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265182.906649:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417401856 00000100:00100000:3.0:1789265182.906657:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417401856 00000100:00100000:3.0:1789265182.906706:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417401728 00000100:00100000:3.0:1789265182.906709:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417401728 00000100:00100000:3.0:1789265182.906728:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789265182.906735:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417401856:12345-0@lo:400: 00000100:00100000:3.0:1789265182.906798:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417401856:12345-0@lo:400: Request processed in 62us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265182.906807:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789265182.906825:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789265182.906831:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417401728:12345-0@lo:400: 00000100:00100000:3.0:1789265182.906858:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417401728:12345-0@lo:400: Request processed in 27us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265182.906873:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789265182.906917:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417401728:0@lo:400: 00000100:00100000:3.0:1789265182.906927:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417401856:0@lo:400: 00000100:00100000:3.0:1789265182.906967:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417401600 00000100:00100000:3.0:1789265182.906971:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417401600 00000100:00100000:3.0:1789265182.907003:0:6516:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789265182.907010:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417402112 00000100:00100000:3.0:1789265182.907013:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417402112 00000100:00100000:3.0:1789265182.907043:0:6516:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789265182.907051:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265182.907057:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417401600:12345-0@lo:400: 00000100:00100000:3.0:1789265182.907098:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417401600:12345-0@lo:400: Request processed in 42us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265182.907105:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789265182.907139:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fcc8376f480 x1876180417401600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265182.907151:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417401600:0@lo:400: 00000100:00100000:2.0:1789265182.907366:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265182.907429:0:6518:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789265182.907439:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417401984 00000100:00100000:2.0:1789265182.907440:0:6516:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789265182.907443:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417401984 00000100:00100000:0.0:1789265182.907479:0:6518:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789265182.907485:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265182.907492:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417401984:12345-0@lo:400: 00000100:00100000:3.0:1789265182.909478:0:8459:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789265182.909493:0:8459:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000004:00100000:1.0:1789265182.909661:0:6517:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789265182.909742:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9fccaea53800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265182.909849:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876180417401472:12345-0@lo:38: Request processed in 4650us (14557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265182.909861:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265182.909888:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265182.909896:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1876180417402112:12345-0@lo:38: 00010000:00080000:1.0:1789265182.909924:0:6517:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:1.0:1789265182.909962:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x9272d942b4a963f6 00000004:00100000:1.0:1789265182.909971:0:6517:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789265182.909989:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9fccaea52800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265182.910049:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876180417402112:12345-0@lo:38: Request processed in 152us (4310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265182.910056:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789265182.910435:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fccb0a67b80 x1876180417402112/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265182.910449:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789265182.910460:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789265182.910477:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789265182.910483:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789265182.910486:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb8223e000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789265182.910494:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1876180417402112:0@lo:38: 00010000:00080000:1.0:1789265182.910514:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fccb0a64380 x1876180417401472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265182.910521:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789265182.910524:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789265182.910528:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789265182.910531:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789265182.910532:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb8223f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789265182.910536:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1876180417401472:0@lo:38: 00000040:00080000:1.0:1789265182.910698:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1789265182.911052:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417401984:12345-0@lo:400: Request processed in 3557us (3685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265182.911220:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789265182.915429:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fcc8376d180 x1876180417401984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265182.915454:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417401984:0@lo:400: 00000020:01000000:2.0:1789265182.915503:0:8426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1789265182.915551:0:8426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789265182.915603:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81490200/0x9272d942b4a963c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a963cc expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265182.915616:0:8426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc81490200/0x9272d942b4a963c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a963cc expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789265182.915697:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789265182.915699:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789265182.915701:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265182.915702:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265182.915703:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265182.915705:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265182.915707:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789265182.915708:0:8426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789265182.915710:0:8426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789265182.915712:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265182.915714:0:8426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789265182.915718:0:8426:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1789265182.915721:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789265182.915722:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789265182.915723:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265182.915724:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265182.915725:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265182.915726:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265182.915727:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789265182.915728:0:8426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789265182.915729:0:8426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789265182.915730:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265182.915731:0:8426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789265182.915761:0:8426:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789265182.915780:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa293b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417402240:0@lo:253: 00000100:00100000:2.0:1789265182.915861:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265182.918505:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc83275840 going to sleep for 11 seconds 00000100:00100000:1.0:1789265182.918636:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417402240 00000100:00100000:1.0:1789265182.918648:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417402240 00000100:00100000:1.0:1789265182.918725:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789265182.918738:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+16:8426:x1876180417402240:12345-0@lo:253: 20000000:01000000:1.0:1789265182.918779:0:6508:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789265182.918797:0:6508:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789265182.926267:0:6508:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789265182.926293:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789265182.926635:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+16:8426:x1876180417402240:12345-0@lo:253: Request processed in 7894us (10767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265182.926651:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 20000000:01000000:2.0:1789265182.926782:0:6532:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789265182.926788:0:6532:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789265182.926814:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fccb520a200/0x9272d942b4a963fd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265182.926851:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc81693000/0x9272d942b4a96339 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96332 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265182.926859:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc81693600/0x9272d942b4a96347 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96340 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265182.926867:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fccb520a200/0x9272d942b4a963fd lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265182.926914:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc81693600/0x9272d942b4a96347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a96340 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265182.927181:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc81693600/0x9272d942b4a96347 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a96340 expref: 15 pid: 6511 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265182.927197:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa291180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876180417402368:0@lo:104: 00000100:00100000:2.0:1789265182.927246:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265182.927298:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc81693000/0x9272d942b4a96339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a96332 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265182.927307:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc81693000/0x9272d942b4a96339 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a96332 expref: 15 pid: 6511 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265182.927315:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa292a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876180417402496:0@lo:104: 00000100:00100000:2.0:1789265182.927337:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc83275000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265182.927380:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa293b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:8426:1876180417402240:0@lo:253: 10000000:01000000:2.0:1789265182.927393:0:8426:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789265182.927397:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789265182.927407:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789265182.927408:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265182.927409:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265182.927411:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265182.927412:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265182.927414:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789265182.927416:0:8426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789265182.927417:0:8426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789265182.927419:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265182.927421:0:8426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789265182.927442:0:8426:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789265182.927443:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789265182.927464:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265182.927483:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417402368 00000100:00100000:0.0:1789265182.927491:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417402368 00000100:00100000:1.0:1789265182.927505:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417402496 00000100:00100000:1.0:1789265182.927507:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417402496 00000100:00100000:0.0:1789265182.927545:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789265182.927555:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd21a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+4:6532:x1876180417402368:12345-0@lo:104: 00010000:00010000:0.0:1789265182.927570:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc8152ec00/0x9272d942b4a96340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96347 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265182.928004:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789265182.928012:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd21a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+4:6532:x1876180417402368:12345-0@lo:104: Request processed in 459us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265182.928040:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1789265182.928333:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265182.928343:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc8152ec00/0x9272d942b4a96340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96347 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.928353:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc8152ec00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:3.0:1789265182.928358:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc8152ec00/0x9272d942b4a96340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a96347 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.928380:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc8152ec00/0x9272d942b4a96340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a96347 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265182.928388:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc8152ec00/0x9272d942b4a96340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a96347 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265182.928395:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789265182.928434:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc8152ec00/0x9272d942b4a96340 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96347 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.928441:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265182.928462:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc8152ec00/0x9272d942b4a96340 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96347 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.928470:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc8152ec00/0x9272d942b4a96340 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96347 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.928484:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265182.928486:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265182.928488:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265182.928503:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417402624:0@lo:103: 00000100:00100000:3.0:1789265182.928550:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265182.928602:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417402624 00000100:00100000:3.0:1789265182.928608:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417402624 00010000:00010000:3.0:1789265182.928632:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc81693600/0x9272d942b4a96347 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96340 expref: 16 pid: 6511 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265182.928776:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265182.928785:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+16:3644:x1876180417402624:12345-0@lo:103: 00010000:00010000:3.0:1789265182.928804:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265182.928811:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc81693600/0x9272d942b4a96347 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96340 expref: 16 pid: 6511 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.928822:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc81693600/0x9272d942b4a96347 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a96340 expref: 16 pid: 6511 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.928841:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265182.928873:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+16:3644:x1876180417402624:12345-0@lo:103: Request processed in 89us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265182.928880:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265182.928922:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417402624:0@lo:103: 00010000:00010000:3.0:1789265182.929103:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81693600/0x9272d942b4a96347 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a96340 expref: 15 pid: 6511 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265182.929116:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa291180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876180417402368:0@lo:104: 00000100:00100000:1.0:1789265182.930676:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789265182.930712:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+3:6532:x1876180417402496:12345-0@lo:104: 00010000:00010000:1.0:1789265182.930733:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc8152fc00/0x9272d942b4a96332 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96339 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265182.930838:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789265182.930844:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+3:6532:x1876180417402496:12345-0@lo:104: Request processed in 138us (3379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265182.930850:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789265182.930873:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa292a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876180417402496:0@lo:104: 00010000:00010000:1.0:1789265182.930881:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265182.930887:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc8152fc00/0x9272d942b4a96332 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96339 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265182.930894:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc8152fc00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:1.0:1789265182.930898:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc8152fc00/0x9272d942b4a96332 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a96339 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.930901:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fccb520a200/0x9272d942b4a963fd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265182.930907:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc8152fc00/0x9272d942b4a96332 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a96339 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265182.930915:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc8152fc00/0x9272d942b4a96332 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a96339 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265182.930921:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789265182.930962:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc8152fc00/0x9272d942b4a96332 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96339 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265182.930969:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265182.931004:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc8152fc00/0x9272d942b4a96332 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96339 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265182.931015:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1789265182.931035:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc8152fc00/0x9272d942b4a96332 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96339 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265182.931044:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417402752:0@lo:103: 00000100:00100000:3.0:1789265182.931087:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265182.931131:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417402752 00000100:00100000:3.0:1789265182.931139:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417402752 00010000:00010000:3.0:1789265182.931164:0:7926:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc81693000/0x9272d942b4a96339 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96332 expref: 15 pid: 6511 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265182.931188:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789265182.931203:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c287aa82-1100-4c72-b927-3b8d47a88a15+15:3642:x1876180417402752:12345-0@lo:103: 00010000:00010000:3.0:1789265182.931226:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265182.931233:0:7926:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc81693000/0x9272d942b4a96339 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96332 expref: 15 pid: 6511 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.931244:0:7926:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc81693000/0x9272d942b4a96339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a96332 expref: 15 pid: 6511 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.931260:0:7926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81693000/0x9272d942b4a96339 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a96332 expref: 15 pid: 6511 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.931277:0:7926:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fccb520a200/0x9272d942b4a963fd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.931287:0:7926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccb520a200/0x9272d942b4a963fd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789265182.931315:0:7926:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005962423s 00010000:00010000:3.0:1789265182.931321:0:7926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fccb520a200/0x9272d942b4a963fd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.931329:0:7926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fccb520a200/0x9272d942b4a963fd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.931335:0:7926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fccb520a200/0x9272d942b4a963fd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.931341:0:7926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fccb520a200/0x9272d942b4a963fd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.931346:0:7926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520a200 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265182.931356:0:7926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fccb520a200/0x9272d942b4a963fd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.931365:0:7926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fccb520a200/0x9272d942b4a963fd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.931379:0:7926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fccb520a200/0x9272d942b4a963fd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.931388:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265182.931418:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c287aa82-1100-4c72-b927-3b8d47a88a15+14:3642:x1876180417402752:12345-0@lo:103: Request processed in 217us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265182.931425:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789265182.931457:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417402752:0@lo:103: 00010000:00010000:3.0:1789265182.931474:0:6532:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fccb520a200/0x9272d942b4a963fd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.931481:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fccb520a200/0x9272d942b4a963fd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265182.931488:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccb520a200/0x9272d942b4a963fd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265182.931572:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265182.931575:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265182.931577:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1789265182.933785:0:8426:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1789265182.933961:0:8426:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789265182.934309:0:8426:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1789265182.935072:0:8426:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789265182.935337:0:8426:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789265182.935764:0:8426:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1789265182.936983:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789265182.948490:0:8426:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789265182.948504:0:8426:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789265182.948562:0:8426:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789265182.948613:0:8426:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.149@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789265182.948635:0:8426:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789265182.948663:0:8426:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1789265182.949749:0:8426:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265182.950084:0:8426:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1789265183.042214:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789265183.937451:0:8512:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789265183.937765:0:8512:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789265184.066480:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265185.089252:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265185.284417:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417402880:0@lo:41: 00000100:00100000:1.0:1789265185.284550:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265185.284627:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417402880 00000100:00100000:1.0:1789265185.284634:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417402880 00000100:00100000:1.0:1789265185.284676:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789265185.284685:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417402880:12345-0@lo:41: 00000004:00000024:1.0:1789265185.284721:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789265185.284765:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417402880:12345-0@lo:41: Request processed in 81us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265185.284774:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789265185.284815:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417402880:0@lo:41: 00000100:00100000:3.0:1789265185.286562:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417403008:0@lo:41: 00000100:00100000:3.0:1789265185.286620:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265185.286780:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417403008 00000100:00100000:0.0:1789265185.286788:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417403008 00000100:00100000:0.0:1789265185.286836:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789265185.286845:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417403008:12345-0@lo:41: 00000004:00000024:0.0:1789265185.286873:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1789265185.286919:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417403008:12345-0@lo:41: Request processed in 75us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265185.286927:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789265185.286967:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417403008:0@lo:41: 00010000:00010000:1.0:1789265186.115193:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265187.137550:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265188.162061:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265188.354874:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417403520:0@lo:400: 00000100:00100000:3.0:1789265188.354943:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265188.355014:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789265188.355055:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417403136:0@lo:400: 00000100:00100000:3.0:1789265188.355086:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265188.355110:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417403648:0@lo:400: 00000100:00100000:3.0:1789265188.355140:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265188.355168:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417403264:0@lo:400: 00000100:00100000:3.0:1789265188.355191:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265188.355206:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417403776:0@lo:400: 00000100:00100000:3.0:1789265188.355227:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265188.355247:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789265188.355253:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417403392:0@lo:400: 00000100:00100000:3.0:1789265188.355276:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265188.355293:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82869f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417403904:0@lo:400: 00000100:00100000:3.0:1789265188.355313:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265188.355348:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417403520 00000100:00100000:3.0:1789265188.355356:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417403520 00000100:00100000:3.0:1789265188.355409:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417403392 00000100:00100000:3.0:1789265188.355412:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417403392 00000100:00100000:3.0:1789265188.355429:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789265188.355437:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417403520:12345-0@lo:400: 00000100:00100000:3.0:1789265188.355496:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417403520:12345-0@lo:400: Request processed in 57us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265188.355508:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789265188.355530:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789265188.355537:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82869500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417403392:12345-0@lo:400: 00000100:00100000:3.0:1789265188.355567:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82869500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417403392:12345-0@lo:400: Request processed in 31us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265188.355583:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789265188.355603:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417403136 00000100:00100000:3.0:1789265188.355607:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417403136 00000100:00100000:3.0:1789265188.355633:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789265188.355640:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+14:3643:x1876180417403136:12345-0@lo:400: 00000100:00100000:3.0:1789265188.355671:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+14:3643:x1876180417403136:12345-0@lo:400: Request processed in 31us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265188.355678:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789265188.355705:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417403648 00000100:00100000:3.0:1789265188.355709:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417403648 00000100:00100000:3.0:1789265188.355737:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417403264 00000100:00100000:3.0:1789265188.355740:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417403264 00000100:00100000:3.0:1789265188.355749:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417403776 00000100:00100000:3.0:1789265188.355751:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417403776 00000100:00100000:3.0:1789265188.355772:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417403904 00000100:00100000:3.0:1789265188.355775:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417403904 00000100:00100000:3.0:1789265188.355790:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789265188.355795:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417403648:12345-0@lo:400: 00000100:00100000:3.0:1789265188.355824:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417403648:12345-0@lo:400: Request processed in 29us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265188.355830:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789265188.355842:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789265188.355848:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417403264:12345-0@lo:400: 00000100:00100000:3.0:1789265188.355876:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417403264:12345-0@lo:400: Request processed in 29us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265188.355882:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789265188.355893:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265188.355899:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417403776:12345-0@lo:400: 00000100:00100000:3.0:1789265188.355935:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417403776:12345-0@lo:400: Request processed in 37us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265188.355941:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265188.355953:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789265188.355969:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417403904:12345-0@lo:400: 00000100:00100000:3.0:1789265188.355996:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417403904:12345-0@lo:400: Request processed in 39us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265188.356002:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1789265188.356055:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265188.356059:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265188.356087:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417403392:0@lo:400: 00010000:00080000:3.0:1789265188.356101:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb82869f80 x1876180417403904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265188.356111:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82869f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417403904:0@lo:400: 00010000:00080000:3.0:1789265188.356121:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcc837e0700 x1876180417403264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265188.356129:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417403264:0@lo:400: 00010000:00080000:3.0:1789265188.356138:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcc837e1880 x1876180417403776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265188.356146:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417403776:0@lo:400: 00000100:00100000:3.0:1789265188.356180:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417403136:0@lo:400: 00010000:00080000:3.0:1789265188.356190:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcc837e1180 x1876180417403648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265188.356198:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417403648:0@lo:400: 00000100:00100000:3.0:1789265188.356218:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417403520:0@lo:400: 00000001:02000400:1.0:1789265189.030003:0:8802:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg349-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789265189.192563:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789265189.878654:0:8854:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789265189.878875:0:8854:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789265190.209459:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265190.401183:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265190.401216:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417404032:0@lo:41: 00000100:00100000:1.0:1789265190.401285:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265190.401472:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417404032 00000100:00100000:3.0:1789265190.401480:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417404032 00000100:00100000:3.0:1789265190.401529:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789265190.401537:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417404032:12345-0@lo:41: 00000004:00000024:3.0:1789265190.401574:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789265190.401615:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417404032:12345-0@lo:41: Request processed in 79us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265190.401623:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789265190.401770:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417404032:0@lo:41: 00000100:00100000:3.0:1789265190.401958:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265190.401968:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417404160:0@lo:41: 00000100:00100000:3.0:1789265190.402001:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265190.402099:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417404160 00000100:00100000:1.0:1789265190.402104:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417404160 00000100:00100000:1.0:1789265190.402149:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789265190.402156:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417404160:12345-0@lo:41: 00000004:00000024:1.0:1789265190.402175:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1789265190.402468:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417404160:12345-0@lo:41: Request processed in 312us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265190.402475:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789265190.402508:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417404160:0@lo:41: 10000000:01000000:0.0:1789265190.913132:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789265190.913141:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fccad90a000 from 30 10000000:01000000:0.0:1789265190.913146:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789265190.913194:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a96404 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.913234:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a96404 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.913247:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a96404 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265190.913271:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417404288:0@lo:101: 00000100:00100000:0.0:1789265190.913342:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265190.913397:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b75540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265190.913587:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417404288 00000100:00100000:3.0:1789265190.913596:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417404288 00000100:00100000:3.0:1789265190.913661:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789265190.913670:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+14:6513:x1876180417404288:12345-0@lo:101: 00010000:00010000:3.0:1789265190.913682:0:7458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265190.913694:0:7458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc81491000/0x9272d942b4a9640b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96404 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265190.913716:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81491000/0x9272d942b4a9640b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96404 expref: 15 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265190.913727:0:7458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc81491000/0x9272d942b4a9640b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96404 expref: 15 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265190.913735:0:7458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81491000, rc 0) 00000100:00100000:3.0:1789265190.913805:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+15:6513:x1876180417404288:12345-0@lo:101: Request processed in 136us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265190.913813:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789265190.914048:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417404288:0@lo:101: 00010000:00010000:0.0:1789265190.914064:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a96404 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9640b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.914073:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a96404 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9640b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265190.914138:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417404416:0@lo:501: 00000100:00100000:0.0:1789265190.914167:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265190.914196:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b75540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265190.914301:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417404416 00000100:00100000:3.0:1789265190.914305:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417404416 00000100:00100000:3.0:1789265190.914337:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789265190.914344:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+15:6513:x1876180417404416:12345-0@lo:501: 00000100:00100000:3.0:1789265190.914467:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+15:6513:x1876180417404416:12345-0@lo:501: Request processed in 124us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265190.914474:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789265190.914603:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417404416:0@lo:501: 00000100:00100000:2.0:1789265190.914632:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa293b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417404544:0@lo:503: 00000100:00100000:2.0:1789265190.914674:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265190.914695:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7f300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265190.915100:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417404544 00000100:00100000:3.0:1789265190.915106:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417404544 00000100:00100000:3.0:1789265190.915137:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789265190.915144:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+15:6513:x1876180417404544:12345-0@lo:503: 00000100:00100000:3.0:1789265190.915240:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+15:6513:x1876180417404544:12345-0@lo:503: Request processed in 96us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265190.915247:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789265190.915398:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa293b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417404544:0@lo:503: 00000100:00100000:0.0:1789265190.916386:0:8906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:8906:1876180417404672:0@lo:502: 00000100:00100000:0.0:1789265190.916445:0:8906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265190.916572:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417404672 00000100:00100000:3.0:1789265190.916577:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417404672 00000100:00100000:3.0:1789265190.916627:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789265190.916636:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+15:8906:x1876180417404672:12345-0@lo:502: 00000100:00100000:3.0:1789265190.916737:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+15:8906:x1876180417404672:12345-0@lo:502: Request processed in 102us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265190.916974:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789265190.917070:0:8906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b75b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265190.917088:0:8906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:8906:1876180417404672:0@lo:502: 00000100:00100000:0.0:1789265190.917136:0:8906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:8906:1876180417404800:0@lo:502: 00000100:00100000:0.0:1789265190.917172:0:8906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265190.917310:0:8906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b75b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265190.917351:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417404800 00000100:00100000:1.0:1789265190.917356:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417404800 00000100:00100000:1.0:1789265190.917427:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789265190.917436:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+15:8906:x1876180417404800:12345-0@lo:502: 00000100:00100000:1.0:1789265190.917540:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+15:8906:x1876180417404800:12345-0@lo:502: Request processed in 104us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265190.917547:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789265190.917628:0:8906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:8906:1876180417404800:0@lo:502: 00000040:00080000:3.0:1789265190.917648:0:8906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789265190.918013:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789265190.918066:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789265190.918076:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a96404 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9640b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265190.918087:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a96404 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9640b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265190.918096:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789265190.918098:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fccad90a000 from 5 10000000:01000000:2.0:1789265190.918100:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789265190.918126:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520be00/0x9272d942b4a96412 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265190.918134:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccb520be00/0x9272d942b4a96412 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265190.918142:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccb520be00/0x9272d942b4a96412 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265190.918155:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa293b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417404928:0@lo:101: 00000100:00100000:2.0:1789265190.918187:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265190.918545:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7f300 going to sleep for 11 seconds 00000100:00100000:0.0:1789265190.918697:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417404928 00000100:00100000:0.0:1789265190.918703:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417404928 00000100:00100000:0.0:1789265190.918924:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789265190.918935:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+15:6513:x1876180417404928:12345-0@lo:101: 00010000:00010000:0.0:1789265190.918955:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265190.918969:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc882b6a00/0x9272d942b4a96419 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96412 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.918991:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc882b6a00/0x9272d942b4a96419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96412 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.919001:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc882b6a00/0x9272d942b4a96419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96412 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.919009:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6a00, rc 0) 00000100:00100000:0.0:1789265190.919078:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+16:6513:x1876180417404928:12345-0@lo:101: Request processed in 145us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265190.919084:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789265190.919208:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa293b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417404928:0@lo:101: 00010000:00010000:1.0:1789265190.919290:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccb520be00/0x9272d942b4a96412 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96419 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265190.919299:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccb520be00/0x9272d942b4a96412 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96419 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265190.919353:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417405056:0@lo:256: 00000100:00100000:1.0:1789265190.919388:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265190.919415:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada67180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265190.919461:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417405056 00000100:00100000:0.0:1789265190.919466:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417405056 00000100:00100000:0.0:1789265190.919508:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789265190.919514:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+16:6513:x1876180417405056:12345-0@lo:256: 20000000:01000000:0.0:1789265190.919529:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789265190.919544:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789265190.919547:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1789265190.920114:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+16:6513:x1876180417405056:12345-0@lo:256: Request processed in 597us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265190.920123:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789265190.921155:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417405056:0@lo:256: 10000000:01000000:2.0:1789265190.921231:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789265190.921240:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520be00/0x9272d942b4a96412 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96419 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265190.921250:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccb520be00/0x9272d942b4a96412 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96419 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265190.921266:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789265190.921269:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1789265190.921271:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789265190.921299:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96420 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265190.921306:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96420 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265190.921314:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96420 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265190.921330:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa291500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417405184:0@lo:101: 00000100:00100000:2.0:1789265190.921373:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265190.921405:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265190.921937:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417405184 00000100:00100000:0.0:1789265190.921953:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417405184 00000100:00100000:0.0:1789265190.922001:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789265190.922010:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+16:6513:x1876180417405184:12345-0@lo:101: 00010000:00010000:0.0:1789265190.922048:0:7458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265190.922062:0:7458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc882b7800/0x9272d942b4a96427 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96420 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.922084:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc882b7800/0x9272d942b4a96427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96420 expref: 17 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.922095:0:7458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc882b7800/0x9272d942b4a96427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96420 expref: 17 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.922105:0:7458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b7800, rc 0) 00000100:00100000:0.0:1789265190.922158:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417405184:12345-0@lo:101: Request processed in 150us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265190.922164:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789265190.922348:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa291500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417405184:0@lo:101: 00010000:00010000:2.0:1789265190.922363:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96420 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96427 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265190.922373:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96420 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96427 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265190.922435:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa291500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417405312:0@lo:501: 00000100:00100000:2.0:1789265190.922465:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265190.922559:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265190.922718:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417405312 00000100:00100000:0.0:1789265190.922722:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417405312 00000100:00100000:0.0:1789265190.922896:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789265190.922904:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417405312:12345-0@lo:501: 00000100:00100000:0.0:1789265190.923061:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417405312:12345-0@lo:501: Request processed in 157us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265190.923067:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789265190.923186:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa291500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417405312:0@lo:501: 00000100:00100000:1.0:1789265190.923231:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a65f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417405440:0@lo:503: 00000100:00100000:1.0:1789265190.923286:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265190.923464:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada67600 going to sleep for 11 seconds 00000100:00100000:2.0:1789265190.923567:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417405440 00000100:00100000:2.0:1789265190.923572:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417405440 00000100:00100000:2.0:1789265190.923595:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789265190.923607:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417405440:12345-0@lo:503: 00000100:00100000:2.0:1789265190.923707:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417405440:12345-0@lo:503: Request processed in 99us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265190.923714:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789265190.924164:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a65f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417405440:0@lo:503: 00000100:00100000:3.0:1789265190.924682:0:8907:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:8907:1876180417405568:0@lo:502: 00000100:00100000:3.0:1789265190.924738:0:8907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265190.925156:0:8907:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb821816c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265190.925326:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417405568 00000100:00100000:1.0:1789265190.925332:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417405568 00000100:00100000:1.0:1789265190.925377:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789265190.925385:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+17:8907:x1876180417405568:12345-0@lo:502: 00000100:00100000:1.0:1789265190.925624:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+17:8907:x1876180417405568:12345-0@lo:502: Request processed in 239us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265190.925632:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789265190.925711:0:8907:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:8907:1876180417405568:0@lo:502: 00000020:01000000:3.0:1789265190.925739:0:8907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789265190.925762:0:8907:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789265190.925769:0:8907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265190.925772:0:8907:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789265190.925780:0:8907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789265190.925783:0:8907:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.149@tcp to nid 0x20000c0a8cb95 (192.168.203.149@tcp) 00000020:01000000:3.0:1789265190.925806:0:8907:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789265190.925810:0:8907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265190.925834:0:8907:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9fccbd3799b8) 00000020:00000080:3.0:1789265190.925856:0:8907:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1789265190.925864:0:8907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789265190.925954:0:8907:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1789265190.925960:0:8907:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789265190.925968:0:8907:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9272d942b4a96435 00010000:00080000:3.0:1789265190.925997:0:8907:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fccbc566000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.149@tcp at head 00010000:00010000:3.0:1789265190.926389:0:8907:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1789265190.949639:0:8907:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789265190.949664:0:8907:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789265190.950319:0:8907:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265190.950629:0:8907:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265190.950727:0:8907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789265190.950975:0:8907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789265190.951920:0:8908:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265190.951926:0:8908:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789265190.953587:0:8907:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789265190.953601:0:8907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789265190.953707:0:8907:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789265190.953733:0:8907:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9272d942b4a9643c 00000100:00080000:2.0:1789265190.953815:0:8907:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789265190.953823:0:8907:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9fccbc566000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265190.953859:0:8907:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fccaa293100 x1876180417405696/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265190.953927:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417405696:0@lo:8: 00000100:00100000:1.0:1789265190.954005:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265190.954146:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417405696 00000100:00100000:3.0:1789265190.954153:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417405696 00000100:00100000:3.0:1789265190.954182:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265190.954189:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1876180417405696:12345-0@lo:8: 00010000:00080000:3.0:1789265190.954224:0:8433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:3.0:1789265190.954260:0:8433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9272d942b4a96443 00002000:00100000:3.0:1789265190.954304:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9fcc837f2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1789265190.954309:0:8433:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1789265190.954313:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789265190.954372:0:8433:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789265190.954631:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1789265190.954664:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9fccbf44f000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1789265190.955094:0:8907:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789265190.955194:0:8907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265190.955200:0:8907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265190.955202:0:8907:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789265190.955206:0:8907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:0.0:1789265190.955366:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417406080:0@lo:400: 00000100:00100000:0.0:1789265190.955411:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265190.955451:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265190.955458:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417406208:0@lo:400: 00000100:00100000:0.0:1789265190.955491:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265190.955522:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417406080 00000100:00100000:0.0:1789265190.955527:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417406080 00000100:00100000:0.0:1789265190.955561:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789265190.955568:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417406080:12345-0@lo:400: 00000100:00100000:0.0:1789265190.955609:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417406080:12345-0@lo:400: Request processed in 41us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265190.955627:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789265190.955664:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417406080:0@lo:400: 00000020:00000080:2.0:1789265190.955839:0:8907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265190.955843:0:8907:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789265190.955848:0:8907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789265190.955850:0:8907:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789265190.955874:0:8907:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa293800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:8907:1876180417406592:0@lo:502: 00000100:00100000:2.0:1789265190.955916:0:8907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265190.955955:0:8907:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265190.956013:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417406592 00000100:00100000:0.0:1789265190.956018:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417406592 00000100:00100000:0.0:1789265190.956072:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789265190.956079:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+17:8907:x1876180417406592:12345-0@lo:502: 00000100:00100000:0.0:1789265190.956173:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+17:8907:x1876180417406592:12345-0@lo:502: Request processed in 94us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265190.956180:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789265190.956331:0:8907:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa293800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:8907:1876180417406592:0@lo:502: 00000020:01000000:2.0:1789265190.956352:0:8907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265190.956356:0:8907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265190.956358:0:8907:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789265190.956367:0:8907:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:0.0:1789265190.956594:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1789265190.956633:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789265190.956644:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96420 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96427 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.956654:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96420 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96427 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265190.956665:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789265190.956667:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fcc8a583000 from 30 10000000:01000000:0.0:1789265190.956676:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789265190.956700:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a9644a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.956708:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a9644a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.956718:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a9644a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265190.956730:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417406720:0@lo:101: 00000100:00100000:0.0:1789265190.956769:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265190.956791:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b75300 going to sleep for 11 seconds 00000100:00100000:0.0:1789265190.956804:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417406720 00000100:00100000:0.0:1789265190.956807:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417406720 00000100:00100000:0.0:1789265190.956833:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789265190.956839:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417406720:12345-0@lo:101: 00010000:00010000:0.0:1789265190.956848:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265190.956859:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc882b7c00/0x9272d942b4a96451 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9644a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.956879:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc882b7c00/0x9272d942b4a96451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9644a expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.956889:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc882b7c00/0x9272d942b4a96451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9644a expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.956896:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b7c00, rc 0) 00000100:00100000:0.0:1789265190.956925:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+18:6513:x1876180417406720:12345-0@lo:101: Request processed in 85us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265190.956950:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789265190.956988:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417406720:0@lo:101: 00010000:00010000:0.0:1789265190.956998:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a9644a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96451 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.957007:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a9644a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96451 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265190.957071:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417406848:0@lo:501: 00000100:00100000:0.0:1789265190.957095:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265190.957108:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b75300 going to sleep for 11 seconds 00000100:00100000:0.0:1789265190.957120:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417406848 00000100:00100000:0.0:1789265190.957123:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417406848 00000100:00100000:0.0:1789265190.957145:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789265190.957152:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+18:6513:x1876180417406848:12345-0@lo:501: 00000100:00100000:0.0:1789265190.957256:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+18:6513:x1876180417406848:12345-0@lo:501: Request processed in 105us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265190.957263:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789265190.957294:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417406848:0@lo:501: 00000100:00100000:0.0:1789265190.957319:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417406976:0@lo:503: 00000100:00100000:0.0:1789265190.957352:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265190.957365:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b75300 going to sleep for 11 seconds 00000100:00100000:0.0:1789265190.957376:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417406976 00000100:00100000:0.0:1789265190.957379:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417406976 00000100:00100000:0.0:1789265190.957402:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789265190.957407:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+18:6513:x1876180417406976:12345-0@lo:503: 00000100:00100000:0.0:1789265190.957503:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+18:6513:x1876180417406976:12345-0@lo:503: Request processed in 94us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265190.957509:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789265190.957544:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417406976:0@lo:503: 00000100:00100000:2.0:1789265190.957833:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417406208 00000100:00100000:2.0:1789265190.957839:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417406208 00000100:00100000:2.0:1789265190.957871:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789265190.957879:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417406208:12345-0@lo:400: 00000100:00100000:2.0:1789265190.957925:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417406208:12345-0@lo:400: Request processed in 47us (2442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265190.957931:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789265190.957965:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417405952:0@lo:400: 00000100:00100000:3.0:1789265190.957975:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1876180417405696:12345-0@lo:8: Request processed in 3782us (3966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265190.957987:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265190.957998:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265190.958018:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417405952 00000100:00100000:3.0:1789265190.958043:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417405952 00000100:00100000:2.0:1789265190.958045:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417406464:0@lo:400: 00000100:00100000:3.0:1789265190.958081:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789265190.958082:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265190.958092:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417405952:12345-0@lo:400: 00000100:00100000:2.0:1789265190.958111:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789265190.958120:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417405824:0@lo:400: 00000100:00100000:3.0:1789265190.958139:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417405952:12345-0@lo:400: Request processed in 48us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265190.958147:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789265190.958152:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265190.958177:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417406336:0@lo:400: 00000100:00100000:2.0:1789265190.958208:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265190.958248:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417405952:0@lo:400: 00000100:00100000:2.0:1789265190.958277:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417406464 00000100:00100000:2.0:1789265190.958281:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417406464 00000100:00100000:2.0:1789265190.958317:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417405824 00000100:00100000:2.0:1789265190.958321:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417405824 00000100:00100000:2.0:1789265190.958333:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417406336 00000100:00100000:2.0:1789265190.958335:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417406336 00000100:00100000:3.0:1789265190.958350:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789265190.958360:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417406464:12345-0@lo:400: 00000100:00100000:3.0:1789265190.958399:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417406464:12345-0@lo:400: Request processed in 42us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265190.958715:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789265190.958724:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417405824:12345-0@lo:400: 00000100:00100000:2.0:1789265190.958768:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417405824:12345-0@lo:400: Request processed in 46us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265190.958782:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789265190.958796:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789265190.958804:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417406336:12345-0@lo:400: 00000100:00100000:2.0:1789265190.958832:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417406336:12345-0@lo:400: Request processed in 30us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265190.958838:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789265190.958869:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265190.958872:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789265190.958896:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcc8376c380 x1876180417406208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265190.958907:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417406208:0@lo:400: 00010000:00080000:2.0:1789265190.958930:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcc8376ea00 x1876180417405824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265190.958939:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417405824:0@lo:400: 00010000:00080000:2.0:1789265190.958959:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcc8376e680 x1876180417406336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265190.958968:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417406336:0@lo:400: 00010000:00080000:2.0:1789265190.958978:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcc8376ed80 x1876180417406464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265190.958986:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417406464:0@lo:400: 00000100:00100000:3.0:1789265190.959061:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789265190.959467:0:8910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:8910:1876180417407104:0@lo:502: 00000100:00100000:3.0:1789265190.960797:0:8910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265190.960836:0:8910:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc992896c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265190.960970:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417407104 00000100:00100000:0.0:1789265190.960977:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417407104 00000100:00100000:0.0:1789265190.961130:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789265190.961140:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+18:8910:x1876180417407104:12345-0@lo:502: 00000100:00100000:0.0:1789265190.961289:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+18:8910:x1876180417407104:12345-0@lo:502: Request processed in 150us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265190.961296:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789265190.961376:0:8910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:8910:1876180417407104:0@lo:502: 00000100:00100000:3.0:1789265190.961438:0:8910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:8910:1876180417407232:0@lo:502: 00000100:00100000:3.0:1789265190.961476:0:8910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789265190.961595:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccaa293100 x1876180417405696/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265190.961605:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789265190.961621:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789265190.961629:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789265190.961634:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789265190.961637:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccbc566000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789265190.961653:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789265190.961658:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417405696:0@lo:8: 00000004:00080000:1.0:1789265190.961683:0:8908:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789265190.961757:0:8908:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 242191733645ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789265190.961764:0:8908:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789265190.963377:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417407232 00000100:00100000:2.0:1789265190.963389:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417407232 00000100:00100000:2.0:1789265190.963447:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789265190.963455:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+18:8910:x1876180417407232:12345-0@lo:502: 00000100:00100000:2.0:1789265190.963885:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+18:8910:x1876180417407232:12345-0@lo:502: Request processed in 156us (2133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265190.963896:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789265190.963979:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa290a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8909:1876180417407360:0@lo:700: 00000100:00100000:2.0:1789265190.964014:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265190.964060:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265190.964119:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417407360 00000100:00100000:3.0:1789265190.964124:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417407360 00000100:00100000:3.0:1789265190.964168:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265190.964177:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8909:x1876180417407360:12345-0@lo:700: 00000100:00100000:3.0:1789265190.964208:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8441:1876180417407488:0@lo:700: 00000100:00100000:3.0:1789265190.964236:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265190.964253:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc99289a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265190.964268:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417407488 00000100:00100000:3.0:1789265190.964272:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417407488 00000100:00100000:3.0:1789265190.964297:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789265190.964304:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8441:x1876180417407488:12345-0@lo:700: 00000100:00080000:2.0:1789265190.964898:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265190.965131:0:8910:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc992896c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265190.965159:0:8910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:8910:1876180417407232:0@lo:502: 00000040:00080000:2.0:1789265190.965195:0:8910:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789265190.965356:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789265190.965380:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789265190.965390:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a9644a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96451 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.965401:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a9644a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96451 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265190.965411:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789265190.965413:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fcc8a583000 from 5 10000000:01000000:0.0:1789265190.965416:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789265190.965440:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a96458 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.965449:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a96458 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.965471:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a96458 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265190.965486:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417407616:0@lo:101: 00000100:00100000:0.0:1789265190.965530:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265190.965552:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b75600 going to sleep for 11 seconds 00000100:00100000:3.0:1789265190.965959:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417407616 00000100:00100000:3.0:1789265190.965967:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417407616 00000100:00100000:3.0:1789265190.966010:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789265190.966018:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+18:6513:x1876180417407616:12345-0@lo:101: 00010000:00010000:3.0:1789265190.966084:0:7458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265190.966099:0:7458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc81490e00/0x9272d942b4a9645f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96458 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265190.966123:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81490e00/0x9272d942b4a9645f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96458 expref: 19 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265190.966135:0:7458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc81490e00/0x9272d942b4a9645f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96458 expref: 19 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265190.966143:0:7458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81490e00, rc 0) 00000100:00100000:3.0:1789265190.966194:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+19:6513:x1876180417407616:12345-0@lo:101: Request processed in 176us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265190.966200:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789265190.966340:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417407616:0@lo:101: 00010000:00010000:0.0:1789265190.966354:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a96458 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9645f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.966364:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a96458 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9645f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265190.966420:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417407744:0@lo:256: 00000100:00100000:0.0:1789265190.966454:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265190.966482:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b75600 going to sleep for 11 seconds 00000100:00100000:3.0:1789265190.966966:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417407744 00000100:00100000:3.0:1789265190.966972:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417407744 00000100:00100000:3.0:1789265190.967008:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789265190.967018:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+19:6513:x1876180417407744:12345-0@lo:256: 20000000:01000000:3.0:1789265190.967052:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789265190.967068:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789265190.967071:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789265190.967151:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+19:6513:x1876180417407744:12345-0@lo:256: Request processed in 135us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265190.967157:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789265190.967367:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417407744:0@lo:256: 10000000:01000000:0.0:1789265190.967410:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789265190.967417:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a96458 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9645f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.967426:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a96458 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9645f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265190.967433:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789265190.967436:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1789265190.967443:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789265190.967462:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6600/0x9272d942b4a96466 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.967468:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6600/0x9272d942b4a96466 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.967475:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6600/0x9272d942b4a96466 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265190.967498:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417407872:0@lo:101: 00000100:00100000:0.0:1789265190.967524:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265190.967547:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b75600 going to sleep for 11 seconds 00000100:00100000:3.0:1789265190.967726:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417407872 00000100:00100000:3.0:1789265190.967731:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417407872 00000100:00100000:3.0:1789265190.967828:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789265190.967836:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+19:6513:x1876180417407872:12345-0@lo:101: 00010000:00010000:3.0:1789265190.967844:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265190.967854:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc81490000/0x9272d942b4a9646d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96466 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265190.967871:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81490000/0x9272d942b4a9646d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96466 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265190.967881:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc81490000/0x9272d942b4a9646d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96466 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265190.967888:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81490000, rc 0) 00000100:00100000:3.0:1789265190.967917:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+20:6513:x1876180417407872:12345-0@lo:101: Request processed in 83us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265190.967929:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000004:00080000:0.0:1789265190.968141:0:7448:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1789265190.968203:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417407872:0@lo:101: 00010000:00010000:0.0:1789265190.968216:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6600/0x9272d942b4a96466 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9646d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.968224:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6600/0x9272d942b4a96466 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9646d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265190.968281:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417408000:0@lo:501: 00000100:00100000:0.0:1789265190.968309:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265190.968331:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b75600 going to sleep for 11 seconds 00000100:00100000:0.0:1789265190.968342:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417408000 00000100:00100000:0.0:1789265190.968345:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417408000 00000100:00100000:0.0:1789265190.968371:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789265190.968377:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8ad99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+20:6513:x1876180417408000:12345-0@lo:501: 00000100:00100000:0.0:1789265190.968494:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8ad99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+20:6513:x1876180417408000:12345-0@lo:501: Request processed in 105us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265190.968508:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789265190.968541:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417408000:0@lo:501: 00000100:00100000:0.0:1789265190.968568:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417408128:0@lo:503: 00000100:00100000:0.0:1789265190.968607:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265190.968733:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b75600 going to sleep for 11 seconds 00000100:00100000:0.0:1789265190.968819:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417408128 00000100:00100000:0.0:1789265190.968823:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417408128 00000100:00100000:0.0:1789265190.968848:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789265190.968854:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8ad98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+20:6513:x1876180417408128:12345-0@lo:503: 00000100:00100000:0.0:1789265190.968931:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8ad98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+20:6513:x1876180417408128:12345-0@lo:503: Request processed in 77us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265190.968938:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789265190.968988:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417408128:0@lo:503: 00000100:00100000:0.0:1789265190.969190:0:8911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:8911:1876180417408256:0@lo:502: 00000100:00100000:0.0:1789265190.969225:0:8911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265190.969245:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417408256 00000100:00100000:0.0:1789265190.969249:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417408256 00000100:00100000:0.0:1789265190.969271:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789265190.969277:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8ad99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+20:8911:x1876180417408256:12345-0@lo:502: 00000100:00100000:0.0:1789265190.969346:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8ad99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+20:8911:x1876180417408256:12345-0@lo:502: Request processed in 68us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265190.969352:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789265190.969381:0:8911:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b759c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265190.969393:0:8911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:8911:1876180417408256:0@lo:502: 00000020:01000000:0.0:1789265190.969422:0:8911:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789265190.969430:0:8911:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789265190.969437:0:8911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265190.969439:0:8911:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789265190.969443:0:8911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789265190.969446:0:8911:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.149@tcp to nid 0x20000c0a8cb95 (192.168.203.149@tcp) 00000020:01000000:0.0:1789265190.969466:0:8911:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789265190.969469:0:8911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789265190.973588:0:8911:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9fccbf4599b8) 00000020:00000080:0.0:1789265190.973722:0:8911:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1789265190.973738:0:8911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789265190.973920:0:8911:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789265190.973927:0:8911:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789265190.973934:0:8911:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9272d942b4a9647b 00010000:00080000:0.0:1789265190.973981:0:8911:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fcb821f6000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.149@tcp at head 40000000:02000000:3.0:1789265190.974368:0:6523:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00010000:00010000:0.0:1789265190.978317:0:8911:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000040:01000000:0.0:1789265190.984936:0:8911:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789265190.984971:0:8911:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789265190.985204:0:8911:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265190.985393:0:8911:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265190.985479:0:8911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789265190.985606:0:8911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000020:00000080:2.0:1789265190.986620:0:8911:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789265190.986634:0:8911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789265190.986672:0:8911:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789265190.986697:0:8911:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9272d942b4a96482 00000100:00080000:2.0:1789265190.986708:0:8911:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789265190.986713:0:8911:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fcb821f6000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265190.986749:0:8911:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fccaa291500 x1876180417408384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789265190.986776:0:8911:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789265190.986837:0:8911:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265190.986842:0:8911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265190.986844:0:8911:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789265190.986847:0:8911:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265190.986850:0:8911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265190.986852:0:8911:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789265190.986854:0:8911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789265190.986856:0:8911:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789265190.986882:0:8911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa293b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:8911:1876180417408512:0@lo:502: 00000100:00100000:2.0:1789265190.986967:0:8911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265190.987002:0:8911:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7f900 going to sleep for 11 seconds 00000100:00100000:1.0:1789265190.987153:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417408384:0@lo:8: 00000100:00100000:1.0:1789265190.987191:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265190.987288:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417408384 00000100:00100000:2.0:1789265190.987295:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417408384 00000100:00100000:2.0:1789265190.987330:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265190.987337:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1876180417408384:12345-0@lo:8: 00010000:00080000:2.0:1789265190.987363:0:8435:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:2.0:1789265190.987387:0:8435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9272d942b4a96489 00002000:00100000:2.0:1789265190.987400:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9fcc992fa000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789265190.987403:0:8435:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789265190.987406:0:8435:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789265190.987466:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789265190.987588:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9fcc992f8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265190.987645:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1876180417408384:12345-0@lo:8: Request processed in 306us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265190.987653:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789265190.987720:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccaa291500 x1876180417408384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265190.987731:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789265190.987738:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789265190.987744:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789265190.987749:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789265190.987751:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb821f6000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789265190.987765:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789265190.987770:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417408384:0@lo:8: 00000100:00100000:0.0:1789265190.987866:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417408512 00000100:00100000:0.0:1789265190.987872:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417408512 00000100:00100000:0.0:1789265190.987902:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789265190.987910:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc82437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+20:8911:x1876180417408512:12345-0@lo:502: 00000100:00100000:0.0:1789265190.988049:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc82437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+20:8911:x1876180417408512:12345-0@lo:502: Request processed in 139us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265190.988056:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000040:00080000:0.0:1789265190.988117:0:8912:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265190.988127:0:8912:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000004:00080000:0.0:1789265190.988409:0:8912:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789265190.988456:0:8912:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 242218433136ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789265190.988463:0:8912:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1789265190.989208:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8441:x1876180417407488:12345-0@lo:700: Request processed in 24900us (24967us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265190.989219:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789265190.989461:0:8441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb8286ad80 x1876180417407488/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789265206 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265190.989476:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8441:1876180417407488:0@lo:700: 40000000:02000000:3.0:1789265190.989498:0:8441:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:2.0:1789265190.993904:0:8911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa293b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:8911:1876180417408512:0@lo:502: 00000020:01000000:2.0:1789265190.993960:0:8911:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265190.993967:0:8911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265190.993969:0:8911:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789265190.993974:0:8911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1789265190.994231:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1789265190.994255:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789265190.994266:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6600/0x9272d942b4a96466 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9646d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.994278:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6600/0x9272d942b4a96466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9646d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265190.994288:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789265190.994291:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fcc83f119b8 from 1 10000000:01000000:0.0:1789265190.994294:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789265190.994326:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96490 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.994335:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96490 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265190.994344:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96490 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265190.994364:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417408640:0@lo:101: 00000100:00100000:0.0:1789265190.994428:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265190.994519:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc994466c0 going to sleep for 11 seconds 00000001:00100000:2.0:1789265190.997531:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789265190.997542:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1789265191.001364:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8909:x1876180417407360:12345-0@lo:700: Request processed in 37180us (37340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265191.001380:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789265191.001569:0:8909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccaa290a80 x1876180417407360/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789265206 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265191.001598:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa290a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8909:1876180417407360:0@lo:700: 00000100:00100000:1.0:1789265191.002152:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417408640 00000100:00100000:1.0:1789265191.002161:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417408640 00000100:00100000:1.0:1789265191.002209:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789265191.002218:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc82d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+20:6513:x1876180417408640:12345-0@lo:101: 00010000:00010000:1.0:1789265191.002231:0:7458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265191.002249:0:7458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a96497 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96490 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265191.002275:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a96497 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96490 expref: 21 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265191.002286:0:7458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a96497 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96490 expref: 21 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265191.002295:0:7458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81693e00, rc 0) 00000100:00100000:1.0:1789265191.002347:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc82d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417408640:12345-0@lo:101: Request processed in 131us (7919us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265191.002353:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789265191.002490:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417408640:0@lo:101: 00010000:00010000:3.0:1789265191.002507:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96490 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96497 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265191.002517:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96490 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96497 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265191.002605:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417408768:0@lo:501: 00000100:00100000:3.0:1789265191.002648:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265191.002682:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc99289a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265191.003089:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417408768 00000100:00100000:0.0:1789265191.003096:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417408768 00000100:00100000:0.0:1789265191.003134:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789265191.003142:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc82d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417408768:12345-0@lo:501: 00000100:00100000:0.0:1789265191.003249:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc82d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417408768:12345-0@lo:501: Request processed in 107us (599us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789265191.003257:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789265191.003374:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417408768:0@lo:501: 10000000:01000000:3.0:1789265191.003405:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789265191.003412:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96490 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96497 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265191.003420:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96490 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96497 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789265191.004550:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1789265191.010666:0:8913:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789265191.010704:0:8913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa293b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8913:1876180417409024:0@lo:7: 00000100:00100000:2.0:1789265191.010775:0:8913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265191.010801:0:8913:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265191.010887:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265191.010900:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417408896:0@lo:13: 00000100:00100000:1.0:1789265191.010929:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265191.011087:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417408896 00000100:00100000:2.0:1789265191.011095:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417408896 00000100:00100000:2.0:1789265191.011147:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265191.011155:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417408896:12345-0@lo:13: 00002000:00000024:2.0:1789265191.011183:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1789265191.011228:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417408896:12345-0@lo:13: Request processed in 74us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265191.011236:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789265191.011291:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789265191.011323:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccaa290a80 x1876180417408896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265191.011342:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417408896:0@lo:13: 00000100:00100000:3.0:1789265191.011465:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417409024 00000100:00100000:3.0:1789265191.011470:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417409024 00000100:00100000:3.0:1789265191.011515:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265191.011523:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8913:x1876180417409024:12345-0@lo:7: 00002000:00080000:3.0:1789265191.014886:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1789265191.014895:0:8433:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000004:00080000:0.0:1789265191.016636:0:8909:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789265191.016670:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8909:1876180417409280:0@lo:7: 00000100:00100000:0.0:1789265191.016736:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265191.016782:0:8435:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789265191.016790:0:8435:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789265191.016874:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc98f17e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265191.016903:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417409280 00000100:00100000:0.0:1789265191.016910:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417409280 00000100:00100000:0.0:1789265191.017066:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789265191.017076:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8909:x1876180417409280:12345-0@lo:7: 00000100:00100000:1.0:1789265191.020208:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417409152:0@lo:13: 00000100:00100000:1.0:1789265191.020279:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265191.020340:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417409152 00000100:00100000:1.0:1789265191.020348:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417409152 00000100:00100000:1.0:1789265191.020390:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265191.020398:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1876180417409152:12345-0@lo:13: 00002000:00000024:1.0:1789265191.020419:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1789265191.020463:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1876180417409152:12345-0@lo:13: Request processed in 65us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265191.020470:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789265191.020509:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcc8376d180 x1876180417409152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265191.020527:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417409152:0@lo:13: 00000100:00100000:3.0:1789265191.021652:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8913:x1876180417409024:12345-0@lo:7: Request processed in 10123us (10870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265191.021663:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789265191.021790:0:8913:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccaa293b80 x1876180417409024/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789265207 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265191.021801:0:8913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa293b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8913:1876180417409024:0@lo:7: 00000004:00080000:2.0:1789265191.021816:0:8913:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789265191.021851:0:8913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa293b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8913:1876180417409408:0@lo:5: 00000100:00100000:2.0:1789265191.021885:0:8913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265191.021903:0:8913:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265191.021972:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417409408 00000100:00100000:1.0:1789265191.021978:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417409408 00000100:00100000:1.0:1789265191.022019:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265191.022052:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8913:x1876180417409408:12345-0@lo:5: 00002000:00080000:1.0:1789265191.022074:0:8435:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789265191.022078:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789265191.023409:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8913:x1876180417409408:12345-0@lo:5: Request processed in 1355us (1518us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789265191.023426:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789265191.023509:0:8913:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccaa293b80 x1876180417409408/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265207 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265191.023524:0:8913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa293b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8913:1876180417409408:0@lo:5: 00000004:00080000:2.0:1789265191.023536:0:8913:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789265191.023573:0:8913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa290700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8913:1876180417409536:0@lo:700: 00000100:00100000:2.0:1789265191.023604:0:8913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265191.023640:0:8913:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265191.023840:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417409536 00000100:00100000:3.0:1789265191.023847:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417409536 00000100:00100000:3.0:1789265191.023888:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789265191.023897:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8913:x1876180417409536:12345-0@lo:700: 00002000:00080000:0.0:1789265191.027449:0:8914:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1789265191.027461:0:8914:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789265191.027868:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8909:x1876180417409280:12345-0@lo:7: Request processed in 10788us (11126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265191.027880:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000001:00080000:1.0:1789265191.028109:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1789265191.028251:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8913:x1876180417409536:12345-0@lo:700: Request processed in 4355us (4645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265191.028261:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789265191.028342:0:8913:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccaa290700 x1876180417409536/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789265207 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265191.028355:0:8913:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789265191.028371:0:8913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa290700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8913:1876180417409536:0@lo:700: 00010000:00080000:2.0:1789265191.029979:0:8909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcc8376f480 x1876180417409280/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789265207 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265191.029996:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8909:1876180417409280:0@lo:7: 00000004:00080000:2.0:1789265191.030012:0:8909:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789265191.030374:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa292300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8909:1876180417409664:0@lo:5: 00000100:00100000:2.0:1789265191.030430:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265191.030464:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7f900 going to sleep for 11 seconds 00000100:00100000:0.0:1789265191.030605:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417409664 00000100:00100000:0.0:1789265191.030624:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417409664 00000100:00100000:0.0:1789265191.030678:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265191.030688:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8909:x1876180417409664:12345-0@lo:5: 00002000:00080000:0.0:1789265191.030716:0:8433:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1789265191.030768:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8909:x1876180417409664:12345-0@lo:5: Request processed in 82us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265191.030775:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789265191.031161:0:8909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccaa292300 x1876180417409664/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265207 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265191.031172:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa292300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8909:1876180417409664:0@lo:5: 00000004:00080000:2.0:1789265191.031183:0:8909:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789265191.031210:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa292300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8909:1876180417409792:0@lo:5: 00000100:00100000:2.0:1789265191.031240:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265191.031268:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7f900 going to sleep for 11 seconds 00000100:00100000:0.0:1789265191.031315:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417409792 00000100:00100000:0.0:1789265191.031320:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417409792 00000100:00100000:0.0:1789265191.031369:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265191.031376:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8909:x1876180417409792:12345-0@lo:5: 00002000:00080000:0.0:1789265191.031406:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1789265191.036404:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8909:x1876180417409792:12345-0@lo:5: Request processed in 5022us (5156us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789265191.036418:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:02000040:0.0:1789265191.036672:0:8913:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00010000:00080000:2.0:1789265191.038152:0:8909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccaa292300 x1876180417409792/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265207 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265191.038174:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa292300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8909:1876180417409792:0@lo:5: 00000004:00080000:2.0:1789265191.038191:0:8909:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1789265191.038240:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa293b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8909:1876180417409920:0@lo:900: 00000100:00100000:2.0:1789265191.038294:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265191.038388:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7f900 going to sleep for 11 seconds 00000100:00100000:3.0:1789265191.040595:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417409920 00000100:00100000:3.0:1789265191.040608:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417409920 00000100:00100000:3.0:1789265191.040729:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789265191.040739:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8909:x1876180417409920:12345-0@lo:900: 00000100:00100000:3.0:1789265191.040963:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8909:x1876180417409920:12345-0@lo:900: Request processed in 225us (2668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265191.040971:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789265191.041062:0:8909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccaa293b80 x1876180417409920/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789265207 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265191.041077:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa293b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8909:1876180417409920:0@lo:900: 00000100:00100000:0.0:1789265191.041625:0:8913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8913:1876180417410048:0@lo:5: 00000100:00100000:0.0:1789265191.041676:0:8913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265191.041707:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417410048 00000100:00100000:0.0:1789265191.041711:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417410048 00000100:00100000:0.0:1789265191.041760:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265191.041767:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8913:x1876180417410048:12345-0@lo:5: 00000100:00100000:2.0:1789265191.046344:0:8913:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc98ed5480 going to sleep for 11 seconds 00002000:00080000:0.0:1789265191.047422:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1789265191.047443:0:8433:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:0.0:1789265191.049847:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8913:x1876180417410048:12345-0@lo:5: Request processed in 8072us (8162us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789265191.049860:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789265191.050621:0:8913:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcc8376f800 x1876180417410048/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265207 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265191.050640:0:8913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8913:1876180417410048:0@lo:5: 00000004:00080000:2.0:1789265191.050655:0:8913:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:2.0:1789265191.234281:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789265191.693240:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:0.0:1789265191.693261:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1789265192.264947:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789265192.582561:0:8964:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789265192.582759:0:8964:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789265193.282152:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789265193.408372:0:9013:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789265193.408444:0:9013:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1789265194.308176:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265195.334414:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265195.523775:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa293b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417410304:0@lo:41: 00000100:00100000:2.0:1789265195.523920:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265195.523997:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcca955fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417410176:0@lo:41: 00000100:00100000:0.0:1789265195.524086:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265195.524166:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417410304 00000100:00100000:1.0:1789265195.524176:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417410304 00000100:00100000:1.0:1789265195.524232:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417410176 00000100:00100000:1.0:1789265195.524240:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417410176 00000100:00100000:1.0:1789265195.524259:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789265195.524267:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417410304:12345-0@lo:41: 00000004:00000024:1.0:1789265195.524301:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789265195.524348:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789265195.524364:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417410176:12345-0@lo:41: 00000004:00000024:0.0:1789265195.524398:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789265195.524790:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417410176:12345-0@lo:41: Request processed in 428us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265195.524800:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789265195.524871:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcca955fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417410176:0@lo:41: 00000100:00100000:1.0:1789265195.526198:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417410304:12345-0@lo:41: Request processed in 1926us (2281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265195.526210:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789265195.526319:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa293b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417410304:0@lo:41: 00000100:00100000:1.0:1789265196.033207:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcca955ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417410432:0@lo:13: 00000100:00100000:1.0:1789265196.033320:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265196.033420:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417410432 00000100:00100000:1.0:1789265196.033431:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417410432 00000100:00100000:1.0:1789265196.033508:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265196.033520:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417410432:12345-0@lo:13: 00000100:00080000:0.0:1789265196.033642:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265196.033719:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417410560:0@lo:13: 00002000:00000024:1.0:1789265196.033720:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265196.033766:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265196.033818:0:8437:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1789265196.033829:0:8437:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1789265196.033847:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417410432:12345-0@lo:13: Request processed in 323us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265196.033876:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789265196.033886:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcca955ca80 x1876180417410432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265196.033900:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789265196.033939:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417410560 00000100:00100000:0.0:1789265196.033946:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcca955ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417410432:0@lo:13: 00000100:00100000:1.0:1789265196.033953:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417410560 00000100:00100000:1.0:1789265196.034068:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265196.034090:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417410560:12345-0@lo:13: 00002000:00000024:1.0:1789265196.034107:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265196.034175:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417410560:12345-0@lo:13: Request processed in 87us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265196.034192:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789265196.034224:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789265196.034269:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcc8376d180 x1876180417410560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265196.034281:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1789265196.034308:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417410560:0@lo:13: 00000100:00100000:0.0:1789265196.034334:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417410688:0@lo:400: 00000100:00100000:1.0:1789265196.034345:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417411072:0@lo:400: 00000100:00100000:0.0:1789265196.034393:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265196.034411:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265196.034432:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417411200:0@lo:400: 00000100:00100000:1.0:1789265196.034455:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789265196.034465:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417410944:0@lo:400: 00000100:00100000:1.0:1789265196.034491:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265196.034512:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417411456:0@lo:400: 00000100:00100000:1.0:1789265196.034573:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265196.034609:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417410688 00000100:00100000:1.0:1789265196.034613:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417410688 00000100:00100000:1.0:1789265196.034647:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789265196.034655:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc82d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+21:3641:x1876180417410688:12345-0@lo:400: 00000100:00100000:1.0:1789265196.034692:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc82d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+21:3641:x1876180417410688:12345-0@lo:400: Request processed in 39us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265196.034710:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789265196.034741:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417411072 00000100:00100000:1.0:1789265196.034746:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417411072 00000100:00100000:1.0:1789265196.034770:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417410944 00000100:00100000:1.0:1789265196.034773:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417410944 00000100:00100000:1.0:1789265196.034786:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789265196.034792:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417411072:12345-0@lo:400: 00000100:00100000:1.0:1789265196.034836:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417411072:12345-0@lo:400: Request processed in 44us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265196.034843:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789265196.034857:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789265196.034865:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417410944:12345-0@lo:400: 00000100:00100000:1.0:1789265196.034904:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417410944:12345-0@lo:400: Request processed in 40us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265196.034925:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789265196.034952:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417411456 00000100:00100000:1.0:1789265196.034958:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417411456 00000100:00100000:1.0:1789265196.035016:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789265196.035058:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417411456:12345-0@lo:400: 00000100:00100000:1.0:1789265196.035094:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417411456:12345-0@lo:400: Request processed in 71us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265196.035101:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789265196.035210:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417410816:0@lo:400: 00000100:00100000:2.0:1789265196.035262:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265196.035295:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417411328:0@lo:400: 00000100:00100000:2.0:1789265196.035323:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265196.035366:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417410816 00000100:00100000:2.0:1789265196.035372:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417410816 00000100:00100000:2.0:1789265196.035415:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417411328 00000100:00100000:2.0:1789265196.035418:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417411328 00000100:00100000:0.0:1789265196.035653:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265196.035701:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417410688:0@lo:400: 00000100:00100000:2.0:1789265196.036143:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417411200 00000100:00100000:2.0:1789265196.036149:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417411200 00000100:00100000:2.0:1789265196.036181:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789265196.036194:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417410816:12345-0@lo:400: 00000100:00100000:2.0:1789265196.036272:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417410816:12345-0@lo:400: Request processed in 82us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265196.036293:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789265196.036315:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789265196.036325:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417411328:12345-0@lo:400: 00000100:00100000:2.0:1789265196.036361:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417411328:12345-0@lo:400: Request processed in 39us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265196.036368:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789265196.036381:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789265196.036387:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417411200:12345-0@lo:400: 00000100:00100000:2.0:1789265196.036420:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417411200:12345-0@lo:400: Request processed in 33us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265196.036426:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1789265196.037100:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcc8376e680 x1876180417410816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265196.037118:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417410816:0@lo:400: 00010000:00080000:2.0:1789265196.037132:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccbd3e6a00 x1876180417411328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265196.037142:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417411328:0@lo:400: 00010000:00080000:2.0:1789265196.037182:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcc8376f100 x1876180417411200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265196.037194:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417411200:0@lo:400: 00000100:00080000:1.0:1789265196.039361:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265196.039372:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265196.039434:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417410944:0@lo:400: 00010000:00080000:1.0:1789265196.039457:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccbd3e5500 x1876180417411456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265196.039490:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417411456:0@lo:400: 00000100:00100000:1.0:1789265196.039512:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417411072:0@lo:400: 00010000:00010000:3.0:1789265196.353656:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265197.380246:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265198.402836:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265199.425524:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265200.449510:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265200.642609:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417411584:0@lo:41: 00000100:00100000:1.0:1789265200.642705:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265200.642797:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417411584 00000100:00100000:1.0:1789265200.642806:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417411584 00000100:00100000:1.0:1789265200.643533:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789265200.643548:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417411584:12345-0@lo:41: 00000004:00000024:1.0:1789265200.643595:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789265200.643665:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417411584:12345-0@lo:41: Request processed in 120us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265200.643673:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789265200.643732:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417411584:0@lo:41: 00000100:00100000:3.0:1789265200.644312:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417411712:0@lo:41: 00000100:00100000:3.0:1789265200.644365:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265200.644993:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417411712 00000100:00100000:1.0:1789265200.645004:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417411712 00000100:00100000:1.0:1789265200.645089:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789265200.645100:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417411712:12345-0@lo:41: 00000004:00000024:1.0:1789265200.646255:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789265200.646372:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417411712:12345-0@lo:41: Request processed in 1270us (2004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265200.646384:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789265200.647358:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417411712:0@lo:41: 00000100:00100000:0.0:1789265201.157768:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417411840:0@lo:13: 00000100:00100000:0.0:1789265201.157869:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265201.157952:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417412352:0@lo:400: 00000100:00100000:0.0:1789265201.157983:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265201.158016:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82868700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417412864:0@lo:400: 00000100:00100000:3.0:1789265201.158059:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417412352 00000100:00100000:0.0:1789265201.158067:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265201.158070:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417412352 00000100:00100000:0.0:1789265201.158118:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789265201.158125:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417412224:0@lo:400: 00000100:00100000:3.0:1789265201.158138:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789265201.158152:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417412352:12345-0@lo:400: 00000100:00100000:0.0:1789265201.158159:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265201.158185:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417412736:0@lo:400: 00000100:00100000:0.0:1789265201.158226:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265201.158237:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417412352:12345-0@lo:400: Request processed in 88us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265201.158248:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789265201.158271:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417412224 00000100:00100000:3.0:1789265201.158275:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417412224 00000100:00100000:0.0:1789265201.158279:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417412352:0@lo:400: 00000100:00100000:3.0:1789265201.158297:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789265201.158306:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417412224:12345-0@lo:400: 00000100:00100000:0.0:1789265201.158324:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417411968:0@lo:400: 00000100:00100000:3.0:1789265201.158353:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417412224:12345-0@lo:400: Request processed in 47us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265201.158362:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789265201.158367:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265201.158396:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417412480:0@lo:400: 00000100:00100000:0.0:1789265201.158422:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265201.158449:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417412992:0@lo:400: 00000100:00100000:3.0:1789265201.158470:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417412736 00000100:00100000:0.0:1789265201.158475:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265201.158477:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417412736 00000100:00100000:0.0:1789265201.158502:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789265201.158511:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82868a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417412096:0@lo:400: 00000100:00100000:3.0:1789265201.158522:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417412480 00000100:00100000:3.0:1789265201.158528:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417412480 00000100:00100000:0.0:1789265201.158538:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265201.158640:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417413120:0@lo:13: 00000100:00100000:1.0:1789265201.158675:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265201.158722:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417411840 00000100:00100000:1.0:1789265201.158726:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417411840 00000100:00100000:1.0:1789265201.158756:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417413120 00000100:00100000:1.0:1789265201.158759:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417413120 00000100:00100000:1.0:1789265201.158775:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265201.158781:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417411840:12345-0@lo:13: 00002000:00000024:1.0:1789265201.158814:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265201.158882:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417411840:12345-0@lo:13: Request processed in 69us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265201.158889:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265201.158911:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82868380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417412608:0@lo:400: 00000100:00100000:1.0:1789265201.158952:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265201.158958:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417413120:12345-0@lo:13: 00002000:00000024:1.0:1789265201.158968:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265201.158996:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417413120:12345-0@lo:13: Request processed in 38us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265201.159003:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789265201.159058:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265201.159064:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265201.159116:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265201.159123:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417412096 00000100:00100000:2.0:1789265201.159131:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417412096 00000100:00100000:3.0:1789265201.159136:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417412608 00000100:00100000:3.0:1789265201.159143:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417412608 00000100:00100000:0.0:1789265201.159154:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417412864 00000100:00100000:0.0:1789265201.159160:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417412864 00000100:00100000:2.0:1789265201.159166:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265201.159179:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417412736:12345-0@lo:400: 00000100:00100000:3.0:1789265201.159186:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789265201.159199:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417412480:12345-0@lo:400: 00000100:00100000:0.0:1789265201.159201:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417412992 00000100:00100000:0.0:1789265201.159207:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417412992 00000100:00100000:0.0:1789265201.159234:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265201.159242:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417412736:12345-0@lo:400: Request processed in 67us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265201.159247:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417412864:12345-0@lo:400: 00000100:00100000:2.0:1789265201.159254:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265201.159275:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789265201.159282:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417412480:12345-0@lo:400: Request processed in 85us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265201.159287:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417412096:12345-0@lo:400: 00000100:00100000:3.0:1789265201.159298:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265201.159298:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417412864:12345-0@lo:400: Request processed in 53us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265201.159311:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265201.159324:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265201.159333:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417412096:12345-0@lo:400: Request processed in 49us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265201.159336:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417412608:12345-0@lo:400: 00000100:00100000:0.0:1789265201.159341:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265201.159348:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789265201.159355:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417412992:12345-0@lo:400: 00000100:00100000:3.0:1789265201.159387:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417412608:12345-0@lo:400: Request processed in 54us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265201.159396:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789265201.159403:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417412992:12345-0@lo:400: Request processed in 52us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265201.159411:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265201.159436:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417411968 00000100:00100000:0.0:1789265201.159441:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417411968 00000100:00100000:0.0:1789265201.159469:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789265201.159475:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+21:3643:x1876180417411968:12345-0@lo:400: 00000100:00100000:0.0:1789265201.159506:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+21:3643:x1876180417411968:12345-0@lo:400: Request processed in 32us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265201.159512:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:2.0:1789265201.159525:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcc8376c380 x1876180417413120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265201.159548:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417413120:0@lo:13: 00010000:00080000:0.0:1789265201.159569:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb82868a80 x1876180417412096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265201.159580:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82868a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417412096:0@lo:400: 00010000:00080000:0.0:1789265201.159592:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb82868380 x1876180417412608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265201.159601:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82868380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417412608:0@lo:400: 00000100:00100000:0.0:1789265201.159612:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417411968:0@lo:400: 00010000:00080000:0.0:1789265201.159623:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb82868e00 x1876180417412480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265201.159634:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417412480:0@lo:400: 00010000:00080000:0.0:1789265201.159644:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb8286b800 x1876180417412992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265201.159664:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417412992:0@lo:400: 00000100:00100000:0.0:1789265201.159712:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417412224:0@lo:400: 00010000:00080000:0.0:1789265201.159723:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb8286b480 x1876180417412736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265201.159731:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417412736:0@lo:400: 00010000:00080000:0.0:1789265201.159739:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb82868700 x1876180417412864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265201.159746:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82868700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417412864:0@lo:400: 00010000:00080000:0.0:1789265201.159755:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccbd3e7800 x1876180417411840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265201.159767:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417411840:0@lo:13: 00000100:00080000:0.0:1789265201.164304:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789265201.473613:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789265202.358150:0:9513:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789265202.358154:0:9513:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789265202.358156:0:9513:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789265202.358287:0:9513:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fccbf44d000 00000020:01000004:3.0:1789265202.358302:0:9513:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789265202.358316:0:9513:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789265202.358331:0:9513:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9fccbd37cd28) 00000020:00000080:3.0:1789265202.358348:0:9513:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789265202.402062:0:9513:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789265202.402121:0:9513:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1789265202.423731:0:9513:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789265202.425347:0:9513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789265202.425364:0:9513:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789265202.425375:0:9513:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9272d942b4a964a5 00000020:01000004:2.0:1789265202.425382:0:9513:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789265202.426301:0:9513:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.149@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789265202.426308:0:9513:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.149@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789265202.426315:0:9513:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789265202.426349:0:9513:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1789265202.426353:0:9513:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.149@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789265202.457756:0:9513:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.149@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789265202.457795:0:9513:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.149@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789265202.457800:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789265202.457802:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789265202.457803:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265202.457804:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265202.457805:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265202.457807:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265202.457808:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265202.457810:0:9513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789265202.457811:0:9513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789265202.457812:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265202.457814:0:9513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789265202.457817:0:9513:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789265202.457819:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789265202.457824:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789265202.457825:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265202.457826:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265202.457827:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265202.457828:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265202.457829:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265202.457830:0:9513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789265202.457831:0:9513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789265202.457832:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265202.457833:0:9513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789265202.457858:0:9513:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789265202.457885:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82868700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417413248:0@lo:253: 00000100:00100000:3.0:1789265202.458135:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265202.458225:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7d900 going to sleep for 11 seconds 00000100:00100000:1.0:1789265202.458318:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417413248 00000100:00100000:1.0:1789265202.458326:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417413248 00000100:00100000:1.0:1789265202.458412:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789265202.458422:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+21:9513:x1876180417413248:12345-0@lo:253: 20000000:01000000:1.0:1789265202.458459:0:7458:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789265202.458463:0:7458:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1789265202.458468:0:7458:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1789265202.458472:0:7458:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1789265202.458695:0:7458:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265202.458815:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1789265202.458830:0:7458:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1789265202.458846:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1789265202.458858:0:7458:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1789265202.458887:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1789265202.458902:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1789265202.459002:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1789265202.459018:0:7458:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.149@tcp 20000000:01000000:1.0:1789265202.459050:0:7458:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.149@tcp (null) (null) (null) 00000040:00080000:1.0:1789265202.459068:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1789265202.459078:0:7458:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789265202.459092:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1789265202.459098:0:7458:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.149@tcp (null) (null) 00000040:00080000:1.0:1789265202.459112:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1789265202.459118:0:7458:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789265202.459133:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1789265202.459149:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1789265202.459292:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1789265202.459304:0:7458:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.149@tcp 20000000:01000000:1.0:1789265202.459306:0:7458:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.149@tcp (null) (null) (null) 00000040:00080000:1.0:1789265202.459336:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1789265202.459346:0:7458:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789265202.459359:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1789265202.459364:0:7458:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.149@tcp (null) (null) 00000040:00080000:1.0:1789265202.459375:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1789265202.459380:0:7458:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789265202.459392:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1789265202.459408:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1789265202.459778:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1789265202.459790:0:7458:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.149@tcp 20000000:01000000:1.0:1789265202.459791:0:7458:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.149@tcp (null) (null) (null) 00000040:00080000:1.0:1789265202.459806:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1789265202.459815:0:7458:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789265202.459829:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1789265202.459844:0:7458:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.149@tcp (null) (null) 00000040:00080000:1.0:1789265202.459859:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1789265202.459879:0:7458:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789265202.459894:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1789265202.459909:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1789265202.459922:0:7458:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789265202.459925:0:7458:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789265202.459928:0:7458:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789265202.459984:0:7458:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789265202.459987:0:7458:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789265202.460787:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1789265202.461316:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1789265202.461341:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1789265202.461353:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1789265202.461363:0:7458:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789265202.461364:0:7458:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789265202.461666:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:1.0:1789265202.461686:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:1.0:1789265202.461702:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1789265202.461856:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1789265202.461885:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1789265202.461896:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1789265202.461903:0:7458:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789265202.461905:0:7458:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789265202.463305:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1789265202.463336:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1789265202.463351:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1789265202.463552:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1789265202.463575:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1789265202.463587:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:3.0:1789265202.463595:0:7458:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789265202.463597:0:7458:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789265202.463856:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1789265202.463886:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1789265202.463898:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1789265202.464089:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1789265202.464108:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1789265202.464121:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:3.0:1789265202.464130:0:7458:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789265202.464132:0:7458:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789265202.464608:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1789265202.464639:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1789265202.464652:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1789265202.464777:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1789265202.464807:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1789265202.464823:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 10000000:01000000:3.0:1789265202.464845:0:7458:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789265202.464877:0:7458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fcc81490400/0x9272d942b4a964ac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.464895:0:7458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc882b6e00/0x9272d942b4a963a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9639b expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.464903:0:7458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc882b7000/0x9272d942b4a963cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a963c5 expref: 21 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.464910:0:7458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc81491000/0x9272d942b4a9640b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96404 expref: 21 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.464925:0:7458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc882b7800/0x9272d942b4a96427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96420 expref: 21 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.464932:0:7458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc882b7c00/0x9272d942b4a96451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9644a expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.464938:0:7458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc81490000/0x9272d942b4a9646d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96466 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.464943:0:7458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a96497 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96490 expref: 21 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.464950:0:7458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fcc81490400/0x9272d942b4a964ac lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.464991:0:7458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a96497 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a96490 expref: 21 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.465017:0:7458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a96497 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a96490 expref: 21 pid: 7458 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265202.465060:0:7458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:7458:1876180417413376:0@lo:104: 00000100:00100000:3.0:1789265202.465123:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265202.465170:0:7458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc81490000/0x9272d942b4a9646d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a96466 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.465178:0:7458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc81490000/0x9272d942b4a9646d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a96466 expref: 21 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265202.465186:0:7458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:7458:1876180417413504:0@lo:104: 00000100:00100000:3.0:1789265202.465493:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265202.465557:0:7458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc882b7c00/0x9272d942b4a96451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a9644a expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.465567:0:7458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc882b7c00/0x9272d942b4a96451 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a9644a expref: 21 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265202.465575:0:7458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:7458:1876180417413632:0@lo:104: 00000100:00100000:3.0:1789265202.465595:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265202.465835:0:7458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc882b7800/0x9272d942b4a96427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a96420 expref: 21 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.465842:0:7458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc882b7800/0x9272d942b4a96427 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a96420 expref: 21 pid: 7458 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265202.465850:0:7458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82868a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:7458:1876180417413760:0@lo:104: 00000100:00100000:3.0:1789265202.465889:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265202.465904:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417413376 00000100:00100000:0.0:1789265202.465911:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417413376 00000100:00100000:0.0:1789265202.465948:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417413504 00000100:00100000:0.0:1789265202.465951:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417413504 00000100:00100000:0.0:1789265202.465963:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417413632 00000100:00100000:0.0:1789265202.465965:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417413632 00000100:00100000:0.0:1789265202.465977:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789265202.465993:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+5:7458:x1876180417413376:12345-0@lo:104: 00010000:00010000:0.0:1789265202.466004:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96490 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96497 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.466078:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789265202.466084:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+5:7458:x1876180417413376:12345-0@lo:104: Request processed in 94us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265202.466091:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789265202.466110:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789265202.466115:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82868e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+4:7458:x1876180417413504:12345-0@lo:104: 00010000:00010000:0.0:1789265202.466121:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6600/0x9272d942b4a96466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9646d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.466151:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789265202.466156:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82868e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+4:7458:x1876180417413504:12345-0@lo:104: Request processed in 42us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265202.466161:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789265202.466174:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789265202.466181:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82868380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+3:7458:x1876180417413632:12345-0@lo:104: 00010000:00010000:0.0:1789265202.466187:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a9644a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96451 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.466231:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789265202.466236:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82868380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+3:7458:x1876180417413632:12345-0@lo:104: Request processed in 57us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265202.466241:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1789265202.466256:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789265202.466266:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96490 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96497 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.466272:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7e00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:0.0:1789265202.466276:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96490 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a96497 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.466283:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96490 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a96497 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265202.466290:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96490 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a96497 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265202.466295:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789265202.466321:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96490 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96497 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.466328:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265202.466345:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96490 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96497 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.466352:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96490 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96497 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.466363:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265202.466366:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6600/0x9272d942b4a96466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9646d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.466372:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6600 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:0.0:1789265202.466375:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6600/0x9272d942b4a96466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a9646d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.466391:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6600/0x9272d942b4a96466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a9646d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265202.466397:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6600/0x9272d942b4a96466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a9646d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265202.466403:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789265202.466416:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6600/0x9272d942b4a96466 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9646d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.466421:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265202.466438:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6600/0x9272d942b4a96466 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9646d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.466445:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6600/0x9272d942b4a96466 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9646d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.466453:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265202.466456:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a9644a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96451 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.466461:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6800 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:0.0:1789265202.466464:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a9644a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a96451 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.466470:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a9644a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a96451 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265202.466476:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a9644a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a96451 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265202.466487:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789265202.466500:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a9644a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96451 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.466506:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265202.466518:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a9644a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96451 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.466524:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a9644a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96451 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.466533:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265202.466534:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265202.466536:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265202.466547:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417413888:0@lo:103: 00000100:00100000:0.0:1789265202.466576:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265202.466601:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265202.466607:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417414016:0@lo:103: 00000100:00100000:0.0:1789265202.466627:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265202.466654:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417414144:0@lo:103: 00000100:00100000:0.0:1789265202.466674:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265202.467619:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417413888 00000100:00100000:0.0:1789265202.467629:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417413888 00010000:00010000:0.0:1789265202.467659:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a96497 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96490 expref: 22 pid: 7458 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265202.467693:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417414016 00000100:00100000:0.0:1789265202.467697:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417414016 00010000:00010000:0.0:1789265202.467721:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc81490000/0x9272d942b4a9646d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96466 expref: 23 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265202.467733:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417414144 00000100:00100000:0.0:1789265202.467736:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417414144 00010000:00010000:0.0:1789265202.467747:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc882b7c00/0x9272d942b4a96451 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9644a expref: 24 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265202.467760:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789265202.467769:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3641:x1876180417413888:12345-0@lo:103: 00010000:00010000:0.0:1789265202.467780:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265202.467785:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a96497 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96490 expref: 24 pid: 7458 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.467795:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a96497 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a96490 expref: 24 pid: 7458 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.467813:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265202.467861:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3641:x1876180417413888:12345-0@lo:103: Request processed in 94us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265202.467879:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789265202.467896:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789265202.467902:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+23:3641:x1876180417414016:12345-0@lo:103: 00010000:00010000:0.0:1789265202.467909:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265202.467913:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc81490000/0x9272d942b4a9646d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96466 expref: 23 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.467922:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc81490000/0x9272d942b4a9646d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a96466 expref: 23 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.467953:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265202.467978:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+23:3641:x1876180417414016:12345-0@lo:103: Request processed in 76us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265202.467985:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789265202.467999:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789265202.468005:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+22:3643:x1876180417414144:12345-0@lo:103: 00010000:00010000:0.0:1789265202.468012:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265202.468017:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc882b7c00/0x9272d942b4a96451 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9644a expref: 22 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.468049:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc882b7c00/0x9272d942b4a96451 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a9644a expref: 22 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.468059:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265202.468086:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+22:3643:x1876180417414144:12345-0@lo:103: Request processed in 81us (1410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265202.468092:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1789265202.468109:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265202.468137:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417414144:0@lo:103: 00000100:00100000:0.0:1789265202.468168:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417414016:0@lo:103: 00000100:00100000:0.0:1789265202.468176:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417413888:0@lo:103: 00010000:00010000:2.0:1789265202.468251:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265202.468615:0:7458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc81491000/0x9272d942b4a9640b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a96404 expref: 21 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.468627:0:7458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc81491000/0x9272d942b4a9640b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a96404 expref: 21 pid: 7458 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265202.468638:0:7458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:7458:1876180417414272:0@lo:104: 00000100:00100000:3.0:1789265202.468674:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265202.468739:0:7458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc882b7000/0x9272d942b4a963cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a963c5 expref: 21 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.468747:0:7458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc882b7000/0x9272d942b4a963cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a963c5 expref: 21 pid: 7458 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265202.468755:0:7458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:7458:1876180417414400:0@lo:104: 00000100:00100000:3.0:1789265202.468779:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265202.468879:0:7458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc882b6e00/0x9272d942b4a963a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a9639b expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.468887:0:7458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc882b6e00/0x9272d942b4a963a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a9639b expref: 21 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265202.468895:0:7458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:7458:1876180417414528:0@lo:104: 00000100:00100000:3.0:1789265202.468933:0:7458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7df00 going to sleep for 11 seconds 00010000:00010000:3.0:1789265202.468950:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a96497 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a96490 expref: 21 pid: 7458 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265202.468962:0:7458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:7458:1876180417413376:0@lo:104: 00010000:00010000:3.0:1789265202.468972:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81490000/0x9272d942b4a9646d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a96466 expref: 20 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265202.468986:0:7458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:7458:1876180417413504:0@lo:104: 00010000:00010000:3.0:1789265202.468997:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b7c00/0x9272d942b4a96451 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a9644a expref: 19 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265202.469006:0:7458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:7458:1876180417413632:0@lo:104: 00000100:00100000:1.0:1789265202.469274:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789265202.469296:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265202.469309:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417413760 00000100:00100000:1.0:1789265202.469314:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417413760 00000100:00100000:1.0:1789265202.469343:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417414272 00000100:00100000:1.0:1789265202.469346:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417414272 00000100:00100000:1.0:1789265202.469356:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417414400 00000100:00100000:1.0:1789265202.469359:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417414400 00000100:00100000:1.0:1789265202.469367:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417414528 00000100:00100000:1.0:1789265202.469370:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417414528 00000100:00100000:1.0:1789265202.469381:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789265202.469387:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+6:7458:x1876180417413760:12345-0@lo:104: 00010000:00010000:1.0:1789265202.469398:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96420 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96427 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265202.469513:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789265202.469519:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+6:7458:x1876180417413760:12345-0@lo:104: Request processed in 132us (3630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265202.469526:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789265202.469541:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789265202.469547:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+5:7458:x1876180417414272:12345-0@lo:104: 00010000:00010000:1.0:1789265202.469555:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a96404 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9640b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265202.469590:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789265202.469595:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+5:7458:x1876180417414272:12345-0@lo:104: Request processed in 49us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265202.469600:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789265202.469610:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789265202.469615:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccafbe1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+4:7458:x1876180417414400:12345-0@lo:104: 00010000:00010000:1.0:1789265202.469623:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc81490200/0x9272d942b4a963c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a963cc expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265202.469652:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789265202.469657:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccafbe1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+4:7458:x1876180417414400:12345-0@lo:104: Request processed in 42us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265202.469663:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789265202.469689:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789265202.469696:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+3:7458:x1876180417414528:12345-0@lo:104: 00010000:00010000:1.0:1789265202.469702:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a9639b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a963a2 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265202.469734:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789265202.469739:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+3:7458:x1876180417414528:12345-0@lo:104: Request processed in 45us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265202.469745:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789265202.469813:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789265202.469820:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96420 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96427 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.469839:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520b400 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265202.469843:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96420 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a96427 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.469851:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96420 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a96427 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265202.469858:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96420 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a96427 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265202.469875:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265202.469914:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96420 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96427 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.469921:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265202.469937:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96420 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96427 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.469944:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96420 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96427 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.469954:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789265202.469958:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a96404 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9640b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.469964:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7400 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265202.469967:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a96404 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a9640b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.469984:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a96404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a9640b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265202.469989:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a96404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a9640b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265202.469993:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265202.470012:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a96404 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9640b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470018:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265202.470049:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a96404 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9640b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470056:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a96404 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9640b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470066:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265202.470068:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc81490200/0x9272d942b4a963c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a963cc expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470074:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490200 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265202.470077:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81490200/0x9272d942b4a963c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a963cc expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470083:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc81490200/0x9272d942b4a963c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a963cc expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265202.470090:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81490200/0x9272d942b4a963c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a963cc expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265202.470100:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265202.470114:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc81490200/0x9272d942b4a963c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a963cc expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470119:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265202.470124:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc81490200/0x9272d942b4a963c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a963cc expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470130:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc81490200/0x9272d942b4a963c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a963cc expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470138:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265202.470141:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a9639b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a963a2 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470147:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81692c00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265202.470149:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a9639b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a963a2 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470155:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a9639b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a963a2 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265202.470160:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a9639b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a963a2 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265202.470165:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265202.470176:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a9639b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a963a2 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470182:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265202.470193:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a9639b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a963a2 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470209:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a9639b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a963a2 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470224:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265202.470225:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265202.470227:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265202.470239:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417414656:0@lo:103: 00000100:00100000:2.0:1789265202.470274:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265202.470297:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265202.470303:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417415040:0@lo:103: 00000100:00100000:2.0:1789265202.470323:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265202.470349:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417414656 00000100:00100000:2.0:1789265202.470353:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417414656 00010000:00010000:2.0:1789265202.470371:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc882b7800/0x9272d942b4a96427 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96420 expref: 19 pid: 7458 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265202.470389:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417415040 00000100:00100000:2.0:1789265202.470392:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417415040 00010000:00010000:2.0:1789265202.470401:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc882b6e00/0x9272d942b4a963a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9639b expref: 20 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265202.470419:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789265202.470424:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb09a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+20:3644:x1876180417414656:12345-0@lo:103: 00010000:00010000:2.0:1789265202.470433:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265202.470437:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc882b7800/0x9272d942b4a96427 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96420 expref: 20 pid: 7458 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470457:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc882b7800/0x9272d942b4a96427 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a96420 expref: 20 pid: 7458 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470471:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265202.470498:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb09a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+20:3644:x1876180417414656:12345-0@lo:103: Request processed in 74us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265202.470504:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789265202.470538:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789265202.470544:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+19:3644:x1876180417415040:12345-0@lo:103: 00010000:00010000:2.0:1789265202.470550:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265202.470554:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc882b6e00/0x9272d942b4a963a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9639b expref: 19 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470561:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc882b6e00/0x9272d942b4a963a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a9639b expref: 19 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470569:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265202.470586:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+19:3644:x1876180417415040:12345-0@lo:103: Request processed in 42us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265202.470590:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789265202.470610:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417414912:0@lo:103: 00000100:00100000:2.0:1789265202.470632:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265202.470648:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265202.470654:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417414784:0@lo:103: 00000100:00100000:2.0:1789265202.470672:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265202.470692:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417414912 00000100:00100000:2.0:1789265202.470695:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417414912 00010000:00010000:2.0:1789265202.470712:0:7926:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc882b7000/0x9272d942b4a963cc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a963c5 expref: 19 pid: 7458 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265202.470727:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417414784 00000100:00100000:2.0:1789265202.470730:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417414784 00010000:00010000:2.0:1789265202.470740:0:7926:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc81491000/0x9272d942b4a9640b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96404 expref: 20 pid: 7458 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265202.470751:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789265202.470756:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c287aa82-1100-4c72-b927-3b8d47a88a15+20:3642:x1876180417414912:12345-0@lo:103: 00010000:00010000:2.0:1789265202.470763:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265202.470766:0:7926:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc882b7000/0x9272d942b4a963cc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a963c5 expref: 20 pid: 7458 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470774:0:7926:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc882b7000/0x9272d942b4a963cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a963c5 expref: 20 pid: 7458 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470784:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265202.470806:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c287aa82-1100-4c72-b927-3b8d47a88a15+20:3642:x1876180417414912:12345-0@lo:103: Request processed in 50us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265202.470813:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789265202.470824:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789265202.470829:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c287aa82-1100-4c72-b927-3b8d47a88a15+19:3642:x1876180417414784:12345-0@lo:103: 00010000:00010000:2.0:1789265202.470835:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265202.470839:0:7926:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc81491000/0x9272d942b4a9640b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96404 expref: 19 pid: 7458 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470847:0:7926:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc81491000/0x9272d942b4a9640b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a96404 expref: 19 pid: 7458 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470875:0:7926:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fcc81490400/0x9272d942b4a964ac lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470883:0:7926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81490400/0x9272d942b4a964ac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470897:0:7926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fcc81490400/0x9272d942b4a964ac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470905:0:7926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fcc81490400/0x9272d942b4a964ac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470911:0:7926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fcc81490400/0x9272d942b4a964ac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470918:0:7926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fcc81490400/0x9272d942b4a964ac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470923:0:7926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490400 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265202.470926:0:7926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fcc81490400/0x9272d942b4a964ac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470933:0:7926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fcc81490400/0x9272d942b4a964ac lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470941:0:7926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fcc81490400/0x9272d942b4a964ac lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.470950:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265202.470972:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c287aa82-1100-4c72-b927-3b8d47a88a15+19:3642:x1876180417414784:12345-0@lo:103: Request processed in 143us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265202.470985:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789265202.471039:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417414784:0@lo:103: 00000100:00100000:2.0:1789265202.471046:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417414912:0@lo:103: 00000100:00100000:2.0:1789265202.471075:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417415040:0@lo:103: 00000100:00100000:2.0:1789265202.471082:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417414656:0@lo:103: 00010000:00010000:2.0:1789265202.471102:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265202.471638:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b7800/0x9272d942b4a96427 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a96420 expref: 18 pid: 7458 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265202.471651:0:7458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82868a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:7458:1876180417413760:0@lo:104: 00010000:00010000:3.0:1789265202.471662:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81491000/0x9272d942b4a9640b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a96404 expref: 17 pid: 7458 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265202.471671:0:7458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:7458:1876180417414272:0@lo:104: 00010000:00010000:3.0:1789265202.471680:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b7000/0x9272d942b4a963cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a963c5 expref: 16 pid: 7458 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265202.471687:0:7458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:7458:1876180417414400:0@lo:104: 00010000:00010000:3.0:1789265202.471697:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b6e00/0x9272d942b4a963a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a9639b expref: 15 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265202.471704:0:7458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:7458:1876180417414528:0@lo:104: 00010000:00010000:3.0:1789265202.471731:0:7458:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fcc81490400/0x9272d942b4a964ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.471739:0:7458:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fcc81490400/0x9272d942b4a964ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.471757:0:7458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fcc81490400/0x9272d942b4a964ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.471763:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81490400/0x9272d942b4a964ac lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789265202.471777:0:7458:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:0.0:1789265202.472293:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265202.474663:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+14:9513:x1876180417413248:12345-0@lo:253: Request processed in 16235us (16522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265202.474674:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789265202.474815:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82868700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417413248:0@lo:253: 10000000:01000000:3.0:1789265202.474830:0:9513:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789265202.474834:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789265202.474836:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789265202.474837:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265202.474839:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1789265202.474840:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265202.474841:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265202.474842:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265202.474844:0:9513:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789265202.474845:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265202.474847:0:9513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789265202.474879:0:9513:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fccbf44d000 from lustre-OST0001 10000000:01000000:3.0:1789265202.474981:0:9513:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789265202.474985:0:9513:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789265202.474994:0:9513:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fcc83f119b8 local copy 10000000:01000000:3.0:1789265202.474998:0:9513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789265202.475222:0:9513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81490400/0x9272d942b4a964b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.475234:0:9513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.149@tcp lock: ffff9fcc81490400/0x9272d942b4a964b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.475245:0:9513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc81490400/0x9272d942b4a964b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265202.475282:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417415168:0@lo:101: 00000100:00100000:3.0:1789265202.475319:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265202.475359:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7d000 going to sleep for 11 seconds 00000100:00100000:1.0:1789265202.476666:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417415168 00000100:00100000:1.0:1789265202.476677:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417415168 00000100:00100000:1.0:1789265202.476775:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789265202.476786:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+14:9513:x1876180417415168:12345-0@lo:101: 00010000:00010000:1.0:1789265202.476801:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265202.476818:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc81692a00/0x9272d942b4a964ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a964b3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265202.476845:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81692a00/0x9272d942b4a964ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a964b3 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265202.476856:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc81692a00/0x9272d942b4a964ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a964b3 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265202.476900:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81692a00, rc 0) 00000100:00100000:1.0:1789265202.476961:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+15:9513:x1876180417415168:12345-0@lo:101: Request processed in 178us (1641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265202.476968:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789265202.477077:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417415168:0@lo:101: 00010000:00010000:3.0:1789265202.477093:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc81490400/0x9272d942b4a964b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9272d942b4a964ba expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.477104:0:9513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc81490400/0x9272d942b4a964b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9272d942b4a964ba expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265202.478576:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417415296:0@lo:501: 00000100:00100000:3.0:1789265202.478634:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265202.478726:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7d000 going to sleep for 11 seconds 00000100:00100000:0.0:1789265202.479001:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417415296 00000100:00100000:0.0:1789265202.479008:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417415296 00000100:00100000:0.0:1789265202.479384:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789265202.479395:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+15:9513:x1876180417415296:12345-0@lo:501: 00000100:00100000:0.0:1789265202.479528:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+15:9513:x1876180417415296:12345-0@lo:501: Request processed in 135us (892us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789265202.479536:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789265202.479620:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417415296:0@lo:501: 10000000:01000000:3.0:1789265202.479636:0:9513:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.149@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789265202.479658:0:9513:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.149@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789265202.479666:0:9513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81490400/0x9272d942b4a964b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9272d942b4a964ba expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.479677:0:9513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81490400/0x9272d942b4a964b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9272d942b4a964ba expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.479684:0:9513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcc81490400/0x9272d942b4a964b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9272d942b4a964ba expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.479710:0:9513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789265202.479754:0:9513:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fccbf44d000 10000000:01000000:3.0:1789265202.479758:0:9513:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789265202.479765:0:9513:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789265202.479767:0:9513:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789265202.479772:0:9513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789265202.479775:0:9513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789265202.479798:0:9513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a964c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.479806:0:9513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a964c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.479815:0:9513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a964c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265202.479828:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417415424:0@lo:101: 00000100:00100000:3.0:1789265202.479856:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265202.479908:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265202.479916:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc81490400/0x9272d942b4a964b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9272d942b4a964ba expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.479923:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490400 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265202.479927:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81490400/0x9272d942b4a964b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9272d942b4a964ba expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.479935:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc81490400/0x9272d942b4a964b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9272d942b4a964ba expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265202.479943:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81490400/0x9272d942b4a964b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9272d942b4a964ba expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265202.479949:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265202.479969:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc81490400/0x9272d942b4a964b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9272d942b4a964ba expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.479975:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265202.479995:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc81490400/0x9272d942b4a964b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9272d942b4a964ba expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.480012:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc81490400/0x9272d942b4a964b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9272d942b4a964ba expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.480044:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265202.480046:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265202.480047:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265202.480066:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265202.480076:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417415552:0@lo:103: 00000100:00100000:2.0:1789265202.480108:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265202.480380:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417415552 00000100:00100000:2.0:1789265202.480386:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417415552 00000100:00100000:2.0:1789265202.480422:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265202.480430:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c287aa82-1100-4c72-b927-3b8d47a88a15+15:3643:x1876180417415552:12345-0@lo:103: 00010000:00010000:2.0:1789265202.480443:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265202.480457:0:7926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81692a00/0x9272d942b4a964ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a964b3 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.480472:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265202.480504:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c287aa82-1100-4c72-b927-3b8d47a88a15+14:3643:x1876180417415552:12345-0@lo:103: Request processed in 75us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265202.480511:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265202.480544:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417415552:0@lo:103: 00000100:00100000:3.0:1789265202.480592:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7df00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265202.480650:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417415424 00000100:00100000:1.0:1789265202.480656:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417415424 00000100:00100000:1.0:1789265202.480694:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789265202.480701:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+14:9513:x1876180417415424:12345-0@lo:101: 00010000:00010000:1.0:1789265202.480709:0:7458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265202.480787:0:7458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc81692e00/0x9272d942b4a964c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a964c1 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265202.480807:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81692e00/0x9272d942b4a964c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a964c1 expref: 15 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265202.480818:0:7458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc81692e00/0x9272d942b4a964c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a964c1 expref: 15 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265202.480825:0:7458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81692e00, rc 0) 00000100:00100000:1.0:1789265202.480925:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+15:9513:x1876180417415424:12345-0@lo:101: Request processed in 224us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265202.480931:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789265202.481574:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417415424:0@lo:101: 00010000:00010000:3.0:1789265202.481593:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a964c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a964c8 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.481602:0:9513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a964c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a964c8 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265202.481684:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417415680:0@lo:501: 00000100:00100000:3.0:1789265202.481775:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265202.481832:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7df00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265202.481977:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417415680 00000100:00100000:1.0:1789265202.481983:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417415680 00000100:00100000:1.0:1789265202.482019:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789265202.482094:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+15:9513:x1876180417415680:12345-0@lo:501: 00000100:00100000:1.0:1789265202.482371:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+15:9513:x1876180417415680:12345-0@lo:501: Request processed in 278us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265202.482378:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789265202.482588:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417415680:0@lo:501: 00000100:00100000:3.0:1789265202.482633:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417415808:0@lo:503: 00000100:00100000:3.0:1789265202.482673:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265202.482806:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7df00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265202.482851:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417415808 00000100:00100000:0.0:1789265202.482856:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417415808 00000100:00100000:2.0:1789265202.483207:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789265202.483218:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+15:9513:x1876180417415808:12345-0@lo:503: 00000100:00100000:2.0:1789265202.483381:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+15:9513:x1876180417415808:12345-0@lo:503: Request processed in 165us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265202.483397:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789265202.483459:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417415808:0@lo:503: 00000040:00080000:3.0:1789265202.483678:0:9513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265202.483750:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417415936:0@lo:502: 00000100:00100000:3.0:1789265202.483786:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265202.483839:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7df00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265202.483881:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417415936 00000100:00100000:2.0:1789265202.483885:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417415936 00000100:00100000:2.0:1789265202.483955:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789265202.483963:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+15:9513:x1876180417415936:12345-0@lo:502: 00000100:00100000:2.0:1789265202.484068:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+15:9513:x1876180417415936:12345-0@lo:502: Request processed in 105us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265202.484074:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789265202.484145:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417415936:0@lo:502: 00000040:00080000:3.0:1789265202.484322:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789265202.484344:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789265202.484356:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789265202.484366:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789265202.484378:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789265202.484389:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789265202.484404:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417416064:0@lo:502: 00000100:00100000:3.0:1789265202.484437:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265202.484656:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7df00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265202.484704:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417416064 00000100:00100000:1.0:1789265202.484709:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417416064 00000100:00100000:1.0:1789265202.484798:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789265202.484806:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+15:9513:x1876180417416064:12345-0@lo:502: 00000100:00100000:1.0:1789265202.484890:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+15:9513:x1876180417416064:12345-0@lo:502: Request processed in 84us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265202.484903:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789265202.484975:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417416064:0@lo:502: 00000040:00080000:3.0:1789265202.485017:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789265202.485044:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1789265202.485562:0:9524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789265202.485570:0:9524:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1789265202.485576:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265202.485578:0:9524:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789265202.485586:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789265202.485600:0:9524:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9fcb829fb370) 00000020:00000080:1.0:1789265202.485623:0:9524:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789265202.485627:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789265202.485685:0:9524:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fccbf44d000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789265202.485693:0:9524:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789265202.485699:0:9524:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9272d942b4a964d6 00010000:00010000:1.0:1789265202.490528:0:9524:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1789265202.490817:0:9524:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1789265202.498574:0:9524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 00010000:00010000:2.0:1789265202.498780:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:1.0:1789265202.499914:0:9524:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1789265202.505845:0:9524:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1789265202.506408:0:9524:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1789265202.515426:0:9524:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1789265202.516981:0:9524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789265202.516995:0:9524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265202.517001:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265202.517004:0:9524:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789265202.517009:0:9524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265202.517013:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265202.517234:0:9524:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789265202.517242:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789265202.517244:0:9524:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789265202.517264:0:9524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265202.517266:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265202.517268:0:9524:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789265202.517271:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789265202.524134:0:9513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1789265202.524248:0:9513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789265202.524306:0:9513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a964c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a964c8 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.524321:0:9513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a964c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a964c8 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265202.524330:0:9513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fccbf44d000 from 1 10000000:01000000:0.0:1789265202.524333:0:9513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789265202.524374:0:9513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a964dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.524383:0:9513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a964dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.524394:0:9513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a964dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265202.524425:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417416192:0@lo:101: 00000100:00100000:0.0:1789265202.524493:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265202.524544:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3b6540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265202.524617:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417416192 00000100:00100000:3.0:1789265202.524624:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417416192 00000100:00100000:3.0:1789265202.524674:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789265202.524683:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+15:9513:x1876180417416192:12345-0@lo:101: 00010000:00010000:3.0:1789265202.524695:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265202.524708:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc81490000/0x9272d942b4a964e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a964dd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.524732:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81490000/0x9272d942b4a964e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a964dd expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.524743:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc81490000/0x9272d942b4a964e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a964dd expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.524751:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81490000, rc 0) 00000100:00100000:3.0:1789265202.524788:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+16:9513:x1876180417416192:12345-0@lo:101: Request processed in 107us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265202.524795:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789265202.527942:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417416192:0@lo:101: 00010000:00010000:0.0:1789265202.527970:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a964dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a964e4 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265202.527982:0:9513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a964dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a964e4 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265202.528131:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417416320:0@lo:501: 00000100:00100000:0.0:1789265202.528202:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265202.528235:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3b6540 going to sleep for 11 seconds 00000100:00100000:2.0:1789265202.528376:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417416320 00000100:00100000:2.0:1789265202.528383:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417416320 00000100:00100000:2.0:1789265202.528432:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789265202.528440:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+16:9513:x1876180417416320:12345-0@lo:501: 00000100:00100000:2.0:1789265202.528541:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+16:9513:x1876180417416320:12345-0@lo:501: Request processed in 101us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265202.528548:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789265202.529571:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417416320:0@lo:501: 00000100:00100000:0.0:1789265202.529615:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417416448:0@lo:503: 00000100:00100000:0.0:1789265202.529671:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265202.529701:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3b6540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265202.530843:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417416448 00000100:00100000:3.0:1789265202.530852:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417416448 00000100:00100000:3.0:1789265202.531363:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789265202.531503:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+16:9513:x1876180417416448:12345-0@lo:503: 00000100:00100000:3.0:1789265202.531689:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+16:9513:x1876180417416448:12345-0@lo:503: Request processed in 190us (2017us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265202.531703:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789265202.531829:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417416448:0@lo:503: 00000040:00080000:2.0:1789265202.532678:0:9513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789265202.532837:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82ef6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417416576:0@lo:502: 00000100:00100000:2.0:1789265202.533225:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265202.533292:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada13e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265202.533327:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417416576 00000100:00100000:1.0:1789265202.533333:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417416576 00000100:00100000:1.0:1789265202.533571:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789265202.533580:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+16:9513:x1876180417416576:12345-0@lo:502: 00000100:00100000:1.0:1789265202.533706:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+16:9513:x1876180417416576:12345-0@lo:502: Request processed in 126us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265202.533779:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789265202.533878:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82ef6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417416576:0@lo:502: 00000040:00080000:0.0:1789265202.534096:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789265202.534126:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789265202.534664:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417416704:0@lo:502: 00000100:00100000:0.0:1789265202.534715:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265202.534754:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3b6240 going to sleep for 11 seconds 00000100:00100000:1.0:1789265202.534817:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417416704 00000100:00100000:1.0:1789265202.534822:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417416704 00000100:00100000:1.0:1789265202.534911:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789265202.534922:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+16:9513:x1876180417416704:12345-0@lo:502: 00000100:00100000:1.0:1789265202.535038:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+16:9513:x1876180417416704:12345-0@lo:502: Request processed in 101us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265202.535046:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789265202.535125:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417416704:0@lo:502: 00000040:00080000:0.0:1789265202.535186:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789265202.535195:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789265202.537668:0:9528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265202.537681:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265202.537683:0:9528:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789265202.537699:0:9528:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fccbf44d000 00000020:00000080:0.0:1789265202.537702:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789265202.537717:0:9528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265202.537720:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265202.537721:0:9528:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789265202.537724:0:9528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789265202.537895:0:9513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789265202.537941:0:9513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265202.537966:0:9513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a964dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a964e4 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.537978:0:9513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a964dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a964e4 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265202.538066:0:9513:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789265202.538069:0:9513:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fccbf44d000 10000000:01000000:2.0:1789265202.538072:0:9513:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fccbf44d000 10000000:01000000:2.0:1789265202.538076:0:9513:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789265202.538082:0:9513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fccbf44d000 from 1 10000000:01000000:2.0:1789265202.538085:0:9513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789265202.538124:0:9513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a964eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.538132:0:9513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a964eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.538143:0:9513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a964eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265202.538165:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82ef7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417416832:0@lo:101: 00000100:00100000:2.0:1789265202.538230:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265202.540969:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417416832 00000100:00100000:2.0:1789265202.540977:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada13cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265202.540981:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417416832 00000100:00100000:1.0:1789265202.541064:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789265202.541076:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+16:9513:x1876180417416832:12345-0@lo:101: 00010000:00010000:1.0:1789265202.541092:0:7458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265202.541108:0:7458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc81692600/0x9272d942b4a964f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a964eb expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265202.541131:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81692600/0x9272d942b4a964f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a964eb expref: 17 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265202.541150:0:7458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc81692600/0x9272d942b4a964f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a964eb expref: 17 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265202.541158:0:7458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81692600, rc 0) 00000100:00100000:1.0:1789265202.541219:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+17:9513:x1876180417416832:12345-0@lo:101: Request processed in 146us (2989us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265202.541225:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789265202.541305:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82ef7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417416832:0@lo:101: 00010000:00010000:2.0:1789265202.541321:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a964eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a964f2 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.541331:0:9513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a964eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a964f2 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265202.543056:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82ef7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417416960:0@lo:501: 00000100:00100000:2.0:1789265202.543111:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265202.553762:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417416960 00000100:00100000:0.0:1789265202.553777:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417416960 00000100:00100000:0.0:1789265202.553852:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789265202.553974:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+17:9513:x1876180417416960:12345-0@lo:501: 00000100:00100000:0.0:1789265202.554374:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+17:9513:x1876180417416960:12345-0@lo:501: Request processed in 512us (11261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265202.554384:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789265202.554693:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada13cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265202.554724:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82ef7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417416960:0@lo:501: 00000100:00100000:2.0:1789265202.554773:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82ef7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417417088:0@lo:503: 00000100:00100000:2.0:1789265202.554827:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265202.554974:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada13cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265202.555364:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417417088 00000100:00100000:1.0:1789265202.555371:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417417088 00000100:00100000:1.0:1789265202.555505:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789265202.555515:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+17:9513:x1876180417417088:12345-0@lo:503: 00000100:00100000:1.0:1789265202.555628:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+17:9513:x1876180417417088:12345-0@lo:503: Request processed in 114us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265202.555637:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789265202.555707:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82ef7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417417088:0@lo:503: 00000040:00080000:0.0:1789265202.555949:0:9513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789265202.556018:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417417216:0@lo:502: 00000100:00100000:0.0:1789265202.556085:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265202.556396:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3b6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265202.556512:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417417216 00000100:00100000:2.0:1789265202.556518:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417417216 00000100:00100000:2.0:1789265202.556562:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789265202.556571:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+17:9513:x1876180417417216:12345-0@lo:502: 00000100:00100000:2.0:1789265202.556674:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+17:9513:x1876180417417216:12345-0@lo:502: Request processed in 103us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265202.556681:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789265202.556730:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417417216:0@lo:502: 00000040:00080000:2.0:1789265202.557354:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789265202.557387:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789265202.557503:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789265202.557526:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789265202.557541:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789265202.557574:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789265202.557590:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789265202.557604:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789265202.557618:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789265202.557632:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789265202.557646:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789265202.557660:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789265202.557673:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789265202.557688:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789265202.557701:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789265202.557716:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789265202.557742:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789265202.557757:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789265202.557772:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789265202.557785:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789265202.557797:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789265202.557822:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789265202.557838:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789265202.557852:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789265202.557949:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1789265202.557969:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1789265202.557983:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1789265202.557997:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1789265202.558011:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1789265202.558960:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1789265202.558998:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1789265202.559013:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1789265202.559210:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1789265202.559230:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1789265202.559243:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1789265202.559257:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1789265202.559271:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1789265202.559305:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1789265202.559321:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1789265202.559335:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1789265202.559347:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1789265202.559360:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1789265202.559372:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1789265202.559385:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1789265202.559398:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1789265202.559548:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1789265202.559600:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82ef5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417417344:0@lo:502: 00000100:00100000:2.0:1789265202.559679:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265202.559783:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada13d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265202.559833:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417417344 00000100:00100000:1.0:1789265202.559847:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417417344 00000100:00100000:1.0:1789265202.560002:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789265202.560011:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+17:9513:x1876180417417344:12345-0@lo:502: 00000100:00100000:1.0:1789265202.560172:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+17:9513:x1876180417417344:12345-0@lo:502: Request processed in 161us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265202.560179:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789265202.560268:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82ef5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417417344:0@lo:502: 00000040:00080000:2.0:1789265202.560320:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1789265202.560329:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1789265202.561387:0:9529:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789265202.561418:0:9529:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9fcb839399b8) 00000020:00000080:2.0:1789265202.561442:0:9529:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1789265202.561528:0:9529:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fccbf44d000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789265202.561532:0:9529:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fccbf44d000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789265202.561535:0:9529:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fccbf44d000 3 00010000:00080000:2.0:1789265202.561562:0:9529:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fcb83932800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.149@tcp at head 00010000:00010000:2.0:1789265202.563785:0:9529:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1789265202.564005:0:9529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789265202.564066:0:9529:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789265202.564079:0:9529:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9272d942b4a96500 00000100:00080000:2.0:1789265202.564089:0:9529:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789265202.564095:0:9529:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fcb83932800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265202.564132:0:9529:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb82ef5500 x1876180417417472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265202.564173:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1876180417417472:0@lo:38: 00000100:00100000:2.0:1789265202.564244:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265202.564302:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417417472 00000100:00100000:2.0:1789265202.564308:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417417472 00000100:00100000:2.0:1789265202.564337:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265202.564344:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1876180417417472:12345-0@lo:38: 00010000:00080000:2.0:1789265202.564364:0:8460:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:2.0:1789265202.564399:0:8460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9272d942b4a96507 00000004:00100000:2.0:1789265202.564415:0:8460:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789265202.564456:0:8460:0:(import.c:65:import_set_state_nolock()) ffff9fcb83930000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265202.564503:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876180417417472:12345-0@lo:38: Request processed in 158us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265202.564510:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789265202.564543:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb82ef5500 x1876180417417472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265202.564551:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789265202.564557:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789265202.564563:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789265202.564566:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789265202.564568:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb83932800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789265202.564573:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1876180417417472:0@lo:38: 00000100:00080000:2.0:1789265202.564589:0:9529:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789265202.567782:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417417600:0@lo:400: 00000100:00100000:0.0:1789265202.567850:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265202.568279:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417417600 00000100:00100000:3.0:1789265202.568288:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417417600 00000100:00100000:3.0:1789265202.568336:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789265202.568346:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417417600:12345-0@lo:400: 00000020:01000004:2.0:1789265202.568480:0:9529:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789265202.568498:0:9529:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9fcb8393cd28) 00000020:00000080:2.0:1789265202.568521:0:9529:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1789265202.568597:0:9529:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fccbf44d000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789265202.568601:0:9529:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fccbf44d000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789265202.568604:0:9529:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fccbf44d000 3 00010000:00080000:2.0:1789265202.568632:0:9529:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fcb83937800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.149@tcp at head 00010000:00010000:2.0:1789265202.570807:0:9529:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1789265202.571114:0:9529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1789265202.571354:0:9529:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789265202.571366:0:9529:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x9272d942b4a96515 00000100:00080000:2.0:1789265202.571376:0:9529:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789265202.571382:0:9529:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9fcb83937800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265202.571477:0:9529:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb82ef5500 x1876180417417856/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265202.571512:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1876180417417856:0@lo:38: 00000100:00100000:2.0:1789265202.571582:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265202.571819:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417417728:0@lo:400: 00000100:00100000:1.0:1789265202.571853:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265202.571950:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417418368:0@lo:400: 00000100:00100000:1.0:1789265202.571974:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265202.571993:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265202.571999:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82868a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417418240:0@lo:400: 00000100:00100000:1.0:1789265202.572018:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265202.572061:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417417856 00000100:00100000:1.0:1789265202.572068:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417417856 00000100:00100000:1.0:1789265202.572088:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417418368 00000100:00100000:1.0:1789265202.572090:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417418368 00000100:00100000:1.0:1789265202.572108:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417418240 00000100:00100000:1.0:1789265202.572110:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417418240 00000100:00100000:1.0:1789265202.572122:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789265202.572129:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417418368:12345-0@lo:400: 00000100:00100000:1.0:1789265202.572235:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417418368:12345-0@lo:400: Request processed in 105us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265202.572241:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789265202.572254:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789265202.572260:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417418240:12345-0@lo:400: 00000100:00100000:1.0:1789265202.572284:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417418240:12345-0@lo:400: Request processed in 25us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265202.572296:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789265202.572307:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265202.572311:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1876180417417856:12345-0@lo:38: 00010000:00080000:1.0:1789265202.572330:0:8459:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:1.0:1789265202.572369:0:8459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x9272d942b4a9651c 00000004:00100000:1.0:1789265202.572385:0:8459:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789265202.572469:0:8459:0:(import.c:65:import_set_state_nolock()) ffff9fcb83919000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265202.572504:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876180417417856:12345-0@lo:38: Request processed in 191us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265202.572509:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265202.572528:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417417984:0@lo:400: 00000100:00100000:1.0:1789265202.572549:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265202.572567:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417418496:0@lo:400: 00000100:00100000:1.0:1789265202.572594:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265202.572612:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789265202.572618:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82868700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417418112:0@lo:400: 00000100:00100000:1.0:1789265202.572636:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265202.572650:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417418624:0@lo:400: 00000100:00100000:1.0:1789265202.572666:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265202.572692:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417417728 00000100:00100000:1.0:1789265202.572695:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417417728 00000100:00100000:1.0:1789265202.572715:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417417984 00000100:00100000:1.0:1789265202.572717:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417417984 00000100:00100000:1.0:1789265202.572726:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789265202.572732:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417417728:12345-0@lo:400: 00000100:00100000:1.0:1789265202.572763:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417417728:12345-0@lo:400: Request processed in 31us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265202.572774:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789265202.572786:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789265202.572792:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417417984:12345-0@lo:400: 00000100:00100000:1.0:1789265202.572823:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417417984:12345-0@lo:400: Request processed in 32us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265202.572829:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789265202.572845:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417418112 00000100:00100000:1.0:1789265202.572848:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417418112 00000100:00100000:1.0:1789265202.572944:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789265202.572952:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417418112:12345-0@lo:400: 00000100:00100000:1.0:1789265202.572981:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417418112:12345-0@lo:400: Request processed in 31us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265202.572986:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1789265202.573042:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb82868a80 x1876180417418240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265202.573056:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82868a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417418240:0@lo:400: 00000100:00100000:1.0:1789265202.573069:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417417728:0@lo:400: 00010000:00080000:1.0:1789265202.573079:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb8286ad80 x1876180417418368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265202.573086:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417418368:0@lo:400: 00000100:00100000:1.0:1789265202.573119:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417418496 00000100:00100000:1.0:1789265202.573122:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417418496 00000100:00080000:2.0:1789265202.573225:0:9529:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789265202.573325:0:9530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82ef6680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9530:1876180417418752:0@lo:901: 00000100:00100000:2.0:1789265202.573358:0:9530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265202.573375:0:9530:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada13180 going to sleep for 11 seconds 00000100:00100000:1.0:1789265202.573479:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417418624 00000100:00100000:1.0:1789265202.573483:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417418624 00000100:00100000:1.0:1789265202.573505:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265202.573519:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417418496:12345-0@lo:400: 00000100:00100000:1.0:1789265202.573551:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417418496:12345-0@lo:400: Request processed in 34us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265202.573556:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265202.573568:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265202.573573:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417418624:12345-0@lo:400: 00000100:00100000:1.0:1789265202.573596:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417418624:12345-0@lo:400: Request processed in 23us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265202.573601:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789265202.573633:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb82868700 x1876180417418112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265202.573642:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82868700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417418112:0@lo:400: 00010000:00080000:1.0:1789265202.573652:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb8286b480 x1876180417418624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265202.573660:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417418624:0@lo:400: 00000100:00100000:1.0:1789265202.573670:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417417984:0@lo:400: 00010000:00080000:1.0:1789265202.573679:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb8286b800 x1876180417418496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265202.573685:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417418496:0@lo:400: 00010000:00080000:1.0:1789265202.573741:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb82ef5500 x1876180417417856/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265202.573748:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789265202.573755:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789265202.573761:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789265202.573771:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789265202.573774:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb83937800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789265202.573779:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1876180417417856:0@lo:38: 00000100:00100000:3.0:1789265202.574051:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417417600:12345-0@lo:400: Request processed in 5705us (6199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265202.574060:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000040:00080000:2.0:1789265202.575214:0:9529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:1.0:1789265202.575970:0:9513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1789265202.576004:0:9513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789265202.576040:0:9513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a964eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a964f2 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265202.576053:0:9513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a964eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a964f2 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789265202.576103:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789265202.576106:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789265202.576107:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265202.576108:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265202.576109:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265202.576111:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265202.576112:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265202.576114:0:9513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789265202.576115:0:9513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789265202.576117:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265202.576119:0:9513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789265202.576122:0:9513:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1789265202.576125:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789265202.576126:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789265202.576127:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265202.576128:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265202.576129:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265202.576130:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265202.576131:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265202.576132:0:9513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789265202.576133:0:9513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789265202.576133:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265202.576931:0:9513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789265202.576957:0:9513:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789265202.576978:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417418880:0@lo:253: 00000100:00100000:1.0:1789265202.577971:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265202.578019:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd342900 going to sleep for 11 seconds 00000100:00100000:1.0:1789265202.578069:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417418752 00000100:00100000:1.0:1789265202.578075:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417418752 00000100:00100000:1.0:1789265202.578126:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789265202.578564:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc8376ca80 x1876180417417600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265202.578579:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417417600:0@lo:400: 00000100:00100000:1.0:1789265202.578647:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9530:x1876180417418752:12345-0@lo:901: 00000100:00100000:1.0:1789265202.578764:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9530:x1876180417418752:12345-0@lo:901: Request processed in 630us (5405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265202.578773:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265202.578798:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417418880 00000100:00100000:1.0:1789265202.578802:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417418880 00000100:00100000:1.0:1789265202.578829:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789265202.578835:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+17:9513:x1876180417418880:12345-0@lo:253: 20000000:01000000:1.0:1789265202.578857:0:7458:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00010000:00080000:0.0:1789265202.579557:0:9530:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb82ef6680 x1876180417418752/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789265218 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265202.579569:0:9530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82ef6680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9530:1876180417418752:0@lo:901: 20000000:01000000:1.0:1789265202.579793:0:7458:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:1.0:1789265202.580558:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:2.0:1789265202.592281:0:7458:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789265202.592323:0:7458:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789265202.592583:0:6532:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789265202.592588:0:6532:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789265202.592610:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fcc81490600/0x9272d942b4a96523 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.592629:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc882b6a00/0x9272d942b4a96419 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96412 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.592638:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc81490e00/0x9272d942b4a9645f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96458 expref: 17 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.592643:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fcc81490600/0x9272d942b4a96523 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.592680:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc81490e00/0x9272d942b4a9645f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a96458 expref: 17 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.592694:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc81490e00/0x9272d942b4a9645f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a96458 expref: 17 pid: 7458 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265202.592724:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876180417419008:0@lo:104: 00000100:00100000:3.0:1789265202.592786:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265202.592848:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc882b6a00/0x9272d942b4a96419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a96412 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.592857:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc882b6a00/0x9272d942b4a96419 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a96412 expref: 17 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265202.592944:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876180417419136:0@lo:104: 00000100:00100000:3.0:1789265202.592968:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265202.592992:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7db40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265202.593061:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417419008 00000100:00100000:2.0:1789265202.593070:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417419008 00000100:00100000:2.0:1789265202.593108:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417419136 00000100:00100000:2.0:1789265202.593111:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417419136 00000100:00100000:2.0:1789265202.593126:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789265202.593204:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+4:6532:x1876180417419008:12345-0@lo:104: 00010000:00010000:2.0:1789265202.593220:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a96458 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9645f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.593278:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265202.593284:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+4:6532:x1876180417419008:12345-0@lo:104: Request processed in 150us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265202.593291:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789265202.593310:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265202.593316:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+3:6532:x1876180417419136:12345-0@lo:104: 00010000:00010000:2.0:1789265202.593325:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fccb520be00/0x9272d942b4a96412 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96419 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.593373:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789265202.593378:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+3:6532:x1876180417419136:12345-0@lo:104: Request processed in 63us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265202.593383:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1789265202.593401:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265202.593415:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a96458 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9645f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.593422:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6c00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265202.593425:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a96458 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a9645f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.593433:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a96458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a9645f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265202.593440:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a96458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a9645f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265202.593446:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265202.593475:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a96458 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9645f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.593482:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265202.593499:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a96458 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9645f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.593506:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a96458 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9645f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.593527:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265202.593531:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fccb520be00/0x9272d942b4a96412 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96419 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.593536:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520be00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265202.593538:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fccb520be00/0x9272d942b4a96412 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a96419 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.593544:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fccb520be00/0x9272d942b4a96412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a96419 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265202.593549:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fccb520be00/0x9272d942b4a96412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a96419 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265202.593553:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265202.593566:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fccb520be00/0x9272d942b4a96412 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96419 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.593572:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265202.593577:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fccb520be00/0x9272d942b4a96412 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96419 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.593582:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fccb520be00/0x9272d942b4a96412 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96419 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.593592:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265202.593594:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265202.593595:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265202.593602:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265202.593617:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417419264:0@lo:103: 00000100:00100000:2.0:1789265202.593646:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265202.593667:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265202.593672:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417419392:0@lo:103: 00000100:00100000:2.0:1789265202.593691:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265202.593717:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417419264 00000100:00100000:2.0:1789265202.593721:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417419264 00010000:00010000:2.0:1789265202.593738:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc81490e00/0x9272d942b4a9645f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96458 expref: 18 pid: 7458 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265202.593758:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417419392 00000100:00100000:2.0:1789265202.593761:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417419392 00010000:00010000:2.0:1789265202.593771:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc882b6a00/0x9272d942b4a96419 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96412 expref: 19 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265202.593787:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789265202.593793:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+19:3641:x1876180417419264:12345-0@lo:103: 00010000:00010000:2.0:1789265202.593804:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265202.593809:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc81490e00/0x9272d942b4a9645f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96458 expref: 19 pid: 7458 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.593819:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc81490e00/0x9272d942b4a9645f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a96458 expref: 19 pid: 7458 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.593834:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265202.594063:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81490e00/0x9272d942b4a9645f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a96458 expref: 19 pid: 7458 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265202.594076:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876180417419008:0@lo:104: 00000100:00100000:3.0:1789265202.594086:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1876180417419136:0@lo:104: 00010000:00010000:3.0:1789265202.594106:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fcc81490600/0x9272d942b4a96523 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265202.594223:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+18:3641:x1876180417419264:12345-0@lo:103: Request processed in 70us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265202.594232:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789265202.594248:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265202.594254:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+17:3641:x1876180417419392:12345-0@lo:103: 00010000:00010000:2.0:1789265202.594270:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265202.594275:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc882b6a00/0x9272d942b4a96419 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96412 expref: 17 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.594283:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc882b6a00/0x9272d942b4a96419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a96412 expref: 17 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.594293:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b6a00/0x9272d942b4a96419 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a96412 expref: 17 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.594304:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fcc81490600/0x9272d942b4a96523 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.594311:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81490600/0x9272d942b4a96523 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789265202.594323:0:6503:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005962423s 00010000:00010000:2.0:1789265202.594327:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fcc81490600/0x9272d942b4a96523 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.594333:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fcc81490600/0x9272d942b4a96523 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.594340:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fcc81490600/0x9272d942b4a96523 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.594347:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fcc81490600/0x9272d942b4a96523 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.594352:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490600 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265202.594355:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fcc81490600/0x9272d942b4a96523 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.594368:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fcc81490600/0x9272d942b4a96523 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.594389:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fcc81490600/0x9272d942b4a96523 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265202.594398:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265202.594533:0:6532:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fcc81490600/0x9272d942b4a96523 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.594542:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fcc81490600/0x9272d942b4a96523 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265202.594549:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81490600/0x9272d942b4a96523 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265202.594619:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+16:3641:x1876180417419392:12345-0@lo:103: Request processed in 364us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265202.594626:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265202.594664:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417419392:0@lo:103: 00000100:00100000:2.0:1789265202.594671:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417419264:0@lo:103: 00000100:00100000:1.0:1789265202.594831:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+15:9513:x1876180417418880:12345-0@lo:253: Request processed in 15995us (16862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265202.594840:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789265202.595000:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c287aa82-1100-4c72-b927-3b8d47a88a15:9513:1876180417418880:0@lo:253: 10000000:01000000:3.0:1789265202.595010:0:9513:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789265202.595013:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789265202.595015:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789265202.595017:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265202.595017:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265202.595019:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265202.595049:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265202.595051:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265202.595053:0:9513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789265202.595054:0:9513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789265202.595056:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265202.595057:0:9513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789265202.595076:0:9513:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789265202.603712:0:9513:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1789265202.603970:0:9513:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789265202.604325:0:9513:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1789265202.604482:0:9513:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789265202.604669:0:9513:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1789265202.605240:0:9513:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1789265202.606670:0:9513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789265202.614526:0:9513:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789265202.614535:0:9513:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789265202.614575:0:9513:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789265202.614621:0:9513:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.149@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789265202.614640:0:9513:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1789265202.614667:0:9513:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1789265202.615451:0:9513:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789265202.615663:0:9513:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000020:00000004:2.0:1789265203.450580:0:9585:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265203.450904:0:9585:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789265203.522614:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265204.552895:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265205.570452:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265205.761371:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417419520:0@lo:41: 00000100:00100000:0.0:1789265205.761449:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265205.761541:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417419520 00000100:00100000:2.0:1789265205.761548:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417419520 00000100:00100000:2.0:1789265205.761597:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789265205.761618:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417419520:12345-0@lo:41: 00000004:00000024:2.0:1789265205.761651:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789265205.762281:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417419520:12345-0@lo:41: Request processed in 663us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265205.762289:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789265205.762494:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417419648:0@lo:41: 00000100:00100000:3.0:1789265205.762540:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265205.762766:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417419520:0@lo:41: 00000100:00100000:2.0:1789265205.762814:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417419648 00000100:00100000:2.0:1789265205.762820:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417419648 00000100:00100000:3.0:1789265205.762921:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789265205.763144:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417419648:12345-0@lo:41: 00000004:00000024:3.0:1789265205.763169:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1789265205.763223:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417419648:12345-0@lo:41: Request processed in 82us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265205.763279:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417419648:0@lo:41: 00000100:00100000:3.0:1789265205.763497:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789265206.273222:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265206.273255:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417419776:0@lo:13: 00000100:00100000:3.0:1789265206.273324:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265206.273571:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417419776 00000100:00100000:0.0:1789265206.273579:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417419776 00000100:00100000:0.0:1789265206.273642:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265206.273652:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417419776:12345-0@lo:13: 00002000:00000024:0.0:1789265206.273682:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265206.273728:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417419776:12345-0@lo:13: Request processed in 78us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265206.273735:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789265206.273776:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd3e7800 x1876180417419776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265206.273793:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417419776:0@lo:13: 00000100:00080000:3.0:1789265206.273850:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265206.273995:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265206.274005:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417419904:0@lo:13: 00000100:00100000:2.0:1789265206.274067:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265206.274270:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417419904 00000100:00100000:0.0:1789265206.274275:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417419904 00000100:00100000:0.0:1789265206.274319:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265206.274326:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417419904:12345-0@lo:13: 00002000:00000024:0.0:1789265206.274350:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265206.274397:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417419904:12345-0@lo:13: Request processed in 71us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265206.274402:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789265206.274428:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd3e7800 x1876180417419904/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265206.274440:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417419904:0@lo:13: 00000100:00080000:3.0:1789265206.274481:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789265206.593255:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265207.618221:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265207.809882:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417420416:0@lo:400: 00000100:00100000:0.0:1789265207.810115:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417420032:0@lo:400: 00000100:00100000:0.0:1789265207.812883:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265207.813302:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417420544:0@lo:400: 00000100:00100000:0.0:1789265207.813349:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265207.813390:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417421056:0@lo:400: 00000100:00100000:0.0:1789265207.813417:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265207.813446:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789265207.813453:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417420160:0@lo:400: 00000100:00100000:0.0:1789265207.813476:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265207.813495:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417420672:0@lo:400: 00000100:00100000:0.0:1789265207.813585:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265207.813605:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417421184:0@lo:400: 00000100:00100000:0.0:1789265207.813627:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265207.813739:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417420288:0@lo:400: 00000100:00100000:0.0:1789265207.813770:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265207.813790:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417420800:0@lo:400: 00000100:00100000:0.0:1789265207.813858:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265207.813880:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417421312:0@lo:400: 00000100:00100000:0.0:1789265207.813907:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265207.814354:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417420032 00000100:00100000:3.0:1789265207.814363:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417420032 00000100:00100000:3.0:1789265207.814415:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789265207.814424:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+15:3643:x1876180417420032:12345-0@lo:400: 00000100:00100000:3.0:1789265207.814483:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+15:3643:x1876180417420032:12345-0@lo:400: Request processed in 60us (1605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265207.814491:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789265207.815073:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417420544 00000100:00100000:0.0:1789265207.815080:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417420544 00000100:00100000:0.0:1789265207.815107:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417420160 00000100:00100000:0.0:1789265207.815110:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417420160 00000100:00100000:0.0:1789265207.815121:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417420672 00000100:00100000:0.0:1789265207.815123:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417420672 00000100:00100000:0.0:1789265207.815148:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417421184 00000100:00100000:0.0:1789265207.815151:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417421184 00000100:00100000:0.0:1789265207.815565:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417420800 00000100:00100000:0.0:1789265207.815570:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417420800 00000100:00100000:0.0:1789265207.815595:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417421312 00000100:00100000:0.0:1789265207.815598:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417421312 00000100:00100000:0.0:1789265207.815619:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789265207.815626:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417420544:12345-0@lo:400: 00000100:00100000:0.0:1789265207.816059:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417420544:12345-0@lo:400: Request processed in 432us (2708us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265207.816067:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789265207.816086:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789265207.816093:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417420160:12345-0@lo:400: 00000100:00100000:0.0:1789265207.816124:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417420160:12345-0@lo:400: Request processed in 32us (2647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265207.816130:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789265207.816141:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789265207.816148:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417420672:12345-0@lo:400: 00000100:00100000:0.0:1789265207.816310:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417420672:12345-0@lo:400: Request processed in 161us (2723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265207.816329:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789265207.816343:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789265207.816350:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417421184:12345-0@lo:400: 00000100:00100000:0.0:1789265207.816589:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417421184:12345-0@lo:400: Request processed in 239us (2960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265207.816596:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789265207.816608:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789265207.816615:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417420800:12345-0@lo:400: 00000100:00100000:0.0:1789265207.816658:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417420800:12345-0@lo:400: Request processed in 44us (2800us total) trans 0 rc 0/0 00000100:00080000:3.0:1789265207.816769:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265207.816774:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265207.817140:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417420288 00000100:00100000:3.0:1789265207.817146:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417420288 00000100:00100000:3.0:1789265207.817201:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789265207.817208:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417420288:12345-0@lo:400: 00000100:00100000:3.0:1789265207.817380:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417420288:12345-0@lo:400: Request processed in 161us (3597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265207.817388:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789265207.817411:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789265207.817419:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417421312:12345-0@lo:400: 00000100:00100000:3.0:1789265207.817464:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417421312:12345-0@lo:400: Request processed in 46us (3556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265207.817471:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789265207.817497:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417421056 00000100:00100000:3.0:1789265207.817724:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417421056 00000100:00100000:3.0:1789265207.817762:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789265207.817777:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417421056:12345-0@lo:400: 00000100:00100000:3.0:1789265207.817810:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417421056:12345-0@lo:400: Request processed in 34us (4393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265207.817816:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265207.818313:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1789265207.818365:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83b91880 x1876180417420160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265207.818491:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417420160:0@lo:400: 00010000:00080000:0.0:1789265207.818578:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83b91500 x1876180417420672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265207.818588:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417420672:0@lo:400: 00010000:00080000:0.0:1789265207.818600:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83b91c00 x1876180417421184/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265207.818608:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417421184:0@lo:400: 00000100:00100000:0.0:1789265207.818618:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417420032:0@lo:400: 00010000:00080000:0.0:1789265207.818629:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83b92a00 x1876180417420544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265207.818652:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417420544:0@lo:400: 00010000:00080000:0.0:1789265207.818773:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83b92d80 x1876180417421056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265207.818782:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417421056:0@lo:400: 00000100:00100000:0.0:1789265207.818849:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417420288:0@lo:400: 00010000:00080000:0.0:1789265207.818862:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83b93100 x1876180417420800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265207.818870:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417420800:0@lo:400: 00010000:00080000:0.0:1789265207.818881:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83b90000 x1876180417421312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265207.818889:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417421312:0@lo:400: 00000100:00100000:1.0:1789265207.819800:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265207.819887:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417420928:0@lo:400: 00000100:00100000:1.0:1789265207.819934:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265207.822276:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417420928 00000100:00100000:0.0:1789265207.822290:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417420928 00000100:00100000:0.0:1789265207.822345:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265207.822354:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417420928:12345-0@lo:400: 00000100:00100000:0.0:1789265207.822443:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417420928:12345-0@lo:400: Request processed in 90us (2508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265207.822450:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789265207.823364:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83b93800 x1876180417420928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265207.823405:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417420928:0@lo:400: 00000100:00100000:3.0:1789265207.825451:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417420416 00000100:00100000:3.0:1789265207.825464:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417420416 00000100:00100000:3.0:1789265207.825535:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789265207.825545:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417420416:12345-0@lo:400: 00000100:00100000:3.0:1789265207.825637:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417420416:12345-0@lo:400: Request processed in 94us (5841us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265207.825644:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789265207.825889:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417420416:0@lo:400: 00010000:00010000:3.0:1789265208.645174:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789265209.410729:0:9875:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg349-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789265209.666207:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789265210.561560:0:9927:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265210.564482:0:9927:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789265210.690733:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265210.883045:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265210.885055:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417421440:0@lo:41: 00000100:00100000:0.0:1789265210.885182:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265210.885261:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417421568:0@lo:41: 00000100:00100000:0.0:1789265210.885297:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265210.885577:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417421440 00000100:00100000:2.0:1789265210.885585:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417421440 00000100:00100000:2.0:1789265210.885649:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417421568 00000100:00100000:2.0:1789265210.885652:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417421568 00000100:00100000:2.0:1789265210.885671:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789265210.885679:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417421440:12345-0@lo:41: 00000004:00000024:2.0:1789265210.885715:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1789265210.885768:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417421440:12345-0@lo:41: Request processed in 89us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265210.885776:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789265210.885793:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789265210.885799:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417421568:12345-0@lo:41: 00000004:00000024:2.0:1789265210.885824:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789265210.896558:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417421568:12345-0@lo:41: Request processed in 10751us (11252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265210.896572:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789265210.896926:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417421440:0@lo:41: 00000100:00100000:2.0:1789265210.896967:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417421568:0@lo:41: 00000100:00100000:1.0:1789265211.393304:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417421696:0@lo:13: 00000100:00100000:1.0:1789265211.393393:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265211.393558:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417421696 00000100:00100000:0.0:1789265211.393566:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417421696 00000100:00100000:0.0:1789265211.393631:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789265211.393642:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417421696:12345-0@lo:13: 00002000:00000024:0.0:1789265211.393669:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265211.393715:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417421696:12345-0@lo:13: Request processed in 76us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265211.393723:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789265211.393855:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265211.393865:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417421824:0@lo:13: 00000100:00100000:2.0:1789265211.393896:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265211.393937:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417421824 00000100:00100000:2.0:1789265211.393941:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417421824 00000100:00100000:2.0:1789265211.393968:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789265211.393974:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417421824:12345-0@lo:13: 00002000:00000024:2.0:1789265211.393985:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265211.394017:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417421824:12345-0@lo:13: Request processed in 42us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265211.394044:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1789265211.394078:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb82ef7480 x1876180417421824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265211.394096:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417421824:0@lo:13: 00000100:00080000:1.0:1789265211.394278:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789265211.394303:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83d25500 x1876180417421696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265211.394317:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417421696:0@lo:13: 00010000:00010000:2.0:1789265211.713239:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265212.738250:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789265212.931598:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789265212.931604:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fccbd2a9800 from 39 10000000:01000000:1.0:1789265212.931608:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789265212.931648:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a9652a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265212.931659:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a9652a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265212.931670:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a9652a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265212.931690:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417421952:0@lo:101: 00000100:00100000:1.0:1789265212.931750:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265212.931790:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83b870c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265212.931824:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417421952 00000100:00100000:1.0:1789265212.931831:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417421952 00000100:00100000:1.0:1789265212.931875:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789265212.931884:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+15:6513:x1876180417421952:12345-0@lo:101: 00010000:00010000:1.0:1789265212.931905:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265212.931917:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a96531 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9652a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265212.931938:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a96531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9652a expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265212.931949:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a96531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9652a expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265212.931957:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81693e00, rc 0) 00000100:00100000:1.0:1789265212.931990:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+16:6513:x1876180417421952:12345-0@lo:101: Request processed in 107us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265212.931996:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789265212.932056:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417421952:0@lo:101: 00010000:00010000:1.0:1789265212.932081:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a9652a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96531 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265212.932090:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a9652a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96531 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265212.932148:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417422080:0@lo:501: 00000100:00100000:1.0:1789265212.932171:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265212.932190:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83b870c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265212.932201:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417422080 00000100:00100000:1.0:1789265212.932204:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417422080 00000100:00100000:1.0:1789265212.932228:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789265212.932234:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+16:6513:x1876180417422080:12345-0@lo:501: 00000100:00100000:2.0:1789265212.932501:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417422208:0@lo:400: 00000100:00100000:2.0:1789265212.932535:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265212.932555:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417422720:0@lo:400: 00000100:00100000:2.0:1789265212.932574:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265212.932589:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180417423232:0@lo:400: 00000100:00100000:3.0:1789265212.932590:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417422336:0@lo:400: 00000100:00100000:2.0:1789265212.932607:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265212.932615:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265212.932625:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789265212.932631:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417422848:0@lo:400: 00000100:00100000:2.0:1789265212.932631:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417422592:0@lo:400: 00000100:00100000:2.0:1789265212.932651:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265212.932669:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417423104:0@lo:400: 00000100:00100000:2.0:1789265212.932689:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265212.932713:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417422208 00000100:00100000:2.0:1789265212.932717:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417422208 00000100:00100000:2.0:1789265212.932743:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417422720 00000100:00100000:2.0:1789265212.932751:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417422720 00000100:00100000:2.0:1789265212.932769:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417423232 00000100:00100000:2.0:1789265212.932772:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417423232 00000100:00100000:2.0:1789265212.932782:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417422592 00000100:00100000:2.0:1789265212.932784:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417422592 00000100:00100000:2.0:1789265212.932811:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789265212.932817:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417422208:12345-0@lo:400: 00000100:00100000:2.0:1789265212.932855:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417422208:12345-0@lo:400: Request processed in 38us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265212.932862:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789265212.932877:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789265212.932883:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417422720:12345-0@lo:400: 00000100:00100000:2.0:1789265212.932906:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417422720:12345-0@lo:400: Request processed in 25us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265212.932912:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789265212.932922:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789265212.932927:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876180417423232:12345-0@lo:400: 00000100:00100000:2.0:1789265212.932951:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876180417423232:12345-0@lo:400: Request processed in 24us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265212.932957:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789265212.932967:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789265212.932972:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417422592:12345-0@lo:400: 00000100:00100000:2.0:1789265212.932994:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417422592:12345-0@lo:400: Request processed in 22us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265212.933000:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789265212.933035:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265212.933052:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417423360:0@lo:400: 00000100:00100000:2.0:1789265212.933081:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265212.933098:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789265212.933105:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417422464:0@lo:400: 00000100:00100000:2.0:1789265212.933126:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265212.933142:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417422976:0@lo:400: 00000100:00100000:2.0:1789265212.933175:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265212.933204:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417423104 00000100:00100000:2.0:1789265212.933208:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417423104 00000100:00100000:2.0:1789265212.933232:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417422976 00000100:00100000:2.0:1789265212.933234:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417422976 00000100:00100000:2.0:1789265212.933250:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265212.933256:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417423104:12345-0@lo:400: 00000100:00100000:2.0:1789265212.933284:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417423104:12345-0@lo:400: Request processed in 29us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265212.933289:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265212.933300:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265212.933305:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417422976:12345-0@lo:400: 00000100:00100000:2.0:1789265212.933331:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417422976:12345-0@lo:400: Request processed in 26us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265212.933350:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789265212.933379:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc837e1180 x1876180417422592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265212.933513:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+16:6513:x1876180417422080:12345-0@lo:501: Request processed in 1278us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265212.933521:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789265212.933554:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417422336 00000100:00100000:1.0:1789265212.933558:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417422336 00000100:00100000:1.0:1789265212.933580:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417422464 00000100:00100000:1.0:1789265212.933583:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417422464 00000100:00100000:1.0:1789265212.933598:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789265212.933604:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417422336:12345-0@lo:400: 00000100:00100000:1.0:1789265212.933636:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417422336:12345-0@lo:400: Request processed in 33us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265212.933642:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789265212.933653:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789265212.933659:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417422464:12345-0@lo:400: 00000100:00100000:1.0:1789265212.933685:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417422464:12345-0@lo:400: Request processed in 26us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265212.933691:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1789265212.933707:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265212.933726:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417422080:0@lo:501: 00000100:00100000:1.0:1789265212.933772:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417423488:0@lo:503: 00000100:00100000:1.0:1789265212.933827:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265212.933849:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83b870c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265212.933863:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417423488 00000100:00100000:1.0:1789265212.933866:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417423488 00000100:00100000:1.0:1789265212.933888:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789265212.933894:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+16:6513:x1876180417423488:12345-0@lo:503: 00000100:00100000:1.0:1789265212.933993:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+16:6513:x1876180417423488:12345-0@lo:503: Request processed in 99us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265212.934000:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789265212.934062:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417423488:0@lo:503: 00000100:00100000:1.0:1789265212.934245:0:9991:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b93800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:9991:1876180417423616:0@lo:502: 00000100:00100000:1.0:1789265212.934276:0:9991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265212.934295:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417423616 00000100:00100000:1.0:1789265212.934298:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417423616 00000100:00100000:1.0:1789265212.934318:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789265212.934324:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+16:9991:x1876180417423616:12345-0@lo:502: 00000100:00100000:0.0:1789265212.934815:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417422848 00000100:00100000:0.0:1789265212.934820:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417422848 00000100:00100000:0.0:1789265212.934853:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417423360 00000100:00100000:0.0:1789265212.934856:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417423360 00000100:00100000:0.0:1789265212.934871:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789265212.934877:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417422848:12345-0@lo:400: 00000100:00100000:2.0:1789265212.935111:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417422592:0@lo:400: 00000100:00100000:0.0:1789265212.935474:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417422848:12345-0@lo:400: Request processed in 596us (2452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265212.935482:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789265212.935499:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789265212.935507:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417423360:12345-0@lo:400: 00000100:00100000:0.0:1789265212.935536:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417423360:12345-0@lo:400: Request processed in 31us (2454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265212.935541:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1789265212.935572:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789265212.935900:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd23ca80 x1876180417423104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265212.935912:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417423104:0@lo:400: 00010000:00080000:2.0:1789265212.935939:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc837e3100 x1876180417422208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265212.935948:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417422208:0@lo:400: 00010000:00080000:2.0:1789265212.935960:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd23ed80 x1876180417422720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265212.935967:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417422720:0@lo:400: 00010000:00080000:2.0:1789265212.935978:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd23e300 x1876180417423232/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265212.935985:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180417423232:0@lo:400: 00000100:00100000:2.0:1789265212.936069:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417422464:0@lo:400: 00010000:00080000:2.0:1789265212.936080:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd23c000 x1876180417422976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265212.936088:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417422976:0@lo:400: 00000100:00100000:2.0:1789265212.936101:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417422336:0@lo:400: 00010000:00080000:2.0:1789265212.936111:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd23dc00 x1876180417422848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265212.936118:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417422848:0@lo:400: 00010000:00080000:2.0:1789265212.936127:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd23e680 x1876180417423360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265212.936135:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417423360:0@lo:400: 00000100:00100000:1.0:1789265212.936914:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+16:9991:x1876180417423616:12345-0@lo:502: Request processed in 2585us (2631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265212.936924:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789265212.936984:0:9991:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83b876c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265212.937003:0:9991:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b93800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:9991:1876180417423616:0@lo:502: 00000100:00100000:1.0:1789265212.937090:0:9991:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b93800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:9991:1876180417423744:0@lo:502: 00000100:00100000:1.0:1789265212.937141:0:9991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265212.937166:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417423744 00000100:00100000:1.0:1789265212.937172:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417423744 00000100:00100000:1.0:1789265212.937205:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789265212.937212:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+16:9991:x1876180417423744:12345-0@lo:502: 00000100:00100000:1.0:1789265212.937311:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+16:9991:x1876180417423744:12345-0@lo:502: Request processed in 98us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265212.937317:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789265212.937364:0:9991:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83b876c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265212.938936:0:9991:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b93800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:9991:1876180417423744:0@lo:502: 00000040:00080000:1.0:1789265212.938989:0:9991:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1789265212.939072:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1789265212.939093:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789265212.939102:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a9652a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96531 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265212.939113:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a9652a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96531 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265212.939122:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789265212.939124:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1789265212.939127:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789265212.939156:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a96538 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265212.939165:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a96538 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265212.939173:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a96538 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265212.939189:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417423872:0@lo:101: 00000100:00100000:1.0:1789265212.939237:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265212.939268:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83b876c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265212.939286:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417423872 00000100:00100000:1.0:1789265212.939291:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417423872 00000100:00100000:1.0:1789265212.939326:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789265212.940491:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+16:6513:x1876180417423872:12345-0@lo:101: 00010000:00010000:1.0:1789265212.940509:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265212.940531:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc81692a00/0x9272d942b4a9653f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96538 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265212.940557:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81692a00/0x9272d942b4a9653f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96538 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265212.940567:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc81692a00/0x9272d942b4a9653f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96538 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265212.940576:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81692a00, rc 0) 00000100:00100000:1.0:1789265212.940630:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417423872:12345-0@lo:101: Request processed in 1296us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265212.940637:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789265212.940696:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417423872:0@lo:101: 00010000:00010000:1.0:1789265212.940720:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a96538 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9653f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265212.940729:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a96538 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9653f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265212.940807:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417424000:0@lo:501: 00000100:00100000:1.0:1789265212.940837:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265212.940862:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83b876c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265212.940876:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417424000 00000100:00100000:1.0:1789265212.940881:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417424000 00000100:00100000:1.0:1789265212.940913:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789265212.940922:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417424000:12345-0@lo:501: 00000100:00100000:1.0:1789265212.942518:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417424000:12345-0@lo:501: Request processed in 1591us (1673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265212.942540:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789265212.942604:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417424000:0@lo:501: 00000100:00100000:1.0:1789265212.942662:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417424128:0@lo:503: 00000100:00100000:1.0:1789265212.942714:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265212.942742:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83b876c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265212.942757:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417424128 00000100:00100000:1.0:1789265212.942761:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417424128 00000100:00100000:1.0:1789265212.942805:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789265212.942814:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417424128:12345-0@lo:503: 00000100:00100000:1.0:1789265212.942912:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417424128:12345-0@lo:503: Request processed in 99us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265212.942919:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789265212.942956:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417424128:0@lo:503: 00000100:00100000:0.0:1789265212.943961:0:9992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d27100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:9992:1876180417424256:0@lo:502: 00000100:00100000:0.0:1789265212.944013:0:9992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265212.944073:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417424256 00000100:00100000:0.0:1789265212.944079:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417424256 00000100:00100000:0.0:1789265212.944112:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789265212.944119:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+17:9992:x1876180417424256:12345-0@lo:502: 00000100:00100000:0.0:1789265212.944210:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+17:9992:x1876180417424256:12345-0@lo:502: Request processed in 90us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265212.944216:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789265212.944258:0:9992:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada139c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265212.944273:0:9992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d27100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:9992:1876180417424256:0@lo:502: 00000020:01000000:0.0:1789265212.944298:0:9992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265212.944307:0:9992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265212.944309:0:9992:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789265212.944314:0:9992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789265212.944316:0:9992:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789265212.944329:0:9992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d27100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:9992:1876180417424384:0@lo:502: 00000100:00100000:0.0:1789265212.944376:0:9992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265212.944409:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417424384 00000100:00100000:0.0:1789265212.944413:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417424384 00000100:00100000:0.0:1789265212.944436:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789265212.944443:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+17:9992:x1876180417424384:12345-0@lo:502: 00000100:00100000:0.0:1789265212.944501:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+17:9992:x1876180417424384:12345-0@lo:502: Request processed in 57us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265212.944508:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789265212.944539:0:9992:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc913b7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265212.944551:0:9992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d27100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:9992:1876180417424384:0@lo:502: 00000020:01000000:0.0:1789265212.944568:0:9992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265212.944572:0:9992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265212.944573:0:9992:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789265212.944582:0:9992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789265212.944637:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789265212.944658:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789265212.944669:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a96538 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9653f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265212.944680:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a96538 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9653f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265212.944689:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789265212.944692:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fccad90a000 from 39 10000000:01000000:0.0:1789265212.944695:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789265212.944718:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96546 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265212.944726:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96546 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265212.944735:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96546 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265212.944747:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d27100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417424512:0@lo:101: 00000100:00100000:0.0:1789265212.944773:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265212.944787:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc913b7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265212.944818:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417424512 00000100:00100000:0.0:1789265212.944822:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417424512 00000100:00100000:0.0:1789265212.944843:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789265212.944850:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417424512:12345-0@lo:101: 00010000:00010000:0.0:1789265212.944858:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265212.944869:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc882b6600/0x9272d942b4a9654d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96546 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265212.944897:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc882b6600/0x9272d942b4a9654d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96546 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265212.944907:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc882b6600/0x9272d942b4a9654d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96546 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265212.944915:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6600, rc 0) 00000100:00100000:0.0:1789265212.944944:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+18:6513:x1876180417424512:12345-0@lo:101: Request processed in 94us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265212.944949:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789265212.944979:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d27100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417424512:0@lo:101: 00010000:00010000:0.0:1789265212.944990:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96546 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9654d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265212.944999:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96546 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9654d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265212.945051:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d27100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417424640:0@lo:501: 00000100:00100000:0.0:1789265212.945074:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265212.945087:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc913b7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265212.945098:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417424640 00000100:00100000:0.0:1789265212.945101:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417424640 00000100:00100000:0.0:1789265212.945121:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789265212.945127:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+18:6513:x1876180417424640:12345-0@lo:501: 00000100:00100000:0.0:1789265212.945220:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+18:6513:x1876180417424640:12345-0@lo:501: Request processed in 93us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265212.945227:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789265212.945265:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d27100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417424640:0@lo:501: 00000100:00100000:0.0:1789265212.945289:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d27100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417424768:0@lo:503: 00000100:00100000:0.0:1789265212.945323:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265212.945336:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc913b7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265212.945348:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417424768 00000100:00100000:0.0:1789265212.945351:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417424768 00000100:00100000:0.0:1789265212.945371:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789265212.945376:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+18:6513:x1876180417424768:12345-0@lo:503: 00000100:00100000:0.0:1789265212.945445:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+18:6513:x1876180417424768:12345-0@lo:503: Request processed in 68us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265212.945452:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789265212.945486:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d27100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417424768:0@lo:503: 00000100:00100000:0.0:1789265212.951642:0:9993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d27100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:9993:1876180417424896:0@lo:502: 00000100:00100000:0.0:1789265212.951722:0:9993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265212.951767:0:9993:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc913b7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265212.951955:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417424896 00000100:00100000:1.0:1789265212.951962:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417424896 00000100:00100000:1.0:1789265212.952009:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789265212.952017:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+18:9993:x1876180417424896:12345-0@lo:502: 00000100:00100000:1.0:1789265212.952180:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+18:9993:x1876180417424896:12345-0@lo:502: Request processed in 163us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265212.952188:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789265212.952462:0:9993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d27100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:9993:1876180417424896:0@lo:502: 00000100:00100000:0.0:1789265212.952522:0:9993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d27100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:9993:1876180417425024:0@lo:502: 00000100:00100000:0.0:1789265212.952561:0:9993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265212.952628:0:9993:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd0c09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265212.955170:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417425024 00000100:00100000:1.0:1789265212.955183:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417425024 00000100:00100000:0.0:1789265212.957692:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789265212.957705:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+18:9993:x1876180417425024:12345-0@lo:502: 00000100:00100000:0.0:1789265212.957902:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+18:9993:x1876180417425024:12345-0@lo:502: Request processed in 199us (5340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265212.957911:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789265212.958004:0:9993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d27100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:9993:1876180417425024:0@lo:502: 00000040:00080000:1.0:1789265212.958063:0:9993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1789265212.958159:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1789265212.958182:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789265212.958192:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96546 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9654d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265212.958203:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9654d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265212.958213:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789265212.958216:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fccad90a000 from 6 10000000:01000000:3.0:1789265212.958225:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789265212.958258:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81490600/0x9272d942b4a96554 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265212.958266:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc81490600/0x9272d942b4a96554 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265212.958276:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc81490600/0x9272d942b4a96554 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265212.958295:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417425152:0@lo:101: 00000100:00100000:3.0:1789265212.958331:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265212.958366:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0d456c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265212.958485:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417425152 00000100:00100000:1.0:1789265212.958497:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417425152 00000100:00100000:1.0:1789265212.958535:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789265212.958543:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+18:6513:x1876180417425152:12345-0@lo:101: 00010000:00010000:1.0:1789265212.958552:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265212.958564:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc81693000/0x9272d942b4a9655b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96554 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265212.958584:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81693000/0x9272d942b4a9655b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96554 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265212.958593:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc81693000/0x9272d942b4a9655b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96554 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265212.958602:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81693000, rc 0) 00000100:00100000:1.0:1789265212.958643:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+19:6513:x1876180417425152:12345-0@lo:101: Request processed in 102us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265212.958649:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789265212.958972:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417425152:0@lo:101: 00010000:00010000:3.0:1789265212.958984:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc81490600/0x9272d942b4a96554 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9655b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265212.958994:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc81490600/0x9272d942b4a96554 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9655b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265212.959855:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417425280:0@lo:256: 00000100:00100000:0.0:1789265212.960003:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265212.960106:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265212.960323:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417425280 00000100:00100000:2.0:1789265212.960330:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417425280 00000100:00100000:2.0:1789265212.960486:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789265212.960495:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+19:6513:x1876180417425280:12345-0@lo:256: 20000000:01000000:2.0:1789265212.960511:0:7458:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789265212.960526:0:7458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789265212.960528:0:7458:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789265212.960706:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+19:6513:x1876180417425280:12345-0@lo:256: Request processed in 211us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265212.960714:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789265212.960775:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417425280:0@lo:256: 10000000:01000000:1.0:1789265212.960836:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789265212.960845:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81490600/0x9272d942b4a96554 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9655b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265212.960854:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc81490600/0x9272d942b4a96554 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9655b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265212.960862:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789265212.960865:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1789265212.960868:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789265212.960902:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a96562 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265212.960915:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a96562 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265212.960925:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a96562 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265212.960940:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417425408:0@lo:101: 00000100:00100000:1.0:1789265212.960969:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265212.961361:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83b87b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265212.961453:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417425408 00000100:00100000:0.0:1789265212.961459:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417425408 00000100:00100000:0.0:1789265212.961501:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789265212.961510:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+19:6513:x1876180417425408:12345-0@lo:101: 00010000:00010000:0.0:1789265212.961520:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265212.961532:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc882b6a00/0x9272d942b4a96569 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96562 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265212.961552:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc882b6a00/0x9272d942b4a96569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96562 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265212.961562:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc882b6a00/0x9272d942b4a96569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96562 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265212.961570:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6a00, rc 0) 00000100:00100000:0.0:1789265212.961605:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+20:6513:x1876180417425408:12345-0@lo:101: Request processed in 97us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265212.961610:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789265212.961643:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417425408:0@lo:101: 00010000:00010000:0.0:1789265212.961669:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a96562 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96569 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265212.961678:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a96562 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96569 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265212.961743:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d26d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417425536:0@lo:501: 00000100:00100000:0.0:1789265212.961783:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265212.961808:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265212.961820:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417425536 00000100:00100000:0.0:1789265212.961824:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417425536 00000100:00100000:0.0:1789265212.961841:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789265212.961847:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+20:6513:x1876180417425536:12345-0@lo:501: 00000100:00100000:0.0:1789265212.962190:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+20:6513:x1876180417425536:12345-0@lo:501: Request processed in 342us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265212.962197:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789265212.962450:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d26d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417425536:0@lo:501: 00000100:00100000:1.0:1789265212.962482:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b92680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417425664:0@lo:503: 00000100:00100000:1.0:1789265212.962525:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265212.962597:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83b87b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265212.962648:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417425664 00000100:00100000:3.0:1789265212.962653:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417425664 00000100:00100000:0.0:1789265212.962696:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789265212.962705:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+20:6513:x1876180417425664:12345-0@lo:503: 00000100:00100000:0.0:1789265212.962807:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+20:6513:x1876180417425664:12345-0@lo:503: Request processed in 103us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265212.962814:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789265212.962947:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b92680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417425664:0@lo:503: 00000100:00100000:1.0:1789265212.963470:0:9994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b92680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:9994:1876180417425792:0@lo:502: 00000100:00100000:1.0:1789265212.963511:0:9994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265212.963543:0:9994:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83b87480 going to sleep for 11 seconds 00000100:00100000:0.0:1789265212.963586:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417425792 00000100:00100000:0.0:1789265212.963591:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417425792 00000100:00100000:0.0:1789265212.963627:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789265212.963636:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+20:9994:x1876180417425792:12345-0@lo:502: 00000100:00100000:0.0:1789265212.963801:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+20:9994:x1876180417425792:12345-0@lo:502: Request processed in 156us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265212.963809:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789265212.964199:0:9994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b92680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:9994:1876180417425792:0@lo:502: 00000020:01000000:0.0:1789265212.964288:0:9994:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789265212.964296:0:9994:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789265212.964303:0:9994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265212.964306:0:9994:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789265212.964312:0:9994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789265212.964316:0:9994:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.149@tcp to nid 0x20000c0a8cb95 (192.168.203.149@tcp) 00000020:01000000:0.0:1789265212.964418:0:9994:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789265212.964421:0:9994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789265212.964437:0:9994:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9fccbf45cd28) 00000020:00000080:0.0:1789265212.964466:0:9994:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1789265212.964472:0:9994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789265212.964572:0:9994:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1789265212.964579:0:9994:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789265212.964587:0:9994:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9272d942b4a96577 00010000:00080000:0.0:1789265212.964616:0:9994:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fccbf422800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.149@tcp at head 00010000:00010000:0.0:1789265212.969984:0:9994:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1789265212.970304:0:9994:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789265212.970319:0:9994:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789265212.970570:0:9994:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265212.970686:0:9994:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265212.970853:0:9994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789265212.971172:0:9994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789265212.975523:0:9996:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789265212.975532:0:9996:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789265212.981492:0:9994:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789265212.981509:0:9994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789265212.981557:0:9994:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789265212.981586:0:9994:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9272d942b4a9657e 00000100:00080000:1.0:1789265212.981597:0:9994:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789265212.981603:0:9994:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fccbf422800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:1.0:1789265212.981646:0:9994:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83b92680 x1876180417425920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265212.981695:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417425920:0@lo:8: 00000100:00100000:1.0:1789265212.981769:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789265212.981837:0:9994:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789265212.981901:0:9994:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265212.981905:0:9994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265212.981908:0:9994:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789265212.981912:0:9994:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265212.981915:0:9994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265212.981917:0:9994:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789265212.981919:0:9994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789265212.981921:0:9994:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789265212.981945:0:9994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:9994:1876180417426048:0@lo:502: 00000100:00100000:1.0:1789265212.981989:0:9994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265212.982004:0:9994:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83b87600 going to sleep for 11 seconds 00000100:00100000:2.0:1789265212.982215:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417425920 00000100:00100000:2.0:1789265212.982222:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417425920 00000100:00100000:2.0:1789265212.982265:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789265212.982273:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1876180417425920:12345-0@lo:8: 00010000:00080000:2.0:1789265212.982298:0:8914:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:2.0:1789265212.982324:0:8914:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9272d942b4a96585 00002000:00100000:2.0:1789265212.982397:0:8914:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9fcb83931000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1789265212.982402:0:8914:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1789265212.982406:0:8914:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789265212.982466:0:8914:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789265212.982683:0:8914:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1789265212.982707:0:8914:0:(import.c:65:import_set_state_nolock()) ffff9fcb83930800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265212.982766:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3640:x1876180417425920:12345-0@lo:8: Request processed in 492us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265212.982773:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789265212.982823:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417426048 00000100:00100000:2.0:1789265212.982828:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417426048 00000100:00100000:2.0:1789265212.982863:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789265212.982870:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+20:9994:x1876180417426048:12345-0@lo:502: 00000100:00100000:2.0:1789265212.983224:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+20:9994:x1876180417426048:12345-0@lo:502: Request processed in 354us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265212.983231:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00010000:00080000:2.0:1789265212.983287:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83b92680 x1876180417425920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265212.983297:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789265212.983304:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789265212.983310:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789265212.983315:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789265212.983317:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccbf422800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789265212.983328:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789265212.983332:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417425920:0@lo:8: 00000004:00080000:3.0:1789265212.983430:0:9996:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789265212.983487:0:9996:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 264213463335ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789265212.983494:0:9996:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1789265212.985174:0:7448:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1789265212.985312:0:9994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:9994:1876180417426048:0@lo:502: 00000020:01000000:1.0:1789265212.986275:0:9994:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265212.986288:0:9994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265212.986291:0:9994:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789265212.986296:0:9994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:1.0:1789265212.986507:0:9997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b90000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9997:1876180417426176:0@lo:700: 00000100:00100000:1.0:1789265212.986570:0:9997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265212.986608:0:9997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcca9792600 going to sleep for 11 seconds 00000100:00100000:3.0:1789265212.986747:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417426176 00000100:00100000:3.0:1789265212.986755:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417426176 00000100:00100000:3.0:1789265212.986836:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265212.986844:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9997:x1876180417426176:12345-0@lo:700: 00000100:00100000:3.0:1789265212.986876:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8442:1876180417426304:0@lo:700: 00000100:00100000:3.0:1789265212.986916:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265212.986931:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0d45540 going to sleep for 11 seconds 00000100:00100000:2.0:1789265212.986990:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417426304 00000100:00100000:2.0:1789265212.986995:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417426304 00000100:00100000:2.0:1789265212.987041:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265212.987048:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8442:x1876180417426304:12345-0@lo:700: 00000100:00080000:1.0:1789265212.987449:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:01000000:0.0:1789265212.988582:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1789265212.988619:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789265212.988631:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a96562 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96569 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265212.988645:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a96562 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96569 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265212.988656:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789265212.988658:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fcc8a583000 from 39 10000000:01000000:0.0:1789265212.988661:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789265212.988694:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a9658c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265212.988703:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a9658c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265212.988725:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a9658c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265212.988748:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417426432:0@lo:101: 00000100:00100000:0.0:1789265212.988821:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265212.988860:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265212.989310:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417426432 00000100:00100000:1.0:1789265212.989317:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417426432 00000100:00100000:1.0:1789265212.989441:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789265212.989450:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+20:6513:x1876180417426432:12345-0@lo:101: 00010000:00010000:1.0:1789265212.989461:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265212.989493:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccbd2ff400/0x9272d942b4a96593 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9658c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265212.989519:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2ff400/0x9272d942b4a96593 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9658c expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265212.989530:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccbd2ff400/0x9272d942b4a96593 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9658c expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265212.989539:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2ff400, rc 0) 00000100:00100000:1.0:1789265212.989586:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417426432:12345-0@lo:101: Request processed in 137us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265212.989593:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789265212.990195:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417426432:0@lo:101: 00010000:00010000:0.0:1789265212.990213:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a9658c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96593 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265212.990224:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a9658c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96593 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265212.990422:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417426560:0@lo:501: 00000100:00100000:0.0:1789265212.990460:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265212.990502:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265212.991510:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417426560 00000100:00100000:3.0:1789265212.991521:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417426560 00000100:00100000:3.0:1789265212.991563:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789265212.991571:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417426560:12345-0@lo:501: 00000100:00100000:3.0:1789265212.991713:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417426560:12345-0@lo:501: Request processed in 142us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265212.991766:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789265212.992212:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417426560:0@lo:501: 00000100:00100000:0.0:1789265212.992256:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417426688:0@lo:503: 00000100:00100000:0.0:1789265212.992308:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265212.992466:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265212.992481:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417426688 00000100:00100000:0.0:1789265212.992486:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417426688 00000100:00100000:0.0:1789265212.992821:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789265212.992832:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417426688:12345-0@lo:503: 00000100:00100000:0.0:1789265212.992949:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417426688:12345-0@lo:503: Request processed in 119us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265212.992961:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 40000000:02000000:3.0:1789265212.997454:0:6523:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:1.0:1789265213.002544:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417426688:0@lo:503: 00000100:00100000:0.0:1789265213.009371:0:9998:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d24000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:9998:1876180417426816:0@lo:502: 00000100:00100000:0.0:1789265213.009462:0:9998:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265213.009503:0:9998:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7f480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265213.009849:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417426816 00000100:00100000:3.0:1789265213.009856:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417426816 00000100:00100000:3.0:1789265213.009950:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789265213.009960:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+21:9998:x1876180417426816:12345-0@lo:502: 00000100:00100000:3.0:1789265213.011624:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+21:9998:x1876180417426816:12345-0@lo:502: Request processed in 1659us (2155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265213.011636:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789265213.011725:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8442:x1876180417426304:12345-0@lo:700: Request processed in 24676us (24805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265213.011734:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789265213.011778:0:8442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd23c380 x1876180417426304/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789265228 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265213.012176:0:9998:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d24000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:9998:1876180417426816:0@lo:502: 00000100:00100000:0.0:1789265213.012315:0:9998:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d24000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:9998:1876180417426944:0@lo:502: 00000100:00100000:0.0:1789265213.012377:0:9998:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265213.012412:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417426944 00000100:00100000:0.0:1789265213.012418:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417426944 00000100:00100000:0.0:1789265213.012458:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789265213.012467:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+21:9998:x1876180417426944:12345-0@lo:502: 00000100:00100000:0.0:1789265213.012567:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+21:9998:x1876180417426944:12345-0@lo:502: Request processed in 100us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265213.012573:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789265213.012617:0:9998:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b753c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265213.012628:0:9998:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d24000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:9998:1876180417426944:0@lo:502: 00000040:00080000:0.0:1789265213.012645:0:9998:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1789265213.012739:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1789265213.012760:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789265213.012770:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a9658c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96593 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265213.012781:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a9658c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96593 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265213.012790:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789265213.012812:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fcc8a583000 from 6 10000000:01000000:0.0:1789265213.012815:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789265213.012839:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a9659a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265213.012846:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a9659a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265213.012854:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a9659a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265213.012865:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417427072:0@lo:101: 00000100:00100000:0.0:1789265213.013433:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265213.013459:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b753c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265213.013980:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8442:1876180417426304:0@lo:700: 40000000:02000000:3.0:1789265213.014000:0:8442:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:3.0:1789265213.030698:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417427072 00000100:00100000:3.0:1789265213.030714:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417427072 00000100:00100000:3.0:1789265213.030763:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789265213.030772:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417427072:12345-0@lo:101: 00010000:00010000:3.0:1789265213.030790:0:7458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265213.030819:0:7458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc81490e00/0x9272d942b4a965a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9659a expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265213.030848:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81490e00/0x9272d942b4a965a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9659a expref: 22 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265213.030860:0:7458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc81490e00/0x9272d942b4a965a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9659a expref: 22 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265213.030869:0:7458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81490e00, rc 0) 00000100:00100000:3.0:1789265213.030951:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417427072:12345-0@lo:101: Request processed in 180us (17518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265213.030957:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789265213.031355:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417427072:0@lo:101: 00010000:00010000:0.0:1789265213.031376:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a9659a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a965a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265213.031387:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a9659a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a965a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265213.031451:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417427200:0@lo:256: 00000100:00100000:0.0:1789265213.031489:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265213.031526:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b753c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265213.031877:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417427200 00000100:00100000:1.0:1789265213.031884:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417427200 00000100:00100000:1.0:1789265213.031925:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789265213.031933:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417427200:12345-0@lo:256: 20000000:01000000:1.0:1789265213.031949:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789265213.031966:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789265213.031969:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1789265213.032084:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417427200:12345-0@lo:256: Request processed in 151us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265213.032092:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789265213.032379:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417427200:0@lo:256: 10000000:01000000:0.0:1789265213.032429:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789265213.032437:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a9659a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a965a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265213.032457:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a9659a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a965a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265213.032466:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789265213.032468:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1789265213.032471:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789265213.032494:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6e00/0x9272d942b4a965a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265213.032501:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6e00/0x9272d942b4a965a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265213.032510:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6e00/0x9272d942b4a965a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265213.032522:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417427328:0@lo:101: 00000100:00100000:0.0:1789265213.032548:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265213.032567:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b753c0 going to sleep for 11 seconds 00000001:00100000:1.0:1789265213.033555:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789265213.033683:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9997:x1876180417426176:12345-0@lo:700: Request processed in 46837us (47110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265213.033697:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789265213.033767:0:9997:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83b90000 x1876180417426176/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789265228 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265213.033782:0:9997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b90000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9997:1876180417426176:0@lo:700: 00000100:00100000:3.0:1789265213.036608:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417427328 00000100:00100000:3.0:1789265213.036624:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417427328 00000100:00100000:3.0:1789265213.036685:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789265213.036695:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417427328:12345-0@lo:101: 00010000:00010000:3.0:1789265213.036710:0:7458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265213.036729:0:7458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc81490400/0x9272d942b4a965af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a965a8 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265213.036757:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81490400/0x9272d942b4a965af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a965a8 expref: 23 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265213.036780:0:7458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc81490400/0x9272d942b4a965af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a965a8 expref: 23 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265213.036789:0:7458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81490400, rc 0) 00000100:00100000:3.0:1789265213.036867:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417427328:12345-0@lo:101: Request processed in 174us (4317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265213.036873:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789265213.038143:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417427328:0@lo:101: 00010000:00010000:1.0:1789265213.038165:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6e00/0x9272d942b4a965a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a965af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265213.038177:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6e00/0x9272d942b4a965a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a965af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265213.038253:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417427456:0@lo:501: 00000100:00100000:1.0:1789265213.038299:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265213.038341:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcca9792600 going to sleep for 11 seconds 00000100:00100000:2.0:1789265213.038603:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417427456 00000100:00100000:2.0:1789265213.038609:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417427456 00000100:00100000:2.0:1789265213.038647:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789265213.038654:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417427456:12345-0@lo:501: 00000100:00100000:2.0:1789265213.038764:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417427456:12345-0@lo:501: Request processed in 110us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265213.038771:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789265213.038956:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417427456:0@lo:501: 00000100:00100000:3.0:1789265213.038990:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417427584:0@lo:503: 00000100:00100000:3.0:1789265213.039057:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265213.039079:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc9977b000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265213.039131:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417427584 00000100:00100000:2.0:1789265213.039135:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417427584 00000100:00100000:2.0:1789265213.039157:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789265213.039162:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417427584:12345-0@lo:503: 00000100:00100000:2.0:1789265213.039229:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417427584:12345-0@lo:503: Request processed in 66us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265213.039235:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789265213.039613:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417427584:0@lo:503: 00000100:00100000:3.0:1789265213.040481:0:9999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:9999:1876180417427712:0@lo:502: 00000100:00100000:3.0:1789265213.040528:0:9999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265213.040558:0:9999:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc9977b600 going to sleep for 11 seconds 00000100:00100000:2.0:1789265213.040639:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417427712 00000100:00100000:2.0:1789265213.040644:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417427712 00000100:00100000:2.0:1789265213.040678:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789265213.040685:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+23:9999:x1876180417427712:12345-0@lo:502: 00000100:00100000:2.0:1789265213.040776:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+23:9999:x1876180417427712:12345-0@lo:502: Request processed in 91us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265213.040783:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789265213.041010:0:9999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:9999:1876180417427712:0@lo:502: 00000020:01000000:3.0:1789265213.041058:0:9999:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789265213.041065:0:9999:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789265213.041071:0:9999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265213.041073:0:9999:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789265213.041077:0:9999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789265213.041081:0:9999:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.149@tcp to nid 0x20000c0a8cb95 (192.168.203.149@tcp) 00000020:01000000:3.0:1789265213.041101:0:9999:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789265213.041104:0:9999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265213.041117:0:9999:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9fccbd378000) 00000020:00000080:3.0:1789265213.041141:0:9999:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1789265213.041146:0:9999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789265213.041219:0:9999:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789265213.041224:0:9999:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789265213.041230:0:9999:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9272d942b4a965bd 00010000:00080000:3.0:1789265213.041255:0:9999:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fccae77a000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.149@tcp at head 00010000:00010000:3.0:1789265213.041469:0:9999:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1789265213.041580:0:9999:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789265213.041590:0:9999:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789265213.041731:0:9999:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265213.041840:0:9999:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1789265213.042486:0:9997:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789265213.042513:0:9997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c11880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9997:1876180417427968:0@lo:7: 00000100:00100000:2.0:1789265213.042572:0:9997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265213.042601:0:9997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83bedf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265213.042645:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265213.042660:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417427840:0@lo:13: 00000100:00100000:0.0:1789265213.042696:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265213.042733:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417427968 00000100:00100000:0.0:1789265213.042740:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417427968 00000100:00100000:0.0:1789265213.042784:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265213.042800:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9997:x1876180417427968:12345-0@lo:7: 00000100:00100000:2.0:1789265213.045069:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417427840 00000100:00100000:2.0:1789265213.045082:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417427840 00000100:00100000:2.0:1789265213.045131:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789265213.045140:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1876180417427840:12345-0@lo:13: 00002000:00000024:2.0:1789265213.045171:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923881984 avail 3692359680 00000100:00100000:2.0:1789265213.045242:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1876180417427840:12345-0@lo:13: Request processed in 104us (2545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265213.045249:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1789265213.046001:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccb5c11f80 x1876180417427840/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265213.046049:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417427840:0@lo:13: 00000040:00080000:3.0:1789265213.047431:0:9999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789265213.047534:0:9999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00002000:00080000:0.0:1789265213.050501:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00000040:00080000:1.0:1789265213.050503:0:10000:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265213.050508:0:10000:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00002000:00080000:0.0:1789265213.050509:0:8433:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789265213.050613:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9997:x1876180417427968:12345-0@lo:7: Request processed in 7818us (8036us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265213.050625:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789265213.050731:0:9997:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccb5c11880 x1876180417427968/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789265229 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265213.050747:0:9997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c11880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9997:1876180417427968:0@lo:7: 00000004:00080000:1.0:1789265213.050762:0:9997:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789265213.050814:0:9997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b93b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9997:1876180417428096:0@lo:5: 00000100:00100000:1.0:1789265213.050849:0:9997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265213.050881:0:9997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265213.051152:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417428096 00000100:00100000:0.0:1789265213.051160:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417428096 00000100:00100000:0.0:1789265213.051193:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265213.051202:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9997:x1876180417428096:12345-0@lo:5: 00002000:00080000:0.0:1789265213.051231:0:8914:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1789265213.051274:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9997:x1876180417428096:12345-0@lo:5: Request processed in 73us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265213.051281:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789265213.051434:0:9997:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83b93b80 x1876180417428096/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265229 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265213.051446:0:9997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b93b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9997:1876180417428096:0@lo:5: 00000004:00080000:2.0:1789265213.051455:0:9997:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789265213.051497:0:9997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c11180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9997:1876180417428224:0@lo:5: 00000100:00100000:2.0:1789265213.051522:0:9997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265213.051546:0:9997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83bedcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265213.052606:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417428224 00000100:00100000:1.0:1789265213.052615:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417428224 00000100:00100000:1.0:1789265213.052652:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265213.052660:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9997:x1876180417428224:12345-0@lo:5: 00002000:00080000:1.0:1789265213.052708:0:8433:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:1.0:1789265213.057247:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9997:x1876180417428224:12345-0@lo:5: Request processed in 4582us (5718us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789265213.057260:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789265213.057458:0:9997:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccb5c11180 x1876180417428224/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265229 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265213.057480:0:9997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c11180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9997:1876180417428224:0@lo:5: 00000004:00080000:3.0:1789265213.057495:0:9997:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789265213.057536:0:9997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9997:1876180417428352:0@lo:900: 00000100:00100000:3.0:1789265213.057573:0:9997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265213.057636:0:9997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc9977bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265213.057750:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417428352 00000100:00100000:1.0:1789265213.057757:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417428352 00000020:00000080:0.0:1789265213.057800:0:9999:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789265213.057814:0:9999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000100:00100000:1.0:1789265213.057838:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265213.057847:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9997:x1876180417428352:12345-0@lo:900: 00000004:01000000:0.0:1789265213.057854:0:9999:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789265213.057879:0:9999:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9272d942b4a965c4 00000100:00080000:0.0:1789265213.057887:0:9999:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789265213.057892:0:9999:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fccae77a000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:1.0:1789265213.057895:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9997:x1876180417428352:12345-0@lo:900: Request processed in 50us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265213.057901:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789265213.057911:0:9999:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83d26300 x1876180417428480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00080000:1.0:1789265213.057969:0:9997:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd23c380 x1876180417428352/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789265229 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265213.057980:0:9997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9997:1876180417428352:0@lo:900: 00000100:00080000:0.0:1789265213.058420:0:9999:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789265213.058491:0:9999:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:1.0:1789265213.058493:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417428480:0@lo:8: 00000020:00000080:0.0:1789265213.058496:0:9999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265213.058498:0:9999:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789265213.058501:0:9999:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265213.058505:0:9999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265213.058506:0:9999:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789265213.058510:0:9999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789265213.058517:0:9999:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789265213.058539:0:9999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d26680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:9999:1876180417428608:0@lo:502: 00000100:00100000:1.0:1789265213.058541:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265213.058583:0:9999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265213.058589:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417428480 00000100:00100000:1.0:1789265213.058593:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417428480 00000100:00100000:0.0:1789265213.058598:0:9999:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b75e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265213.058615:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265213.058617:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417428608 00000100:00100000:0.0:1789265213.058619:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417428608 00000100:00100000:1.0:1789265213.058620:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1876180417428480:12345-0@lo:8: 00010000:00080000:1.0:1789265213.058643:0:8914:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 264 last 0 00000100:00100000:0.0:1789265213.058644:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789265213.058650:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+23:9999:x1876180417428608:12345-0@lo:502: 00000020:00000080:1.0:1789265213.058694:0:8914:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9272d942b4a965cb 00002000:00100000:1.0:1789265213.058713:0:8914:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9fcb8391e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789265213.058717:0:8914:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789265213.058720:0:8914:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1789265213.058763:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+23:9999:x1876180417428608:12345-0@lo:502: Request processed in 112us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265213.058770:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00002000:00080000:1.0:1789265213.058813:0:8914:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:0.0:1789265213.058825:0:9999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d26680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:9999:1876180417428608:0@lo:502: 00000100:00080000:1.0:1789265213.058836:0:8914:0:(import.c:65:import_set_state_nolock()) ffff9fcb8391a800 : changing import state from RECOVER to FULL 00000020:01000000:0.0:1789265213.058844:0:9999:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265213.058848:0:9999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265213.058849:0:9999:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789265213.058853:0:9999:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00100000:1.0:1789265213.058870:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3640:x1876180417428480:12345-0@lo:8: Request processed in 249us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265213.058876:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000020:01000000:1.0:1789265213.058898:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:1.0:1789265213.058918:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789265213.058928:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6e00/0x9272d942b4a965a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a965af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265213.058938:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6e00/0x9272d942b4a965a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a965af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265213.058947:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789265213.058949:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fcc83f119b8 from 1 10000000:01000000:1.0:1789265213.058952:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789265213.058974:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffe00/0x9272d942b4a965d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265213.058982:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffe00/0x9272d942b4a965d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265213.058991:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffe00/0x9272d942b4a965d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265213.059003:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417428736:0@lo:101: 00000100:00100000:1.0:1789265213.059760:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265213.059802:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc913b7e40 going to sleep for 11 seconds 00010000:00080000:0.0:1789265213.059813:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83d26300 x1876180417428480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265213.059818:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417428736 00000100:00100000:1.0:1789265213.059823:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417428736 00000100:00100000:0.0:1789265213.059824:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789265213.059831:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789265213.059837:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789265213.059841:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789265213.059844:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccae77a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789265213.059854:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789265213.059859:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789265213.059859:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417428480:0@lo:8: 00000100:00100000:1.0:1789265213.059866:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417428736:12345-0@lo:101: 00010000:00010000:1.0:1789265213.059876:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265213.059889:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccbd2fe200/0x9272d942b4a965d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a965d2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265213.059911:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2fe200/0x9272d942b4a965d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a965d2 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265213.059921:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccbd2fe200/0x9272d942b4a965d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a965d2 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265213.059929:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fe200, rc 0) 00000100:00100000:1.0:1789265213.059958:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+24:6513:x1876180417428736:12345-0@lo:101: Request processed in 93us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265213.059964:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789265213.059997:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417428736:0@lo:101: 00010000:00010000:1.0:1789265213.060010:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffe00/0x9272d942b4a965d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a965d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265213.060018:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffe00/0x9272d942b4a965d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a965d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265213.060536:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417428864:0@lo:501: 00000100:00100000:1.0:1789265213.060566:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265213.060589:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc913b7e40 going to sleep for 11 seconds 00000004:00080000:1.0:1789265213.060605:0:10000:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1789265213.062704:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417428864 00000100:00100000:0.0:1789265213.062719:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417428864 00000100:00100000:0.0:1789265213.062776:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789265213.062802:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+24:6513:x1876180417428864:12345-0@lo:501: 00000100:00100000:0.0:1789265213.062938:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+24:6513:x1876180417428864:12345-0@lo:501: Request processed in 148us (2371us total) trans 0 rc -2/-2 00000004:00080000:1.0:1789265213.062940:0:10000:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 264292916487ns, next at 0ns, rc = 0 00000100:00100000:0.0:1789265213.062946:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00080000:00080000:1.0:1789265213.062948:0:10000:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1789265213.065078:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417428864:0@lo:501: 10000000:01000000:0.0:1789265213.065135:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789265213.065145:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffe00/0x9272d942b4a965d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a965d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265213.065155:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffe00/0x9272d942b4a965d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a965d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789265213.067177:0:10002:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789265213.067206:0:10002:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d26680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10002:1876180417429120:0@lo:7: 00000100:00100000:0.0:1789265213.067268:0:10002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265213.067296:0:10002:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b75d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265213.067309:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265213.067319:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417428992:0@lo:13: 00000100:00100000:0.0:1789265213.067354:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265213.067381:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417428992 00000100:00100000:0.0:1789265213.067388:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417428992 00000100:00100000:0.0:1789265213.067442:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789265213.067451:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180417428992:12345-0@lo:13: 00002000:00000024:0.0:1789265213.067471:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:0.0:1789265213.067520:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180417428992:12345-0@lo:13: Request processed in 70us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265213.067528:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1789265213.067553:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265213.067568:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417429120 00000100:00100000:0.0:1789265213.067571:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417429120 00000100:00100000:0.0:1789265213.067602:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789265213.067609:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10002:x1876180417429120:12345-0@lo:7: 00010000:00080000:2.0:1789265213.067764:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83d26300 x1876180417428992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265213.067782:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417428992:0@lo:13: 00002000:00080000:1.0:1789265213.072085:0:8434:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1789265213.072095:0:8434:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789265213.072183:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10002:x1876180417429120:12345-0@lo:7: Request processed in 4570us (4910us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265213.072194:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1789265213.072733:0:10002:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83d26680 x1876180417429120/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789265229 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265213.072749:0:10002:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d26680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10002:1876180417429120:0@lo:7: 00000004:00080000:0.0:1789265213.072763:0:10002:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789265213.072810:0:10002:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d26680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10002:1876180417429248:0@lo:5: 00000100:00100000:0.0:1789265213.072851:0:10002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265213.072884:0:10002:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b75d80 going to sleep for 11 seconds 00000004:00080000:0.0:1789265213.077153:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1789265213.077757:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417429248 00000100:00100000:1.0:1789265213.077768:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417429248 00000100:00100000:1.0:1789265213.077861:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789265213.077872:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:10002:x1876180417429248:12345-0@lo:5: 00002000:00080000:1.0:1789265213.077904:0:8914:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789265213.077908:0:8914:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1789265213.082326:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00100000:3.0:1789265213.082357:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789265213.082362:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1789265213.082941:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:10002:x1876180417429248:12345-0@lo:5: Request processed in 5067us (10085us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789265213.082953:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789265213.083081:0:10002:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83d26680 x1876180417429248/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265229 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265213.083093:0:10002:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789265213.083099:0:10002:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d26680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10002:1876180417429248:0@lo:5: 00000004:00080000:3.0:1789265213.083113:0:10002:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789265213.083172:0:10002:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10002:1876180417429376:0@lo:700: 00000100:00100000:3.0:1789265213.083208:0:10002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265213.083241:0:10002:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc9977b480 going to sleep for 11 seconds 00000100:00100000:0.0:1789265213.083349:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417429376 00000100:00100000:0.0:1789265213.083356:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417429376 00000100:00100000:0.0:1789265213.083403:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789265213.083412:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10002:x1876180417429376:12345-0@lo:700: 00000100:00100000:0.0:1789265213.106229:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10002:x1876180417429376:12345-0@lo:700: Request processed in 22809us (23011us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265213.106245:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789265213.106780:0:10002:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd23df80 x1876180417429376/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789265229 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265213.106806:0:10002:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10002:1876180417429376:0@lo:700: 00000004:02000040:3.0:1789265213.110534:0:10002:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1789265213.122832:0:10002:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d26680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10002:1876180417429504:0@lo:5: 00000100:00100000:0.0:1789265213.122903:0:10002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265213.122945:0:10002:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b75f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265213.122999:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417429504 00000100:00100000:2.0:1789265213.123008:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417429504 00000100:00100000:2.0:1789265213.123092:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789265213.123102:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:10002:x1876180417429504:12345-0@lo:5: 00002000:00080000:2.0:1789265213.136266:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1789265213.136288:0:8433:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1789265213.143506:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:10002:x1876180417429504:12345-0@lo:5: Request processed in 20398us (20596us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789265213.143520:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789265213.143709:0:10002:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83d26680 x1876180417429504/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265229 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265213.143727:0:10002:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d26680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10002:1876180417429504:0@lo:5: 00000004:00080000:1.0:1789265213.143742:0:10002:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:0.0:1789265213.761424:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789265213.777103:0:10038:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789265213.777355:0:10038:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789265214.787878:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789265214.817516:0:10087:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265214.817528:0:10087:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1789265215.314522:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265215.315768:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399554688 00000100:00100000:2.0:1789265215.315789:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399554688 00000100:00100000:2.0:1789265215.315842:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 180 00000100:00100000:2.0:1789265215.315851:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8ad99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2392:x1876180399554688:12345-192.168.203.49@tcp:250: 00010000:00080000:2.0:1789265215.315880:0:6511:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 5f6ab780-f65a-4da8-8aa9-108982c08b32@192.168.203.49@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:2.0:1789265215.315907:0:6511:0:(genops.c:1385:class_connect()) connect: client 5f6ab780-f65a-4da8-8aa9-108982c08b32, cookie 0x9272d942b4a965e0 00000100:00080000:2.0:1789265215.316077:0:6511:0:(import.c:65:import_set_state_nolock()) ffff9fcb83932000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265215.316147:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8ad99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+5:2392:x1876180399554688:12345-192.168.203.49@tcp:250: Request processed in 296us (1635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265215.316170:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 180 00000100:00100000:3.0:1789265215.329355:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265215.329473:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399554816 00000100:00100000:0.0:1789265215.329489:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399554816 00000100:00100000:0.0:1789265215.329581:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 181 00000100:00100000:0.0:1789265215.329592:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8ad98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+5:6149:x1876180399554816:12345-192.168.203.49@tcp:101: 00010000:00010000:0.0:1789265215.329609:0:7458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265215.329628:0:7458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc882b7c00/0x9272d942b4a965e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbc2a expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265215.329662:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc882b7c00/0x9272d942b4a965e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc2a expref: 6 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265215.329674:0:7458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc882b7c00/0x9272d942b4a965e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc2a expref: 6 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265215.329683:0:7458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b7c00, rc 0) 00000100:00100000:0.0:1789265215.329755:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8ad98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+6:6149:x1876180399554816:12345-192.168.203.49@tcp:101: Request processed in 165us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265215.329762:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 181 00000100:00100000:2.0:1789265215.332487:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265215.332588:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399554944 00000100:00100000:1.0:1789265215.332598:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399554944 00000100:00100000:1.0:1789265215.332652:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 182 00000100:00100000:1.0:1789265215.332663:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8ad99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+6:6149:x1876180399554944:12345-192.168.203.49@tcp:501: 00000100:00100000:1.0:1789265215.332795:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8ad99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+6:6149:x1876180399554944:12345-192.168.203.49@tcp:501: Request processed in 133us (318us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789265215.332817:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 182 00000100:00100000:3.0:1789265215.342769:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265215.343014:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399555072 00000100:00100000:0.0:1789265215.343064:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399555072 00000100:00100000:0.0:1789265215.343128:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 183 00000100:00100000:0.0:1789265215.343138:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc82437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+6:6149:x1876180399555072:12345-192.168.203.49@tcp:101: 00010000:00010000:0.0:1789265215.343155:0:7458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265215.343174:0:7458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc882b7800/0x9272d942b4a965ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbc31 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265215.343202:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc882b7800/0x9272d942b4a965ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc31 expref: 7 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265215.343215:0:7458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc882b7800/0x9272d942b4a965ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc31 expref: 7 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265215.343243:0:7458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b7800, rc 0) 00000100:00100000:0.0:1789265215.343327:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc82437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+7:6149:x1876180399555072:12345-192.168.203.49@tcp:101: Request processed in 190us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265215.343335:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 183 00000100:00100000:3.0:1789265215.345422:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265215.345552:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399555200 00000100:00100000:1.0:1789265215.345564:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399555200 00000100:00100000:1.0:1789265215.345647:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 184 00000100:00100000:1.0:1789265215.345658:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc82d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+7:6149:x1876180399555200:12345-192.168.203.49@tcp:501: 00000100:00100000:1.0:1789265215.345872:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc82d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+8:6149:x1876180399555200:12345-192.168.203.49@tcp:501: Request processed in 215us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265215.345882:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 184 00000100:00100000:2.0:1789265215.348345:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265215.349434:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399555328 00000100:00100000:0.0:1789265215.349450:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399555328 00000100:00100000:0.0:1789265215.349538:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 185 00000100:00100000:0.0:1789265215.349549:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc82d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+8:6149:x1876180399555328:12345-192.168.203.49@tcp:503: 00000100:00100000:0.0:1789265215.349712:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc82d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+8:6149:x1876180399555328:12345-192.168.203.49@tcp:503: Request processed in 164us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265215.349721:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 185 00000100:00100000:3.0:1789265215.358454:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265215.358913:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399555456 00000100:00100000:2.0:1789265215.358927:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399555456 00000100:00100000:2.0:1789265215.359003:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 186 00000100:00100000:2.0:1789265215.359014:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc82d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+8:6169:x1876180399555456:12345-192.168.203.49@tcp:502: 00000100:00100000:2.0:1789265215.359283:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc82d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+8:6169:x1876180399555456:12345-192.168.203.49@tcp:502: Request processed in 270us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265215.359292:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 186 00000100:00100000:3.0:1789265215.415387:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265215.415497:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399555584 00000100:00100000:0.0:1789265215.415512:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399555584 00000100:00100000:0.0:1789265215.415588:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 187 00000100:00100000:0.0:1789265215.415600:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+8:6169:x1876180399555584:12345-192.168.203.49@tcp:502: 00000100:00100000:0.0:1789265215.415768:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+8:6169:x1876180399555584:12345-192.168.203.49@tcp:502: Request processed in 169us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265215.415785:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 187 00000100:00100000:3.0:1789265215.426139:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265215.426494:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399555712 00000100:00100000:2.0:1789265215.426508:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399555712 00000100:00100000:2.0:1789265215.426583:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 188 00000100:00100000:2.0:1789265215.426595:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+8:6149:x1876180399555712:12345-192.168.203.49@tcp:101: 00010000:00010000:2.0:1789265215.426619:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265215.426646:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccb520be00/0x9272d942b4a965f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbc62 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265215.426685:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccb520be00/0x9272d942b4a965f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc62 expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265215.426698:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccb520be00/0x9272d942b4a965f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc62 expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265215.426709:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520be00, rc 0) 00000100:00100000:2.0:1789265215.426793:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+9:6149:x1876180399555712:12345-192.168.203.49@tcp:101: Request processed in 201us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265215.426822:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 188 00000100:00100000:3.0:1789265215.429695:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265215.429806:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399555840 00000100:00100000:0.0:1789265215.429821:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399555840 00000100:00100000:0.0:1789265215.429898:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 189 00000100:00100000:0.0:1789265215.429909:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+9:6149:x1876180399555840:12345-192.168.203.49@tcp:256: 20000000:01000000:0.0:1789265215.429935:0:7458:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789265215.429960:0:7458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789265215.429965:0:7458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789265215.429973:0:7458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789265215.429976:0:7458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789265215.429978:0:7458:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789265215.431937:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+9:6149:x1876180399555840:12345-192.168.203.49@tcp:256: Request processed in 2022us (2248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265215.431952:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 189 00000100:00100000:2.0:1789265215.437425:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265215.437924:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399555968 00000100:00100000:1.0:1789265215.437939:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399555968 00000100:00100000:1.0:1789265215.440928:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 190 00000100:00100000:1.0:1789265215.440965:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+9:6149:x1876180399555968:12345-192.168.203.49@tcp:101: 00010000:00010000:1.0:1789265215.440991:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265215.441019:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a965fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbc69 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265215.441087:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a965fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc69 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265215.441100:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a965fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc69 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265215.441111:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2ff600, rc 0) 00000100:00100000:1.0:1789265215.441211:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:6149:x1876180399555968:12345-192.168.203.49@tcp:101: Request processed in 264us (3898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265215.441219:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 190 00000100:00100000:2.0:1789265215.445646:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265215.445970:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399556096 00000100:00100000:1.0:1789265215.446004:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399556096 00000100:00100000:1.0:1789265215.446122:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 191 00000100:00100000:1.0:1789265215.446483:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:6149:x1876180399556096:12345-192.168.203.49@tcp:501: 00000100:00100000:1.0:1789265215.446910:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:6149:x1876180399556096:12345-192.168.203.49@tcp:501: Request processed in 777us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265215.446920:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 191 00000100:00100000:3.0:1789265215.449396:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265215.449507:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399556224 00000100:00100000:2.0:1789265215.449520:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399556224 00000100:00100000:2.0:1789265215.449748:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 192 00000100:00100000:2.0:1789265215.449762:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:6149:x1876180399556224:12345-192.168.203.49@tcp:503: 00000100:00100000:2.0:1789265215.449977:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:6149:x1876180399556224:12345-192.168.203.49@tcp:503: Request processed in 217us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265215.449986:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 192 00000100:00100000:2.0:1789265215.454083:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265215.454185:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399556352 00000100:00100000:0.0:1789265215.454201:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399556352 00000100:00100000:0.0:1789265215.454271:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 193 00000100:00100000:0.0:1789265215.454284:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:6175:x1876180399556352:12345-192.168.203.49@tcp:502: 00000100:00100000:0.0:1789265215.454498:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:6175:x1876180399556352:12345-192.168.203.49@tcp:502: Request processed in 215us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265215.454507:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 193 00000100:00100000:0.0:1789265215.458211:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265215.458340:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399556480 00000100:00100000:1.0:1789265215.458353:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399556480 00000100:00100000:1.0:1789265215.458428:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 194 00000100:00100000:1.0:1789265215.458440:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:6175:x1876180399556480:12345-192.168.203.49@tcp:502: 00000100:00100000:1.0:1789265215.458663:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:6175:x1876180399556480:12345-192.168.203.49@tcp:502: Request processed in 224us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265215.458672:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 194 00000100:00100000:3.0:1789265215.463597:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265215.463651:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265215.464072:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399556608 00000100:00100000:0.0:1789265215.464086:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399556608 00000100:00100000:0.0:1789265215.464141:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399556864 00000100:00100000:0.0:1789265215.464144:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399556864 00000100:00100000:0.0:1789265215.464173:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:0.0:1789265215.464183:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2392:x1876180399556608:12345-192.168.203.49@tcp:38: 00010000:00080000:0.0:1789265215.464223:0:8460:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:0.0:1789265215.464291:0:8460:0:(genops.c:1385:class_connect()) connect: client 5b43750b-84cf-4d62-9028-e016267b6509, cookie 0x9272d942b4a96603 00000004:00100000:0.0:1789265215.464323:0:8460:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789265215.464611:0:8460:0:(import.c:65:import_set_state_nolock()) ffff9fccbf425800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265215.464703:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+6:2392:x1876180399556608:12345-192.168.203.49@tcp:38: Request processed in 519us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265215.464712:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:0.0:1789265215.464753:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 8 00000100:00100000:0.0:1789265215.464758:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2392:x1876180399556864:12345-192.168.203.49@tcp:38: 00010000:00080000:0.0:1789265215.464774:0:8460:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:0.0:1789265215.464822:0:8460:0:(genops.c:1385:class_connect()) connect: client 5b43750b-84cf-4d62-9028-e016267b6509, cookie 0x9272d942b4a9660a 00000004:00100000:0.0:1789265215.464836:0:8460:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789265215.465046:0:8460:0:(import.c:65:import_set_state_nolock()) ffff9fccae77e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265215.465077:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+6:2392:x1876180399556864:12345-192.168.203.49@tcp:38: Request processed in 317us (1425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265215.465084:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 8 00010000:00010000:3.0:1789265215.811447:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265216.001715:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265216.001750:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417429760:0@lo:41: 00000100:00100000:0.0:1789265216.001867:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265216.001981:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417429760 00000100:00100000:0.0:1789265216.001992:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417429760 00000100:00100000:0.0:1789265216.002082:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789265216.002094:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417429760:12345-0@lo:41: 00000004:00000024:0.0:1789265216.002139:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789265216.002200:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417429760:12345-0@lo:41: Request processed in 108us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265216.002208:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789265216.002261:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417429760:0@lo:41: 00000100:00100000:1.0:1789265216.002464:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265216.002477:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417429632:0@lo:41: 00000100:00100000:1.0:1789265216.002514:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265216.002684:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417429632 00000100:00100000:2.0:1789265216.002690:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417429632 00000100:00100000:2.0:1789265216.004552:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789265216.004581:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417429632:12345-0@lo:41: 00000004:00000024:2.0:1789265216.004634:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789265216.004756:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417429632:12345-0@lo:41: Request processed in 187us (2240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265216.004763:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789265216.004922:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417429632:0@lo:41: 00000100:00100000:3.0:1789265216.469651:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265216.469701:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265216.469743:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265216.469865:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399557120 00000100:00100000:1.0:1789265216.469871:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399556992 00000100:00100000:2.0:1789265216.469879:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399557120 00000100:00100000:1.0:1789265216.469879:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399556992 00000100:00100000:2.0:1789265216.470099:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399556736 00000100:00100000:2.0:1789265216.470103:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399556736 00000100:00100000:2.0:1789265216.470139:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 9 00000100:00100000:2.0:1789265216.470150:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+7:6149:x1876180399557120:12345-192.168.203.49@tcp:41: 00000004:00000024:2.0:1789265216.470188:0:8459:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789265216.470284:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+7:6149:x1876180399557120:12345-192.168.203.49@tcp:41: Request processed in 135us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265216.470292:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 9 00000100:00100000:2.0:1789265216.470310:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 10 00000100:00100000:2.0:1789265216.470316:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+6:0:x1876180399556736:12345-192.168.203.49@tcp:41: 00000004:00000024:2.0:1789265216.470327:0:8459:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789265216.470346:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+6:0:x1876180399556736:12345-192.168.203.49@tcp:41: Request processed in 30us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265216.470352:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 10 00000100:00100000:1.0:1789265216.471478:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 11 00000100:00100000:1.0:1789265216.471495:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+6:0:x1876180399556992:12345-192.168.203.49@tcp:41: 00000004:00000024:1.0:1789265216.471532:0:8460:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789265216.471596:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+6:0:x1876180399556992:12345-192.168.203.49@tcp:41: Request processed in 106us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265216.471603:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 11 00000100:00080000:3.0:1789265216.473450:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265216.473464:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265216.475922:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265216.476066:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399557248 00000100:00100000:2.0:1789265216.476079:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399557248 00000100:00100000:2.0:1789265216.476157:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 12 00000100:00100000:2.0:1789265216.476168:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+6:6149:x1876180399557248:12345-192.168.203.49@tcp:40: 00000100:00100000:2.0:1789265216.476441:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+6:6149:x1876180399557248:12345-192.168.203.49@tcp:40: Request processed in 273us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265216.476450:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 12 00000100:00100000:1.0:1789265216.481688:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265216.481840:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265216.481906:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265216.481951:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265216.481978:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399557376 00000100:00100000:0.0:1789265216.481992:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399557376 00000100:00100000:3.0:1789265216.482060:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399557632 00000100:00100000:2.0:1789265216.482060:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399557504 00000100:00100000:2.0:1789265216.482068:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399557504 00000100:00100000:3.0:1789265216.482072:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399557632 00000100:00100000:0.0:1789265216.482097:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 16 00000100:00100000:0.0:1789265216.482109:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1876180399557376:12345-192.168.203.49@tcp:8: 00000100:00100000:3.0:1789265216.482110:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 17 00000100:00100000:2.0:1789265216.482119:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 195 00000100:00100000:3.0:1789265216.482122:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1876180399557632:12345-192.168.203.49@tcp:8: 00000100:00100000:2.0:1789265216.482132:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:2395:x1876180399557504:12345-192.168.203.49@tcp:400: 00010000:00080000:0.0:1789265216.482174:0:8435:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:0.0:1789265216.482221:0:8435:0:(genops.c:1385:class_connect()) connect: client 5b43750b-84cf-4d62-9028-e016267b6509, cookie 0x9272d942b4a96611 00002000:00100000:0.0:1789265216.482237:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5b43750b-84cf-4d62-9028-e016267b6509/ffff9fcb82f02800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1789265216.482238:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:2395:x1876180399557504:12345-192.168.203.49@tcp:400: Request processed in 108us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265216.482248:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 195 00000100:00100000:2.0:1789265216.482306:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399557760 00000100:00100000:2.0:1789265216.482310:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399557760 00000100:00100000:2.0:1789265216.482344:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 4 00000100:00100000:2.0:1789265216.482360:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5b43750b-84cf-4d62-9028-e016267b6509+6:6149:x1876180399557760:12345-192.168.203.49@tcp:900: 00000100:00100000:2.0:1789265216.482405:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5b43750b-84cf-4d62-9028-e016267b6509+6:6149:x1876180399557760:12345-192.168.203.49@tcp:900: Request processed in 45us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265216.482413:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 4 00002000:00100000:0.0:1789265216.482423:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789265216.482662:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789265216.482697:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9fcb82f03000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265216.482750:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+6:2392:x1876180399557376:12345-192.168.203.49@tcp:8: Request processed in 643us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265216.482759:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 16 00010000:00080000:3.0:1789265216.488919:0:8914:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:3.0:1789265216.488974:0:8914:0:(genops.c:1385:class_connect()) connect: client 5b43750b-84cf-4d62-9028-e016267b6509, cookie 0x9272d942b4a96618 00002000:00100000:3.0:1789265216.488993:0:8914:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5b43750b-84cf-4d62-9028-e016267b6509/ffff9fcb83c7a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789265216.489060:0:8914:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789265216.489665:0:8914:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789265216.489712:0:8914:0:(import.c:65:import_set_state_nolock()) ffff9fcb83c7e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265216.489837:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+6:2392:x1876180399557632:12345-192.168.203.49@tcp:8: Request processed in 7712us (7927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265216.489850:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 17 00000100:00100000:1.0:1789265216.491624:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265216.492376:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399557888 00000100:00100000:2.0:1789265216.492391:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399557888 00000100:00100000:2.0:1789265216.492468:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 0 00000100:00100000:2.0:1789265216.492480:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+6:6149:x1876180399557888:12345-192.168.203.49@tcp:33: 00000100:00100000:0.0:1789265216.513433:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265216.513464:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417429888:0@lo:13: 00000100:00100000:0.0:1789265216.513554:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265216.513680:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265216.513699:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417430016:0@lo:13: 00000100:00100000:1.0:1789265216.513728:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417429888 00000100:00100000:1.0:1789265216.513738:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417429888 00000100:00100000:3.0:1789265216.513745:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265216.513816:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417430016 00000100:00100000:1.0:1789265216.513820:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417430016 00000100:00080000:3.0:1789265216.513829:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265216.513845:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789265216.513855:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417429888:12345-0@lo:13: 00002000:00000024:1.0:1789265216.513882:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265216.513943:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417429888:12345-0@lo:13: Request processed in 90us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265216.513950:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789265216.513967:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265216.513973:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417430016:12345-0@lo:13: 00002000:00000024:1.0:1789265216.513981:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265216.514003:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417430016:12345-0@lo:13: Request processed in 30us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265216.514009:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789265216.514186:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83b93b80 x1876180417430016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265216.514210:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417430016:0@lo:13: 00010000:00080000:3.0:1789265216.514254:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83d26d80 x1876180417429888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265216.514278:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417429888:0@lo:13: 00000004:00080000:3.0:1789265216.522629:0:6519:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 30036us 00000004:00200000:2.0:1789265216.572550:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789265216.572667:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+6:6149:x1876180399557888:12345-192.168.203.49@tcp:33: Request processed in 80186us (81058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265216.572677:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 0 00000100:00100000:1.0:1789265216.820520:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265216.820785:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399558016 00000100:00100000:0.0:1789265216.820797:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399558016 00000100:00100000:0.0:1789265216.820861:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 13 00000100:00100000:0.0:1789265216.820872:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+6:6193:x1876180399558016:12345-192.168.203.49@tcp:101: 00010000:00010000:0.0:1789265216.820997:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265216.821103:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7a00/0x9272d942b4a9661f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbc9a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265216.821172:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a96626 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265216.821185:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a96626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265216.821199:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a96626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265216.821262:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789265216.821266:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265216.821281:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a96626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265216.821307:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7a00/0x9272d942b4a9661f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc9a expref: 8 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265216.821327:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a96626 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc9a expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265216.821335:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fccacd51400) 00010000:00010000:0.0:1789265216.821338:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265216.821341:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b7000, rc 0) 00000100:00100000:0.0:1789265216.821412:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+7:6193:x1876180399558016:12345-192.168.203.49@tcp:101: Request processed in 542us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265216.821420:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 13 00010000:00010000:0.0:1789265216.833181:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265217.857383:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265218.049376:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417430144:0@lo:13: 00000100:00100000:2.0:1789265218.049452:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265218.049540:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417430144 00000100:00100000:2.0:1789265218.049549:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417430144 00000100:00100000:2.0:1789265218.049755:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789265218.049775:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417430144:12345-0@lo:13: 00002000:00000024:2.0:1789265218.049827:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789265218.049861:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265218.049927:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417430144:12345-0@lo:13: Request processed in 152us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265218.049938:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789265218.052749:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccb5c13100 x1876180417430144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265218.052774:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789265218.052803:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417430144:0@lo:13: 00000100:00100000:3.0:1789265218.561467:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417430656:0@lo:400: 00000100:00100000:3.0:1789265218.561585:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265218.561658:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417431168:0@lo:400: 00000100:00100000:3.0:1789265218.561697:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265218.561724:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417431680:0@lo:400: 00000100:00100000:3.0:1789265218.561745:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265218.561790:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789265218.561796:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417430528:0@lo:400: 00000100:00100000:3.0:1789265218.561818:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265218.561838:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417431040:0@lo:400: 00000100:00100000:3.0:1789265218.561864:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265218.561881:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417431552:0@lo:400: 00000100:00100000:3.0:1789265218.561907:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265218.561941:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417430656 00000100:00100000:3.0:1789265218.561951:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417430656 00000100:00100000:3.0:1789265218.562000:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417430528 00000100:00100000:3.0:1789265218.562004:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417430528 00000100:00100000:3.0:1789265218.562055:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789265218.562066:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417430656:12345-0@lo:400: 00000100:00100000:3.0:1789265218.562133:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417430656:12345-0@lo:400: Request processed in 68us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265218.562142:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789265218.562161:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789265218.562168:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417430528:12345-0@lo:400: 00000100:00100000:3.0:1789265218.562196:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417430528:12345-0@lo:400: Request processed in 30us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265218.562202:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789265218.562222:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417431168 00000100:00100000:3.0:1789265218.562226:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417431168 00000100:00100000:3.0:1789265218.562258:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417431680 00000100:00100000:3.0:1789265218.562269:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417431680 00000100:00100000:3.0:1789265218.562301:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265218.562307:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417431168:12345-0@lo:400: 00000100:00100000:3.0:1789265218.562341:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417431168:12345-0@lo:400: Request processed in 35us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265218.562347:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265218.562359:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265218.562365:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180417431680:12345-0@lo:400: 00000100:00100000:3.0:1789265218.562393:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180417431680:12345-0@lo:400: Request processed in 28us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265218.562399:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789265218.562425:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265218.562431:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265218.562466:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417430528:0@lo:400: 00000100:00100000:3.0:1789265218.562478:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417430656:0@lo:400: 00010000:00080000:3.0:1789265218.562491:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd23ca80 x1876180417431168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265218.562502:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417431168:0@lo:400: 00010000:00080000:3.0:1789265218.562512:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4fad80 x1876180417431680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265218.562521:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417431680:0@lo:400: 00000100:00100000:0.0:1789265218.562742:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417430272:0@lo:400: 00000100:00100000:0.0:1789265218.562841:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265218.562906:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417430784:0@lo:400: 00000100:00100000:0.0:1789265218.562935:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265218.562974:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417431296:0@lo:400: 00000100:00100000:0.0:1789265218.563007:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265218.563052:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417430272 00000100:00100000:3.0:1789265218.563061:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417430272 00000100:00100000:0.0:1789265218.563106:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789265218.563116:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789265218.563124:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417430400:0@lo:400: 00000100:00100000:3.0:1789265218.563131:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3643:x1876180417430272:12345-0@lo:400: 00000100:00100000:0.0:1789265218.563161:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265218.563194:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417430912:0@lo:400: 00000100:00100000:3.0:1789265218.563218:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3643:x1876180417430272:12345-0@lo:400: Request processed in 91us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265218.563227:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789265218.563246:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265218.563275:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417431424:0@lo:400: 00000100:00100000:0.0:1789265218.563301:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265218.563302:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417431040 00000100:00100000:3.0:1789265218.563309:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417431040 00000100:00100000:0.0:1789265218.563335:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417430272:0@lo:400: 00000100:00100000:3.0:1789265218.563347:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417431552 00000100:00100000:3.0:1789265218.563353:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417431552 00000100:00100000:3.0:1789265218.563383:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417430784 00000100:00100000:0.0:1789265218.563384:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417431296 00000100:00100000:3.0:1789265218.563392:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417430784 00000100:00100000:0.0:1789265218.563396:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417431296 00000100:00100000:0.0:1789265218.563453:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265218.563463:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417431296:12345-0@lo:400: 00000100:00100000:0.0:1789265218.563513:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417431296:12345-0@lo:400: Request processed in 51us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265218.563520:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789265218.563606:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4f9500 x1876180417431296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265218.563619:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417431296:0@lo:400: 00000100:00100000:0.0:1789265218.563639:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417430400 00000100:00100000:0.0:1789265218.563643:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417430400 00000100:00100000:0.0:1789265218.563661:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417430912 00000100:00100000:0.0:1789265218.563664:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417430912 00000100:00100000:0.0:1789265218.563676:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417431424 00000100:00100000:0.0:1789265218.563679:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417431424 00000100:00100000:0.0:1789265218.563694:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789265218.563711:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417431040:12345-0@lo:400: 00000100:00100000:0.0:1789265218.563751:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417431040:12345-0@lo:400: Request processed in 42us (1887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265218.563769:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789265218.563784:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789265218.563792:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876180417431552:12345-0@lo:400: 00000100:00100000:0.0:1789265218.563820:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876180417431552:12345-0@lo:400: Request processed in 29us (1912us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265218.563826:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789265218.563837:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789265218.563842:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417430400:12345-0@lo:400: 00000100:00100000:0.0:1789265218.563872:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417430400:12345-0@lo:400: Request processed in 29us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265218.563878:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789265218.563890:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789265218.563895:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417430912:12345-0@lo:400: 00000100:00100000:0.0:1789265218.563920:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417430912:12345-0@lo:400: Request processed in 25us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265218.563926:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789265218.563936:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789265218.563942:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417431424:12345-0@lo:400: 00000100:00100000:0.0:1789265218.563967:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417431424:12345-0@lo:400: Request processed in 26us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265218.563972:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789265218.563998:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417430400:0@lo:400: 00000100:00100000:0.0:1789265218.564018:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417430912:0@lo:400: 00000100:00100000:0.0:1789265218.564049:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417431424:0@lo:400: 00010000:00080000:0.0:1789265218.564082:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd23ed80 x1876180417431040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265218.564092:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417431040:0@lo:400: 00010000:00080000:0.0:1789265218.564102:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4fb800 x1876180417431552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265218.564111:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417431552:0@lo:400: 00000100:00080000:0.0:1789265218.564161:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265218.564166:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265218.564168:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265218.565181:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265218.565198:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417431808:0@lo:13: 00000100:00100000:1.0:1789265218.565245:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265218.565284:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417431808 00000100:00100000:1.0:1789265218.565290:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417431808 00000100:00100000:1.0:1789265218.565335:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789265218.565344:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876180417431808:12345-0@lo:13: 00002000:00000024:1.0:1789265218.565362:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265218.565418:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876180417431808:12345-0@lo:13: Request processed in 75us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265218.565425:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789265218.565462:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83b92680 x1876180417431808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265218.565478:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417431808:0@lo:13: 00000100:00100000:3.0:1789265218.565491:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789265218.565592:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417430784:12345-0@lo:400: 00000100:00100000:3.0:1789265218.565688:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417430784:12345-0@lo:400: Request processed in 185us (2752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265218.565696:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789265218.566904:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417430784:0@lo:400: 00000001:00100000:3.0:1789265218.571166:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5b43750b-84cf-4d62-9028-e016267b6509 00000001:00080000:3.0:1789265218.571191:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:3.0:1789265218.883490:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265219.004819:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265219.005414:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399558144 00000100:00100000:1.0:1789265219.005425:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399558144 00000100:00100000:1.0:1789265219.005514:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 14 00000100:00100000:1.0:1789265219.005525:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+7:6245:x1876180399558144:12345-192.168.203.49@tcp:41: 00000004:00000024:1.0:1789265219.005578:0:8460:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789265219.005654:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+7:6245:x1876180399558144:12345-192.168.203.49@tcp:41: Request processed in 131us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265219.005662:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 14 00000100:00080000:0.0:1789265219.007001:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265219.008153:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265219.008249:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399558272 00000100:00100000:2.0:1789265219.008260:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399558272 00000100:00100000:2.0:1789265219.008335:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 15 00000100:00100000:2.0:1789265219.008345:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+6:6245:x1876180399558272:12345-192.168.203.49@tcp:41: 00000004:00000024:2.0:1789265219.008394:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789265219.008456:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+6:6245:x1876180399558272:12345-192.168.203.49@tcp:41: Request processed in 112us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265219.008464:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 15 00000100:00080000:0.0:1789265219.008936:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265219.016178:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265219.016282:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399558400 00000100:00100000:2.0:1789265219.016302:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399558400 00000100:00100000:2.0:1789265219.016379:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 16 00000100:00100000:2.0:1789265219.016390:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5b43750b-84cf-4d62-9028-e016267b6509+6:6245:x1876180399558400:12345-192.168.203.49@tcp:13: 00002000:00000024:2.0:1789265219.016426:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265219.016499:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5b43750b-84cf-4d62-9028-e016267b6509+6:6245:x1876180399558400:12345-192.168.203.49@tcp:13: Request processed in 111us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265219.016506:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 16 00000100:00080000:0.0:1789265219.017151:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265219.031075:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265219.031224:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399558528 00000100:00100000:1.0:1789265219.031234:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399558528 00000100:00100000:1.0:1789265219.031322:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 17 00000100:00100000:1.0:1789265219.031333:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5b43750b-84cf-4d62-9028-e016267b6509+5:6245:x1876180399558528:12345-192.168.203.49@tcp:13: 00002000:00000024:1.0:1789265219.031359:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265219.031425:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5b43750b-84cf-4d62-9028-e016267b6509+5:6245:x1876180399558528:12345-192.168.203.49@tcp:13: Request processed in 94us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265219.031433:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 17 00000100:00080000:0.0:1789265219.031515:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789265219.906135:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789265220.635709:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5b43750b-84cf-4d62-9028-e016267b6509 00000001:00100000:2.0:1789265220.651518:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5b43750b-84cf-4d62-9028-e016267b6509 00010000:00010000:2.0:1789265220.929480:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265221.121835:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417432064:0@lo:41: 00000100:00100000:0.0:1789265221.121906:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265221.122057:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417432064 00000100:00100000:3.0:1789265221.122065:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417432064 00000100:00100000:3.0:1789265221.122120:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789265221.122131:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417432064:12345-0@lo:41: 00000004:00000024:3.0:1789265221.122164:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789265221.122214:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417432064:12345-0@lo:41: Request processed in 84us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265221.122232:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789265221.122426:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417432064:0@lo:41: 00000100:00100000:2.0:1789265221.122500:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265221.122513:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417431936:0@lo:41: 00000100:00100000:2.0:1789265221.122546:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265221.122627:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417431936 00000100:00100000:3.0:1789265221.122631:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417431936 00000100:00100000:3.0:1789265221.122663:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789265221.122670:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417431936:12345-0@lo:41: 00000004:00000024:3.0:1789265221.122688:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789265221.122732:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417431936:12345-0@lo:41: Request processed in 62us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265221.122748:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789265221.122818:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417431936:0@lo:41: 00000100:00100000:3.0:1789265221.633727:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417432192:0@lo:13: 00000100:00100000:3.0:1789265221.633812:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265221.633889:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417432192 00000100:00100000:3.0:1789265221.633895:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417432192 00000100:00100000:3.0:1789265221.633947:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789265221.633957:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417432192:12345-0@lo:13: 00002000:00000024:3.0:1789265221.633984:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265221.634067:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417432192:12345-0@lo:13: Request processed in 111us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265221.634074:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1789265221.634093:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789265221.634832:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4f9f80 x1876180417432192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265237 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265221.634853:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417432192:0@lo:13: 00000100:00100000:1.0:1789265221.639293:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417432320:0@lo:13: 00000100:00100000:1.0:1789265221.639396:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265221.640775:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417432320 00000100:00100000:3.0:1789265221.640788:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417432320 00000100:00100000:3.0:1789265221.640842:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789265221.640865:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417432320:12345-0@lo:13: 00002000:00000024:3.0:1789265221.640890:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265221.640955:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417432320:12345-0@lo:13: Request processed in 92us (1559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265221.640962:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1789265221.640981:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789265221.641051:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc8376ca80 x1876180417432320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265237 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265221.641071:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417432320:0@lo:13: 00010000:00010000:2.0:1789265221.953973:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265221.963063:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265221.963109:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265221.963135:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265221.963154:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265221.963177:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265221.963211:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399558912 00000100:00100000:1.0:1789265221.963221:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399558912 00000100:00100000:1.0:1789265221.963275:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399558784 00000100:00100000:1.0:1789265221.963279:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399558784 00000100:00100000:1.0:1789265221.963303:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 49 00000100:00100000:1.0:1789265221.963312:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399558912:12345-192.168.203.49@tcp:400: 00000100:00100000:1.0:1789265221.963382:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399558912:12345-192.168.203.49@tcp:400: Request processed in 71us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265221.963389:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 49 00000100:00100000:1.0:1789265221.963405:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 50 00000100:00100000:1.0:1789265221.963411:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399558784:12345-192.168.203.49@tcp:400: 00000100:00100000:1.0:1789265221.963435:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399558784:12345-192.168.203.49@tcp:400: Request processed in 24us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265221.963440:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 50 00000100:00100000:1.0:1789265221.963458:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399559168 00000100:00100000:1.0:1789265221.963461:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399559168 00000100:00100000:1.0:1789265221.963483:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399559040 00000100:00100000:1.0:1789265221.963485:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399559040 00000100:00100000:1.0:1789265221.963503:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 11 00000100:00100000:1.0:1789265221.963508:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399559168:12345-192.168.203.49@tcp:400: 00000100:00100000:1.0:1789265221.963531:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399559168:12345-192.168.203.49@tcp:400: Request processed in 23us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265221.963549:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 11 00000100:00100000:1.0:1789265221.963560:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 12 00000100:00100000:1.0:1789265221.963566:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399559040:12345-192.168.203.49@tcp:400: 00000100:00100000:1.0:1789265221.963592:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399559040:12345-192.168.203.49@tcp:400: Request processed in 26us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265221.963598:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 12 00000100:00080000:1.0:1789265221.963617:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265221.963620:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265221.963623:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265221.963625:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789265221.963823:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399558656 00000100:00100000:2.0:1789265221.963827:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399558656 00000100:00100000:2.0:1789265221.963867:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 197 00000100:00100000:2.0:1789265221.963882:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:2395:x1876180399558656:12345-192.168.203.49@tcp:400: 00000100:00100000:2.0:1789265221.963917:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:2395:x1876180399558656:12345-192.168.203.49@tcp:400: Request processed in 43us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265221.963924:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 197 00000001:02000400:2.0:1789265222.263135:0:10185:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1789265222.659785:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5b43750b-84cf-4d62-9028-e016267b6509 00010000:00010000:0.0:1789265222.978455:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265223.169428:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265223.169452:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417432448:0@lo:13: 00000100:00100000:0.0:1789265223.169520:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265223.169922:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417432448 00000100:00100000:2.0:1789265223.169932:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417432448 00000100:00100000:2.0:1789265223.169995:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789265223.170006:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417432448:12345-0@lo:13: 00000100:00080000:1.0:1789265223.170110:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1789265223.170171:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265223.170236:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417432448:12345-0@lo:13: Request processed in 232us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265223.170244:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789265223.170376:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccb5c11c00 x1876180417432448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265223.170394:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417432448:0@lo:13: 00000100:00100000:0.0:1789265223.684398:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265223.684427:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82868700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417432576:0@lo:13: 00000100:00100000:0.0:1789265223.684492:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265223.684580:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417432576 00000100:00100000:1.0:1789265223.684587:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417432576 00000100:00100000:1.0:1789265223.684643:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789265223.684651:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417432576:12345-0@lo:13: 00002000:00000024:1.0:1789265223.684670:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265223.684709:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417432576:12345-0@lo:13: Request processed in 59us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265223.684716:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1789265223.684781:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789265223.684808:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb82868700 x1876180417432576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265223.684818:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1789265223.684839:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82868700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417432576:0@lo:13: 00000100:00100000:0.0:1789265223.685644:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417432832:0@lo:400: 00000100:00100000:0.0:1789265223.685683:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265223.685708:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417433344:0@lo:400: 00000100:00100000:0.0:1789265223.685739:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265223.685756:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417433856:0@lo:400: 00000100:00100000:0.0:1789265223.685777:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265223.685807:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789265223.685812:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417432960:0@lo:400: 00000100:00100000:0.0:1789265223.685854:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265223.685877:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417433472:0@lo:400: 00000100:00100000:0.0:1789265223.685896:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265223.685911:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417433984:0@lo:400: 00000100:00100000:0.0:1789265223.685940:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265223.685974:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417432832 00000100:00100000:0.0:1789265223.685980:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417432832 00000100:00100000:2.0:1789265223.686162:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417433088:0@lo:400: 00000100:00100000:2.0:1789265223.686202:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265223.686224:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417433600:0@lo:400: 00000100:00100000:2.0:1789265223.686251:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265223.686270:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789265223.686274:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417432704:0@lo:400: 00000100:00100000:2.0:1789265223.686299:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265223.686317:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417433216:0@lo:400: 00000100:00100000:2.0:1789265223.686336:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265223.686347:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417433728:0@lo:400: 00000100:00100000:2.0:1789265223.686363:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265223.686483:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417433600 00000100:00100000:1.0:1789265223.686487:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417433600 00000100:00100000:1.0:1789265223.686538:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417433728 00000100:00100000:1.0:1789265223.686548:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417433728 00000100:00100000:1.0:1789265223.686572:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265223.686580:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417433600:12345-0@lo:400: 00000100:00100000:1.0:1789265223.686626:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417433600:12345-0@lo:400: Request processed in 47us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265223.686633:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265223.686646:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789265223.686652:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417433728:12345-0@lo:400: 00000100:00100000:1.0:1789265223.686678:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417433728:12345-0@lo:400: Request processed in 26us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265223.686684:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789265223.686730:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4f2d80 x1876180417433728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265223.686743:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417433728:0@lo:400: 00010000:00080000:1.0:1789265223.686754:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4f3800 x1876180417433600/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265223.686761:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417433600:0@lo:400: 00000100:00080000:2.0:1789265223.686871:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265223.686963:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417433344 00000100:00100000:0.0:1789265223.686967:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417433344 00000100:00100000:0.0:1789265223.687149:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417433856 00000100:00100000:0.0:1789265223.687154:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417433856 00000100:00100000:3.0:1789265223.687275:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417432960 00000100:00100000:3.0:1789265223.687280:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417432960 00000100:00100000:3.0:1789265223.687316:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417433088 00000100:00100000:3.0:1789265223.687320:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417433088 00000100:00100000:3.0:1789265223.687336:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789265223.687342:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417432960:12345-0@lo:400: 00000100:00100000:3.0:1789265223.687393:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417432960:12345-0@lo:400: Request processed in 51us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265223.687399:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789265223.687413:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789265223.687418:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417433088:12345-0@lo:400: 00000100:00100000:3.0:1789265223.687449:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417433088:12345-0@lo:400: Request processed in 30us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265223.687455:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789265223.687473:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417432704 00000100:00100000:3.0:1789265223.687476:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417432704 00000100:00100000:3.0:1789265223.687500:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789265223.687506:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3641:x1876180417432704:12345-0@lo:400: 00000100:00100000:3.0:1789265223.687546:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3641:x1876180417432704:12345-0@lo:400: Request processed in 39us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265223.687552:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789265223.688936:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417432704:0@lo:400: 00000100:00100000:1.0:1789265223.688954:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417433088:0@lo:400: 00000100:00080000:2.0:1789265223.689859:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265223.690006:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417433472 00000100:00100000:1.0:1789265223.690015:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417433472 00000100:00080000:2.0:1789265223.690294:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265223.690382:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417433984 00000100:00100000:0.0:1789265223.690394:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417433984 00000100:00100000:0.0:1789265223.690425:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417433216 00000100:00100000:0.0:1789265223.690429:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417433216 00000100:00100000:0.0:1789265223.690446:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789265223.690454:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417432832:12345-0@lo:400: 00000100:00100000:0.0:1789265223.690533:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417432832:12345-0@lo:400: Request processed in 80us (4849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265223.690540:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789265223.690555:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789265223.690561:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417433344:12345-0@lo:400: 00000100:00100000:0.0:1789265223.690588:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417433344:12345-0@lo:400: Request processed in 27us (4848us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265223.690593:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789265223.690603:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789265223.690609:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417433856:12345-0@lo:400: 00000100:00100000:0.0:1789265223.690635:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417433856:12345-0@lo:400: Request processed in 27us (4858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265223.690639:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789265223.690650:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789265223.690656:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417433984:12345-0@lo:400: 00000100:00100000:0.0:1789265223.690683:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417433984:12345-0@lo:400: Request processed in 28us (4743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265223.690688:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789265223.690698:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789265223.690704:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417433216:12345-0@lo:400: 00000100:00100000:0.0:1789265223.690750:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417433216:12345-0@lo:400: Request processed in 47us (4412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265223.690763:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789265223.690812:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417432960:0@lo:400: 00010000:00080000:0.0:1789265223.690829:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4f0000 x1876180417433984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265223.690839:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417433984:0@lo:400: 00000100:00100000:0.0:1789265223.690850:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417432832:0@lo:400: 00000100:00100000:0.0:1789265223.690860:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417433344:0@lo:400: 00000100:00100000:0.0:1789265223.690870:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417433856:0@lo:400: 00000100:00100000:3.0:1789265223.691176:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417433216:0@lo:400: 00000100:00080000:2.0:1789265223.691292:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265223.693097:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789265223.693114:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417433472:12345-0@lo:400: 00000100:00100000:1.0:1789265223.693203:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417433472:12345-0@lo:400: Request processed in 96us (7305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265223.693226:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1789265223.694604:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4f3100 x1876180417433472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265223.694622:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417433472:0@lo:400: 00010000:00010000:2.0:1789265224.001999:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265225.025500:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789265226.011659:0:10332:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd57b01a0 20000000:00000080:0.0:1789265226.011676:0:10332:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fcb83cc2800 uarg=0000000000000000 20000000:01000000:1.0:1789265226.013658:0:10332:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1789265226.013662:0:10332:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1789265226.013665:0:10332:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789265226.013964:0:10332:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789265226.013970:0:10332:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1789265226.014317:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789265226.014320:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789265226.016974:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1789265226.017893:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1789265226.017930:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1789265226.017945:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:0.0:1789265226.017958:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789265226.017960:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789265226.019522:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1789265226.020224:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1789265226.020263:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1789265226.020279:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:1.0:1789265226.020291:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789265226.020294:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789265226.024878:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1789265226.026226:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1789265226.026264:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1789265226.026283:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:0.0:1789265226.026298:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789265226.026301:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789265226.029424:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1789265226.029683:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1789265226.029725:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1789265226.029743:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:1.0:1789265226.029755:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789265226.029757:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789265226.034835:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1789265226.035246:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1789265226.035279:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1789265226.035298:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 10000000:01000000:1.0:1789265226.035312:0:10332:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789265226.035333:0:10332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fccbd2fe400/0x9272d942b4a9662d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265226.035351:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc81692e00/0x9272d942b4a964c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a964c1 expref: 23 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265226.035358:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc81692600/0x9272d942b4a964f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a964eb expref: 23 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265226.035379:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a96531 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9652a expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265226.035386:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc81692a00/0x9272d942b4a9653f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96538 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265226.035393:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc882b6600/0x9272d942b4a9654d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96546 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265226.035400:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc882b6a00/0x9272d942b4a96569 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96562 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265226.035406:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fccbd2ff400/0x9272d942b4a96593 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9658c expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265226.035413:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc81490400/0x9272d942b4a965af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a965a8 expref: 23 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265226.035419:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fccbd2fe200/0x9272d942b4a965d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a965d2 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265226.035428:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc882b7c00/0x9272d942b4a965e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc2a expref: 9 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265226.035435:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc882b7800/0x9272d942b4a965ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc31 expref: 9 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265226.035442:0:10332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fccbd2fe400/0x9272d942b4a9662d lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265226.035491:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc882b7800/0x9272d942b4a965ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc31 expref: 9 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265226.035504:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcc882b7800/0x9272d942b4a965ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc31 expref: 9 pid: 7458 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265226.035517:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180417434112:192.168.203.49@tcp:104: 00010000:00010000:1.0:1789265226.035741:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc882b7c00/0x9272d942b4a965e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc2a expref: 9 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265226.035750:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcc882b7c00/0x9272d942b4a965e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc2a expref: 9 pid: 7458 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265226.035759:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82868a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180417434240:192.168.203.49@tcp:104: 00010000:00010000:1.0:1789265226.035793:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fccbd2fe200/0x9272d942b4a965d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a965d2 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265226.035802:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fccbd2fe200/0x9272d942b4a965d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a965d2 expref: 23 pid: 6511 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265226.035811:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82868700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180417434368:0@lo:104: 00000100:00100000:1.0:1789265226.035852:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265226.035895:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc81490400/0x9272d942b4a965af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a965a8 expref: 23 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265226.035905:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc81490400/0x9272d942b4a965af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a965a8 expref: 23 pid: 7458 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265226.035907:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417434368 00000100:00100000:0.0:1789265226.035916:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417434368 00000100:00100000:1.0:1789265226.035931:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180417434496:0@lo:104: 00000100:00100000:1.0:1789265226.035959:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265226.035987:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265226.035998:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+3:10332:x1876180417434368:12345-0@lo:104: 00010000:00010000:0.0:1789265226.036019:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffe00/0x9272d942b4a965d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a965d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265226.036097:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789265226.036104:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+3:10332:x1876180417434368:12345-0@lo:104: Request processed in 108us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265226.036111:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1789265226.036133:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265226.036140:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffe00/0x9272d942b4a965d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a965d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265226.036148:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ffe00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:0.0:1789265226.036152:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffe00/0x9272d942b4a965d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a965d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265226.036160:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffe00/0x9272d942b4a965d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a965d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265226.036167:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffe00/0x9272d942b4a965d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a965d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265226.036173:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789265226.040934:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffe00/0x9272d942b4a965d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a965d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265226.040950:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265226.040969:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffe00/0x9272d942b4a965d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a965d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265226.040987:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffe00/0x9272d942b4a965d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a965d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265226.041014:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265226.041017:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265226.041019:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265226.041044:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265226.041064:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417434624:0@lo:103: 00000100:00100000:0.0:1789265226.041129:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265226.041212:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417434624 00000100:00100000:2.0:1789265226.041221:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417434624 00010000:00010000:2.0:1789265226.041258:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fccbd2fe200/0x9272d942b4a965d9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a965d2 expref: 24 pid: 6511 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265226.041293:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789265226.041304:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb09a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417434624:12345-0@lo:103: 00010000:00010000:2.0:1789265226.041316:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265226.041321:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fccbd2fe200/0x9272d942b4a965d9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a965d2 expref: 24 pid: 6511 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.041331:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fccbd2fe200/0x9272d942b4a965d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a965d2 expref: 24 pid: 6511 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.041349:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265226.041396:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb09a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417434624:12345-0@lo:103: Request processed in 95us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265226.041404:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265226.042110:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417434624:0@lo:103: 00010000:00010000:1.0:1789265226.042870:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fccbd2ff400/0x9272d942b4a96593 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a9658c expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265226.042886:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fccbd2ff400/0x9272d942b4a96593 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a9658c expref: 23 pid: 6508 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265226.042901:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180417434752:0@lo:104: 00000100:00100000:1.0:1789265226.042945:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265226.044385:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc882b6a00/0x9272d942b4a96569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a96562 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265226.044401:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc882b6a00/0x9272d942b4a96569 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a96562 expref: 23 pid: 6510 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265226.044414:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180417434880:0@lo:104: 00000100:00100000:1.0:1789265226.044454:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265226.051404:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789265226.051432:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417434496 00000100:00100000:3.0:1789265226.051441:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417434496 00000100:00100000:3.0:1789265226.051486:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417434752 00000100:00100000:3.0:1789265226.051488:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417434752 00000100:00100000:3.0:1789265226.051499:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417434880 00000100:00100000:3.0:1789265226.051501:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417434880 00000100:00100000:3.0:1789265226.051517:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789265226.051525:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+5:10332:x1876180417434496:12345-0@lo:104: 00010000:00010000:3.0:1789265226.051542:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6e00/0x9272d942b4a965a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a965af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265226.051640:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789265226.051646:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+5:10332:x1876180417434496:12345-0@lo:104: Request processed in 123us (15687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265226.051654:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789265226.051669:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789265226.051675:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+4:10332:x1876180417434752:12345-0@lo:104: 00010000:00010000:3.0:1789265226.051683:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a9658c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96593 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.051700:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265226.051719:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6e00/0x9272d942b4a965a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a965af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.051730:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6e00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265226.051735:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6e00/0x9272d942b4a965a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a965af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.051744:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6e00/0x9272d942b4a965a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a965af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265226.051750:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:2.0:1789265226.051752:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6e00/0x9272d942b4a965a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a965af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265226.051758:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+4:10332:x1876180417434752:12345-0@lo:104: Request processed in 82us (8811us total) trans 0 rc 0/0 10000000:01000000:2.0:1789265226.051765:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789265226.051779:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789265226.051794:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789265226.051801:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf49d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+3:10332:x1876180417434880:12345-0@lo:104: 00010000:00010000:3.0:1789265226.051810:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a96562 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96569 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.051823:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6e00/0x9272d942b4a965a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a965af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.051831:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789265226.051847:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00010000:00010000:3.0:1789265226.051851:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789265226.051856:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1789265226.051858:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf49d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+3:10332:x1876180417434880:12345-0@lo:104: Request processed in 58us (7403us total) trans 0 rc 0/0 00010000:00010000:2.0:1789265226.051859:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6e00/0x9272d942b4a965a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a965af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265226.051866:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1789265226.051873:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1789265226.051877:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6e00/0x9272d942b4a965a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a965af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.051895:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265226.051899:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a9658c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96593 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.051906:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6c00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265226.051909:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a9658c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a96593 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.051916:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a9658c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a96593 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265226.051918:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265226.051927:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a96562 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96569 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265226.051927:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a9658c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a96593 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265226.051945:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81693600 already unused, calling callback (ffffffffc1191c20) 10000000:01000000:2.0:1789265226.051946:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:3.0:1789265226.051953:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a96562 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a96569 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265226.051962:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a96562 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a96569 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265226.051969:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a96562 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a96569 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265226.051974:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265226.051980:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a9658c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96593 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.051988:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265226.052014:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a9658c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96593 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265226.052112:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417435136:0@lo:103: 00000100:00100000:0.0:1789265226.052152:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265226.052229:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a96562 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96569 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265226.052235:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265226.052241:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a96562 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96569 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265226.052247:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a96562 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96569 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265226.052257:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265226.052258:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265226.052260:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265226.052267:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789265226.052277:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417435008:0@lo:103: 00000100:00100000:3.0:1789265226.052300:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265226.053372:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265226.053385:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417435264:0@lo:103: 00010000:00010000:2.0:1789265226.053404:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6c00/0x9272d942b4a9658c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96593 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.053419:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265226.053421:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265226.053424:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265226.053430:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265226.053476:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417435136 00000100:00100000:2.0:1789265226.053484:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417435136 00010000:00010000:2.0:1789265226.053510:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fccbd2ff400/0x9272d942b4a96593 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9658c expref: 24 pid: 6508 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265226.053547:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417435008 00000100:00100000:2.0:1789265226.053551:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417435008 00010000:00010000:2.0:1789265226.053563:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc81490400/0x9272d942b4a965af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a965a8 expref: 25 pid: 7458 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265226.053586:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417435264 00000100:00100000:2.0:1789265226.053589:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417435264 00010000:00010000:2.0:1789265226.053600:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc882b6a00/0x9272d942b4a96569 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96562 expref: 26 pid: 6510 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265226.053614:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789265226.053622:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+26:3643:x1876180417435136:12345-0@lo:103: 00010000:00010000:2.0:1789265226.053634:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265226.053639:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fccbd2ff400/0x9272d942b4a96593 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9658c expref: 26 pid: 6508 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.053649:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fccbd2ff400/0x9272d942b4a96593 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a9658c expref: 26 pid: 6508 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.053681:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265226.053700:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789265226.053723:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+26:3641:x1876180417435008:12345-0@lo:103: 00000100:00100000:2.0:1789265226.053731:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+26:3643:x1876180417435136:12345-0@lo:103: Request processed in 108us (1577us total) trans 0 rc 0/0 00010000:00010000:0.0:1789265226.053733:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265226.053742:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc81490400/0x9272d942b4a965af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a965a8 expref: 26 pid: 7458 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265226.053743:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1789265226.053757:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc81490400/0x9272d942b4a965af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a965a8 expref: 26 pid: 7458 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265226.053767:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1789265226.053771:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265226.053776:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82137480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+25:3643:x1876180417435264:12345-0@lo:103: 00010000:00010000:2.0:1789265226.053786:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265226.053792:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc882b6a00/0x9272d942b4a96569 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96562 expref: 25 pid: 6510 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.053804:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc882b6a00/0x9272d942b4a96569 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a96562 expref: 25 pid: 6510 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265226.053804:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+25:3641:x1876180417435008:12345-0@lo:103: Request processed in 83us (1499us total) trans 0 rc 0/0 00010000:00010000:2.0:1789265226.053818:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265226.053821:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265226.053848:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82137480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3643:x1876180417435264:12345-0@lo:103: Request processed in 73us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265226.053855:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789265226.053921:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417435264:0@lo:103: 00000100:00100000:2.0:1789265226.053931:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417435136:0@lo:103: 00010000:00010000:2.0:1789265226.054144:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265226.055433:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417435008:0@lo:103: 00010000:00010000:1.0:1789265226.055436:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc882b6600/0x9272d942b4a9654d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a96546 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265226.055452:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc882b6600/0x9272d942b4a9654d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a96546 expref: 23 pid: 6510 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265226.055465:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180417435392:0@lo:104: 00000100:00100000:1.0:1789265226.055511:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265226.055554:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc81692a00/0x9272d942b4a9653f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a96538 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265226.055645:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc81692a00/0x9272d942b4a9653f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a96538 expref: 23 pid: 6511 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265226.055654:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180417435520:0@lo:104: 00000100:00100000:1.0:1789265226.055680:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265226.055752:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a96531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a9652a expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265226.055760:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a96531 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a9652a expref: 23 pid: 6508 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265226.055769:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180417435648:0@lo:104: 00000100:00100000:1.0:1789265226.055792:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265226.055852:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc81692600/0x9272d942b4a964f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a964eb expref: 23 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265226.055860:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc81692600/0x9272d942b4a964f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a964eb expref: 23 pid: 7458 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265226.055869:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180417435776:0@lo:104: 00000100:00100000:1.0:1789265226.055896:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265226.055914:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417435392 00000100:00100000:2.0:1789265226.055920:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417435392 00000100:00100000:2.0:1789265226.055951:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417435520 00000100:00100000:2.0:1789265226.055954:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417435520 00000100:00100000:2.0:1789265226.055964:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417435648 00000100:00100000:2.0:1789265226.055966:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417435648 00000100:00100000:2.0:1789265226.055977:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789265226.055992:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+5:10332:x1876180417435392:12345-0@lo:104: 00010000:00010000:2.0:1789265226.056003:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9654d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.056138:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265226.056145:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+5:10332:x1876180417435392:12345-0@lo:104: Request processed in 155us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265226.056152:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789265226.056169:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789265226.056177:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+4:10332:x1876180417435520:12345-0@lo:104: 00010000:00010000:2.0:1789265226.056185:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a96538 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9653f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.056217:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789265226.056222:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+4:10332:x1876180417435520:12345-0@lo:104: Request processed in 47us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265226.056227:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789265226.056240:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789265226.056247:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+3:10332:x1876180417435648:12345-0@lo:104: 00010000:00010000:2.0:1789265226.056253:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a9652a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96531 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.056283:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789265226.056288:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+3:10332:x1876180417435648:12345-0@lo:104: Request processed in 42us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265226.056293:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1789265226.056309:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789265226.056321:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9654d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.056329:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7e00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265226.056333:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a9654d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.056341:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96546 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a9654d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265226.056348:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96546 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a9654d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265226.056354:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265226.056385:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96546 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9654d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.056392:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265226.056407:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96546 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9654d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.056413:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a96546 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9654d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.056424:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265226.056428:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a96538 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9653f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.056433:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81692c00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265226.056436:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a96538 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a9653f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.056452:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a96538 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a9653f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265226.056459:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a96538 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a9653f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265226.056463:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265226.056476:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a96538 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9653f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.056482:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265226.056487:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a96538 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9653f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.056494:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc81692c00/0x9272d942b4a96538 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9653f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.056502:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265226.056505:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a9652a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96531 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.056509:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81693800 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265226.056511:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a9652a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a96531 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.056517:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a9652a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a96531 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265226.056523:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a9652a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a96531 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265226.056535:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265226.056551:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a9652a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96531 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.056557:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265226.056677:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a9652a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96531 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.056685:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a9652a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96531 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.056695:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265226.056697:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265226.056698:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265226.056714:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265226.056726:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417436160:0@lo:103: 00000100:00100000:2.0:1789265226.056756:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265226.056801:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417436160 00000100:00100000:2.0:1789265226.056806:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417436160 00010000:00010000:2.0:1789265226.056826:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a96531 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9652a expref: 24 pid: 6508 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265226.056848:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789265226.056856:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3644:x1876180417436160:12345-0@lo:103: 00010000:00010000:2.0:1789265226.056866:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265226.056870:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a96531 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9652a expref: 24 pid: 6508 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.056880:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a96531 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a9652a expref: 24 pid: 6508 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.056903:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265226.058482:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3644:x1876180417436160:12345-0@lo:103: Request processed in 1620us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265226.058495:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789265226.058505:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265226.058547:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265226.058556:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399559296 00000100:00100000:2.0:1789265226.058564:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399559296 00010000:00010000:2.0:1789265226.058659:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc882b7800/0x9272d942b4a965ee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc31 expref: 10 pid: 7458 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265226.058677:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399559424 00000100:00100000:2.0:1789265226.058680:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399559424 00010000:00010000:2.0:1789265226.058691:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc882b7c00/0x9272d942b4a965e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc2a expref: 11 pid: 7458 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265226.058713:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 29 00000100:00100000:2.0:1789265226.058720:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82134700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f6ab780-f65a-4da8-8aa9-108982c08b32+11:2396:x1876180399559296:12345-192.168.203.49@tcp:103: 00010000:00010000:2.0:1789265226.058731:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265226.058735:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc882b7800/0x9272d942b4a965ee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc31 expref: 11 pid: 7458 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.058746:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc882b7800/0x9272d942b4a965ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc31 expref: 11 pid: 7458 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.058764:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265226.058807:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82134700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f6ab780-f65a-4da8-8aa9-108982c08b32+11:2396:x1876180399559296:12345-192.168.203.49@tcp:103: Request processed in 87us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265226.058814:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 29 00000100:00100000:2.0:1789265226.058829:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 30 00000100:00100000:2.0:1789265226.058849:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82135f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:2396:x1876180399559424:12345-192.168.203.49@tcp:103: 00010000:00010000:2.0:1789265226.058857:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265226.058861:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc882b7c00/0x9272d942b4a965e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc2a expref: 10 pid: 7458 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.058870:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc882b7c00/0x9272d942b4a965e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc2a expref: 10 pid: 7458 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.058880:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265226.058899:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82135f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:2396:x1876180399559424:12345-192.168.203.49@tcp:103: Request processed in 51us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265226.058905:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 30 00000100:00100000:2.0:1789265226.058948:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417436160:0@lo:103: 00000100:00100000:2.0:1789265226.058977:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417436032:0@lo:103: 00000100:00100000:2.0:1789265226.059013:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265226.059149:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265226.059157:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417435904:0@lo:103: 00000100:00100000:2.0:1789265226.059180:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265226.059205:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417436032 00000100:00100000:2.0:1789265226.059208:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417436032 00010000:00010000:2.0:1789265226.059224:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc81692a00/0x9272d942b4a9653f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96538 expref: 24 pid: 6511 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265226.059236:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417435904 00000100:00100000:2.0:1789265226.059238:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417435904 00010000:00010000:2.0:1789265226.059248:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc882b6600/0x9272d942b4a9654d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96546 expref: 25 pid: 6510 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265226.059259:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789265226.059276:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb09a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+25:3642:x1876180417436032:12345-0@lo:103: 00000100:00100000:0.0:1789265226.059282:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1789265226.059284:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265226.059291:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc81692a00/0x9272d942b4a9653f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96538 expref: 25 pid: 6511 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265226.059299:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+25:3642:x1876180417435904:12345-0@lo:103: 00010000:00010000:2.0:1789265226.059305:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc81692a00/0x9272d942b4a9653f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a96538 expref: 25 pid: 6511 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265226.059313:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265226.059317:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265226.059329:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc882b6600/0x9272d942b4a9654d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96546 expref: 25 pid: 6510 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265226.059341:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc882b6600/0x9272d942b4a9654d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a96546 expref: 25 pid: 6510 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265226.059348:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb09a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+25:3642:x1876180417436032:12345-0@lo:103: Request processed in 76us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265226.059362:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1789265226.059366:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265226.059409:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417435904:12345-0@lo:103: Request processed in 117us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265226.059425:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417435904:0@lo:103: 00000100:00100000:0.0:1789265226.059426:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789265226.059442:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417436032:0@lo:103: 00010000:00010000:2.0:1789265226.059461:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265226.060154:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265226.062234:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc81692e00/0x9272d942b4a964c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a964c1 expref: 23 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265226.062252:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc81692e00/0x9272d942b4a964c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a964c1 expref: 23 pid: 7458 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265226.062267:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bbad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180417436288:0@lo:104: 00000100:00100000:1.0:1789265226.062325:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265226.062401:0:10332:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdf2c00 going to sleep for 11 seconds 00010000:00010000:1.0:1789265226.062433:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b7800/0x9272d942b4a965ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc31 expref: 9 pid: 7458 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265226.062450:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180417434112:192.168.203.49@tcp:104: 00010000:00010000:1.0:1789265226.062465:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b7c00/0x9272d942b4a965e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc2a expref: 8 pid: 7458 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265226.062474:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82868a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180417434240:192.168.203.49@tcp:104: 00010000:00010000:1.0:1789265226.062490:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccbd2fe200/0x9272d942b4a965d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a965d2 expref: 23 pid: 6511 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265226.062500:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82868700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180417434368:0@lo:104: 00000100:00100000:3.0:1789265226.062511:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417435776 00010000:00010000:1.0:1789265226.062514:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81490400/0x9272d942b4a965af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a965a8 expref: 22 pid: 7458 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265226.062520:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417435776 00000100:00100000:1.0:1789265226.062527:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180417434496:0@lo:104: 00010000:00010000:1.0:1789265226.062540:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccbd2ff400/0x9272d942b4a96593 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a9658c expref: 21 pid: 6508 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265226.062549:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180417434752:0@lo:104: 00010000:00010000:1.0:1789265226.062623:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b6a00/0x9272d942b4a96569 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a96562 expref: 20 pid: 6510 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265226.062634:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180417434880:0@lo:104: 00010000:00010000:1.0:1789265226.062644:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b6600/0x9272d942b4a9654d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a96546 expref: 19 pid: 6510 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265226.062665:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180417435392:0@lo:104: 00010000:00010000:1.0:1789265226.062678:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81692a00/0x9272d942b4a9653f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a96538 expref: 18 pid: 6511 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265226.062686:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180417435520:0@lo:104: 00010000:00010000:1.0:1789265226.062695:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a96531 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a9652a expref: 17 pid: 6508 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265226.062716:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180417435648:0@lo:104: 00000100:00100000:0.0:1789265226.062811:0:10338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417436288 00000100:00100000:0.0:1789265226.062816:0:10338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417436288 00000100:00100000:0.0:1789265226.062840:0:10338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789265226.062848:0:10338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+4:10332:x1876180417435776:12345-0@lo:104: 00010000:00010000:0.0:1789265226.062861:0:10338:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a964eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a964f2 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265226.062964:0:10338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789265226.062971:0:10338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+4:10332:x1876180417435776:12345-0@lo:104: Request processed in 124us (7073us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265226.062978:0:10338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789265226.062995:0:10338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789265226.063008:0:10338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+3:10332:x1876180417436288:12345-0@lo:104: 00010000:00010000:0.0:1789265226.063016:0:10338:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a964c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a964c8 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265226.063145:0:10338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789265226.063151:0:10338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+3:10332:x1876180417436288:12345-0@lo:104: Request processed in 144us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265226.063157:0:10338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789265226.063242:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180417435776:0@lo:104: 00000100:00100000:1.0:1789265226.063250:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bbad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180417436288:0@lo:104: 00010000:00010000:1.0:1789265226.063290:0:10332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fccbd2fe400/0x9272d942b4a9662d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.063390:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265226.063397:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a964eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a964f2 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.063404:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520b400 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265226.063408:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a964eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a964f2 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.063416:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a964eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a964f2 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265226.063423:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a964eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a964f2 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265226.063437:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265226.063507:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a964eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a964f2 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.063513:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265226.063544:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a964eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a964f2 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.063553:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a964eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a964f2 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.063629:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265226.063634:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a964c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a964c8 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.063641:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81491000 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265226.063644:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a964c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a964c8 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.063650:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a964c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a964c8 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265226.063656:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a964c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a964c8 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265226.063662:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789265226.063690:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265226.063711:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417436416:0@lo:103: 00000100:00100000:1.0:1789265226.063746:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265226.063866:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a964c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a964c8 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.063873:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265226.063906:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a964c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a964c8 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.063913:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a964c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a964c8 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.063929:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265226.063931:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265226.063932:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265226.063944:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417436416 00000100:00100000:2.0:1789265226.063948:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417436416 00010000:00010000:2.0:1789265226.063970:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc81692600/0x9272d942b4a964f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a964eb expref: 17 pid: 7458 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265226.063974:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417436544:0@lo:103: 00000100:00100000:2.0:1789265226.063994:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789265226.064002:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+17:3643:x1876180417436416:12345-0@lo:103: 00010000:00010000:2.0:1789265226.064012:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265226.064018:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc81692600/0x9272d942b4a964f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a964eb expref: 17 pid: 7458 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265226.064092:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265226.064129:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417436544 00000100:00100000:3.0:1789265226.064133:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417436544 00010000:00010000:3.0:1789265226.064219:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc81692e00/0x9272d942b4a964c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a964c1 expref: 18 pid: 7458 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.064222:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc81692600/0x9272d942b4a964f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a964eb expref: 18 pid: 7458 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.064247:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81692600/0x9272d942b4a964f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a964eb expref: 18 pid: 7458 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265226.064254:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789265226.064264:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+17:3641:x1876180417436544:12345-0@lo:103: 00010000:00010000:2.0:1789265226.064264:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265226.064274:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265226.064286:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc81692e00/0x9272d942b4a964c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a964c1 expref: 17 pid: 7458 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265226.064297:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc81692e00/0x9272d942b4a964c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a964c1 expref: 17 pid: 7458 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265226.064308:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+17:3643:x1876180417436416:12345-0@lo:103: Request processed in 306us (560us total) trans 0 rc 0/0 00010000:00010000:3.0:1789265226.064310:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81692e00/0x9272d942b4a964c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a964c1 expref: 17 pid: 7458 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265226.064325:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:3.0:1789265226.064330:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fccbd2fe400/0x9272d942b4a9662d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265226.064339:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2fe400/0x9272d942b4a9662d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265226.064353:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fccbd2fe400/0x9272d942b4a9662d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265226.064359:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417436416:0@lo:103: 00010000:00010000:3.0:1789265226.064363:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fccbd2fe400/0x9272d942b4a9662d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265226.064375:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fccbd2fe400/0x9272d942b4a9662d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265226.064382:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fccbd2fe400/0x9272d942b4a9662d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265226.064387:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fe400 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265226.064391:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fccbd2fe400/0x9272d942b4a9662d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.064393:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265226.064401:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fccbd2fe400/0x9272d942b4a9662d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265226.064429:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fccbd2fe400/0x9272d942b4a9662d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265226.064439:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265226.064472:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+15:3641:x1876180417436544:12345-0@lo:103: Request processed in 208us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265226.064479:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789265226.064508:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417436544:0@lo:103: 00010000:00010000:2.0:1789265226.064685:0:10332:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fccbd2fe400/0x9272d942b4a9662d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.064694:0:10332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fccbd2fe400/0x9272d942b4a9662d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265226.064701:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccbd2fe400/0x9272d942b4a9662d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265226.241366:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417436672:0@lo:41: 00000100:00100000:1.0:1789265226.241442:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265226.241668:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417436672 00000100:00100000:0.0:1789265226.241676:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417436672 00000100:00100000:0.0:1789265226.241742:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789265226.241752:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417436672:12345-0@lo:41: 00000004:00000024:0.0:1789265226.241783:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789265226.241844:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417436672:12345-0@lo:41: Request processed in 94us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265226.241852:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789265226.242108:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417436800:0@lo:41: 00000100:00100000:1.0:1789265226.242139:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265226.242631:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417436672:0@lo:41: 00000100:00100000:3.0:1789265226.242767:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417436800 00000100:00100000:3.0:1789265226.242773:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417436800 00000100:00100000:3.0:1789265226.242815:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789265226.242823:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417436800:12345-0@lo:41: 00000004:00000024:3.0:1789265226.242846:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789265226.242902:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417436800:12345-0@lo:41: Request processed in 80us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265226.242909:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789265226.243111:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417436800:0@lo:41: 00000100:00100000:1.0:1789265226.753305:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265226.753330:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417436928:0@lo:13: 00000100:00100000:1.0:1789265226.753401:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265226.753534:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417436928 00000100:00100000:3.0:1789265226.753542:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417436928 00000100:00100000:2.0:1789265226.753635:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417437056:0@lo:13: 00000100:00100000:3.0:1789265226.753654:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789265226.753677:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265226.753679:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417436928:12345-0@lo:13: 00002000:00000024:3.0:1789265226.753726:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265226.753733:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417437056 00000100:00100000:2.0:1789265226.753738:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417437056 00000100:00100000:3.0:1789265226.753969:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417436928:12345-0@lo:13: Request processed in 295us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265226.753976:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1789265226.754058:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4faa00 x1876180417436928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265226.754077:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417436928:0@lo:13: 00000100:00080000:0.0:1789265226.754252:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265226.755797:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265226.755811:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417437056:12345-0@lo:13: 00002000:00000024:2.0:1789265226.755844:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265226.755928:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417437056:12345-0@lo:13: Request processed in 120us (2253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265226.755935:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1789265226.756066:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83bba300 x1876180417437056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265226.756111:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417437056:0@lo:13: 00010000:00010000:2.0:1789265227.075501:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265227.082634:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265227.082687:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265227.082729:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265227.082749:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399559808 00000100:00100000:0.0:1789265227.082760:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399559808 00000100:00100000:2.0:1789265227.082762:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265227.082814:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399559680 00000100:00100000:0.0:1789265227.082817:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399559680 00000100:00100000:0.0:1789265227.082836:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 57 00000100:00100000:2.0:1789265227.082840:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265227.082846:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399559808:12345-192.168.203.49@tcp:400: 00000100:00100000:2.0:1789265227.082881:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 58 00000100:00100000:2.0:1789265227.082901:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399559680:12345-192.168.203.49@tcp:400: 00000100:00100000:0.0:1789265227.082914:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399559808:12345-192.168.203.49@tcp:400: Request processed in 70us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265227.082921:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 57 00000100:00100000:2.0:1789265227.082926:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399559680:12345-192.168.203.49@tcp:400: Request processed in 28us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265227.082932:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 58 00000100:00080000:2.0:1789265227.082952:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265227.082956:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265227.083072:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399560064 00000100:00100000:3.0:1789265227.083177:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399560064 00000100:00100000:3.0:1789265227.083223:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399559936 00000100:00100000:3.0:1789265227.083228:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399559936 00000100:00100000:3.0:1789265227.083268:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 15 00000100:00100000:3.0:1789265227.083276:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399560064:12345-192.168.203.49@tcp:400: 00000100:00100000:3.0:1789265227.083313:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399560064:12345-192.168.203.49@tcp:400: Request processed in 38us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265227.083319:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 15 00000100:00100000:3.0:1789265227.083332:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 16 00000100:00100000:3.0:1789265227.083338:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399559936:12345-192.168.203.49@tcp:400: 00000100:00100000:3.0:1789265227.083360:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399559936:12345-192.168.203.49@tcp:400: Request processed in 23us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265227.083366:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 16 00000100:00080000:0.0:1789265227.083617:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265227.083621:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265227.083793:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399559552 00000100:00100000:1.0:1789265227.083799:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399559552 00000100:00100000:1.0:1789265227.083842:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 199 00000100:00100000:1.0:1789265227.083850:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f6ab780-f65a-4da8-8aa9-108982c08b32+8:2396:x1876180399559552:12345-192.168.203.49@tcp:400: 00000100:00100000:1.0:1789265227.083892:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f6ab780-f65a-4da8-8aa9-108982c08b32+8:2396:x1876180399559552:12345-192.168.203.49@tcp:400: Request processed in 43us (1270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265227.083899:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 199 10000000:01000000:0.0:1789265227.329181:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789265227.329189:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fccbf44d000 from 48 10000000:01000000:0.0:1789265227.329195:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789265227.329371:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc8152e200/0x9272d942b4a96634 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265227.329390:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc8152e200/0x9272d942b4a96634 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265227.329403:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc8152e200/0x9272d942b4a96634 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265227.329428:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82137b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417437184:0@lo:101: 00000100:00100000:0.0:1789265227.329519:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265227.329625:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3e2600 going to sleep for 11 seconds 00000100:00100000:3.0:1789265227.331586:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417437184 00000100:00100000:3.0:1789265227.331600:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417437184 00000100:00100000:3.0:1789265227.331741:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789265227.331753:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+15:6513:x1876180417437184:12345-0@lo:101: 00010000:00010000:3.0:1789265227.331770:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265227.331788:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc80031400/0x9272d942b4a9663b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96634 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265227.331816:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc80031400/0x9272d942b4a9663b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96634 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265227.331847:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc80031400/0x9272d942b4a9663b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96634 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265227.331856:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc80031400, rc 0) 00000100:00100000:3.0:1789265227.331936:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+16:6513:x1876180417437184:12345-0@lo:101: Request processed in 185us (2416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265227.331943:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789265227.332072:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82137b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417437184:0@lo:101: 00010000:00010000:0.0:1789265227.332089:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc8152e200/0x9272d942b4a96634 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9663b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265227.332099:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc8152e200/0x9272d942b4a96634 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9663b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265227.332178:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82137b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417437312:0@lo:501: 00000100:00100000:0.0:1789265227.332209:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265227.334071:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3e2600 going to sleep for 11 seconds 00000100:00100000:2.0:1789265227.334274:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417437312 00000100:00100000:2.0:1789265227.334282:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417437312 00000100:00100000:2.0:1789265227.334327:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789265227.334335:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+16:6513:x1876180417437312:12345-0@lo:501: 00000100:00100000:2.0:1789265227.334495:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+16:6513:x1876180417437312:12345-0@lo:501: Request processed in 159us (2284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265227.334502:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789265227.334712:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82137b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417437312:0@lo:501: 00000100:00100000:0.0:1789265227.334756:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82137b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417437440:0@lo:503: 00000100:00100000:0.0:1789265227.334801:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265227.334834:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3e2600 going to sleep for 11 seconds 00000100:00100000:2.0:1789265227.334883:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417437440 00000100:00100000:2.0:1789265227.334887:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417437440 00000100:00100000:2.0:1789265227.334941:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789265227.334948:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+16:6513:x1876180417437440:12345-0@lo:503: 00000100:00100000:2.0:1789265227.335051:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+16:6513:x1876180417437440:12345-0@lo:503: Request processed in 95us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265227.335058:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789265227.335350:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82137b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417437440:0@lo:503: 00000100:00100000:0.0:1789265227.335559:0:10350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82137b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10350:1876180417437568:0@lo:502: 00000100:00100000:0.0:1789265227.335594:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265227.335615:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417437568 00000100:00100000:0.0:1789265227.335618:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417437568 00000100:00100000:0.0:1789265227.335638:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789265227.335644:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+16:10350:x1876180417437568:12345-0@lo:502: 00000100:00100000:0.0:1789265227.335733:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+16:10350:x1876180417437568:12345-0@lo:502: Request processed in 89us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265227.335740:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789265227.335774:0:10350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3e2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265227.335785:0:10350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82137b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10350:1876180417437568:0@lo:502: 00000100:00100000:0.0:1789265227.335816:0:10350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82137b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10350:1876180417437696:0@lo:502: 00000100:00100000:0.0:1789265227.335842:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265227.335860:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417437696 00000100:00100000:0.0:1789265227.335863:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417437696 00000100:00100000:0.0:1789265227.335877:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789265227.335882:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+16:10350:x1876180417437696:12345-0@lo:502: 00000100:00100000:0.0:1789265227.335929:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+16:10350:x1876180417437696:12345-0@lo:502: Request processed in 46us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265227.335935:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789265227.335957:0:10350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3e2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265227.335967:0:10350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82137b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10350:1876180417437696:0@lo:502: 00000040:00080000:0.0:1789265227.335982:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789265227.336358:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789265227.336387:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789265227.336396:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc8152e200/0x9272d942b4a96634 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9663b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265227.336407:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc8152e200/0x9272d942b4a96634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9663b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265227.336417:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789265227.336419:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1789265227.336422:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789265227.336443:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f600/0x9272d942b4a96642 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265227.336451:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f600/0x9272d942b4a96642 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265227.336513:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f600/0x9272d942b4a96642 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265227.336527:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82137b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417437824:0@lo:101: 00000100:00100000:0.0:1789265227.336554:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265227.336567:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3e2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265227.336580:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417437824 00000100:00100000:0.0:1789265227.336583:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417437824 00000100:00100000:0.0:1789265227.336601:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789265227.336606:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+16:6513:x1876180417437824:12345-0@lo:101: 00010000:00010000:0.0:1789265227.336614:0:7458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265227.336626:0:7458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc8152e800/0x9272d942b4a96649 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96642 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265227.336655:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc8152e800/0x9272d942b4a96649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96642 expref: 17 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265227.336665:0:7458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc8152e800/0x9272d942b4a96649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96642 expref: 17 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265227.336674:0:7458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc8152e800, rc 0) 00000100:00100000:0.0:1789265227.336713:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417437824:12345-0@lo:101: Request processed in 106us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265227.336719:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789265227.336751:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82137b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417437824:0@lo:101: 00010000:00010000:0.0:1789265227.336761:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f600/0x9272d942b4a96642 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96649 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265227.336769:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f600/0x9272d942b4a96642 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96649 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265227.336809:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82137b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417437952:0@lo:501: 00000100:00100000:0.0:1789265227.336833:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265227.336845:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3e2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265227.336855:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417437952 00000100:00100000:0.0:1789265227.336858:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417437952 00000100:00100000:0.0:1789265227.336876:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789265227.336882:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417437952:12345-0@lo:501: 00000100:00100000:0.0:1789265227.336966:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417437952:12345-0@lo:501: Request processed in 84us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265227.336973:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789265227.338828:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82137b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417437952:0@lo:501: 00000100:00100000:0.0:1789265227.338897:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82137b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417438080:0@lo:503: 00000100:00100000:0.0:1789265227.338969:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265227.339019:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3e2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265227.339419:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417438080 00000100:00100000:2.0:1789265227.339428:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417438080 00000100:00100000:2.0:1789265227.339489:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789265227.339499:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417438080:12345-0@lo:503: 00000100:00100000:2.0:1789265227.339616:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417438080:12345-0@lo:503: Request processed in 119us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265227.339625:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789265227.339897:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82137b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417438080:0@lo:503: 00000100:00100000:3.0:1789265227.340856:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10351:1876180417438208:0@lo:502: 00000100:00100000:3.0:1789265227.340928:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265227.341315:0:10351:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cd4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265227.341373:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417438208 00000100:00100000:0.0:1789265227.341379:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417438208 00000100:00100000:0.0:1789265227.341447:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789265227.341765:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+17:10351:x1876180417438208:12345-0@lo:502: 00000100:00100000:0.0:1789265227.341885:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+17:10351:x1876180417438208:12345-0@lo:502: Request processed in 429us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265227.341892:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789265227.341970:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10351:1876180417438208:0@lo:502: 00000020:01000000:3.0:1789265227.341998:0:10351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265227.342017:0:10351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265227.342019:0:10351:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789265227.342042:0:10351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789265227.342068:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10351:1876180417438336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265227.342112:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265227.342474:0:10351:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cd4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265227.342654:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417438336 00000100:00100000:2.0:1789265227.342661:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417438336 00000100:00100000:2.0:1789265227.342711:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789265227.342729:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+17:10351:x1876180417438336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265227.342820:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+17:10351:x1876180417438336:12345-0@lo:502:llog_process_th.0 Request processed in 101us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265227.342827:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789265227.342950:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10351:1876180417438336:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789265227.342973:0:10351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265227.342978:0:10351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265227.342980:0:10351:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789265227.342984:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1789265227.343360:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1789265227.343386:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789265227.343397:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f600/0x9272d942b4a96642 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96649 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265227.343408:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f600/0x9272d942b4a96642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96649 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265227.343418:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789265227.343421:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fccbd2a9800 from 48 10000000:01000000:2.0:1789265227.343424:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789265227.343454:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96650 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265227.343461:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96650 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265227.343471:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96650 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265227.343487:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417438464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265227.343534:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265227.343579:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265227.343623:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417438464 00000100:00100000:3.0:1789265227.343629:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417438464 00000100:00100000:3.0:1789265227.343665:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789265227.343672:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+17:6513:x1876180417438464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265227.343687:0:7458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265227.343710:0:7458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc80031000/0x9272d942b4a96657 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96650 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265227.343813:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc80031000/0x9272d942b4a96657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96650 expref: 18 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265227.343828:0:7458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc80031000/0x9272d942b4a96657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96650 expref: 18 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265227.343837:0:7458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc80031000, rc 0) 00000100:00100000:3.0:1789265227.343878:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+18:6513:x1876180417438464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265227.343884:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789265227.343949:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417438464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265227.343962:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96650 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96657 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265227.343970:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96650 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96657 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265227.344059:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417438592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265227.344088:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265227.344108:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265227.344326:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417438592 00000100:00100000:3.0:1789265227.344330:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417438592 00000100:00100000:3.0:1789265227.344362:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789265227.344369:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+18:6513:x1876180417438592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265227.344479:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+18:6513:x1876180417438592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265227.344486:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789265227.344560:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417438592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265227.344587:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417438720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265227.344945:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265227.344966:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265227.345046:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417438720 00000100:00100000:3.0:1789265227.345051:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417438720 00000100:00100000:3.0:1789265227.345080:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789265227.345086:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+18:6513:x1876180417438720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265227.345364:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+18:6513:x1876180417438720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 277us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265227.345382:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789265227.345449:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417438720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265227.345795:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c11880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10352:1876180417438848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265227.345835:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265227.345891:0:10352:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da0600 going to sleep for 11 seconds 00000100:00100000:0.0:1789265227.345957:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417438848 00000100:00100000:0.0:1789265227.345962:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417438848 00000100:00100000:1.0:1789265227.346049:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789265227.346059:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+18:10352:x1876180417438848:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265227.346164:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+18:10352:x1876180417438848:12345-0@lo:502:llog_process_th.0 Request processed in 94us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265227.346171:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789265227.346332:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c11880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10352:1876180417438848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265227.346373:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c11880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10352:1876180417438976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265227.346407:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265227.346764:0:10352:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da0600 going to sleep for 11 seconds 00000100:00100000:3.0:1789265227.346800:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417438976 00000100:00100000:3.0:1789265227.346805:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417438976 00000100:00100000:3.0:1789265227.346830:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789265227.346837:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+18:10352:x1876180417438976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265227.346959:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+18:10352:x1876180417438976:12345-0@lo:502:llog_process_th.0 Request processed in 121us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265227.346966:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789265227.347389:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c11880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10352:1876180417438976:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789265227.347421:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789265227.347639:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789265227.347659:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789265227.347671:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96650 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96657 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265227.347682:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96657 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265227.347693:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789265227.347708:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1789265227.347712:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789265227.347740:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc80031e00/0x9272d942b4a9665e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265227.347749:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc80031e00/0x9272d942b4a9665e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265227.347758:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc80031e00/0x9272d942b4a9665e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265227.347775:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417439104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789265227.347827:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265227.347891:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cd4600 going to sleep for 11 seconds 00000100:00100000:2.0:1789265227.347928:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417439104 00000100:00100000:2.0:1789265227.347933:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417439104 00000100:00100000:2.0:1789265227.347996:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789265227.348014:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+18:6513:x1876180417439104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265227.348055:0:7458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265227.348069:0:7458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccb520ae00/0x9272d942b4a96665 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9665e expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265227.348091:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccb520ae00/0x9272d942b4a96665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9665e expref: 19 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265227.348101:0:7458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccb520ae00/0x9272d942b4a96665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9665e expref: 19 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265227.348109:0:7458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520ae00, rc 0) 00000100:00100000:2.0:1789265227.348143:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+19:6513:x1876180417439104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265227.348314:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789265227.348388:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417439104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265227.348401:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc80031e00/0x9272d942b4a9665e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96665 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265227.348411:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc80031e00/0x9272d942b4a9665e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96665 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265227.348464:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82137b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417439232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265227.348491:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265227.348615:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccae763b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265227.348692:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417439232 00000100:00100000:3.0:1789265227.348705:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417439232 00000100:00100000:3.0:1789265227.348768:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789265227.348776:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+19:6513:x1876180417439232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265227.348880:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+19:6513:x1876180417439232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265227.348886:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789265227.348957:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82137b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417439232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265227.348985:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82137b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417439360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265227.349064:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265227.349078:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccae763b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265227.349091:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417439360 00000100:00100000:0.0:1789265227.349094:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417439360 00000100:00100000:0.0:1789265227.349116:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789265227.349122:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+19:6513:x1876180417439360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265227.349210:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+19:6513:x1876180417439360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265227.349216:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789265227.349384:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82137b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417439360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265227.349815:0:10353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82137b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10353:1876180417439488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265227.349854:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265227.349888:0:10353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3e20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265227.350326:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417439488 00000100:00100000:3.0:1789265227.350332:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417439488 00000100:00100000:3.0:1789265227.350361:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789265227.350369:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+19:10353:x1876180417439488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265227.350458:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+19:10353:x1876180417439488:12345-0@lo:502:llog_process_th.0 Request processed in 89us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265227.350465:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789265227.350549:0:10353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82137b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10353:1876180417439488:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265227.350574:0:10353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265227.350582:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265227.350585:0:10353:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789265227.350589:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789265227.350608:0:10353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82137b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10353:1876180417439616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265227.350639:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265227.350663:0:10353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccae763b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265227.350716:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417439616 00000100:00100000:3.0:1789265227.350720:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417439616 00000100:00100000:3.0:1789265227.350776:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789265227.350782:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+19:10353:x1876180417439616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265227.350840:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+19:10353:x1876180417439616:12345-0@lo:502:llog_process_th.0 Request processed in 58us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265227.350847:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789265227.350985:0:10353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82137b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10353:1876180417439616:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789265227.351014:0:10353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265227.351019:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265227.351039:0:10353:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789265227.351045:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1789265227.351255:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1789265227.351277:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789265227.351287:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc80031e00/0x9272d942b4a9665e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96665 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265227.351297:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc80031e00/0x9272d942b4a9665e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96665 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265227.351306:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789265227.351309:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fccad90a000 from 48 10000000:01000000:2.0:1789265227.351318:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789265227.351345:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520a000/0x9272d942b4a9666c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265227.351353:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccb520a000/0x9272d942b4a9666c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265227.351361:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccb520a000/0x9272d942b4a9666c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265227.351375:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417439744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265227.351411:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265227.351433:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da0180 going to sleep for 11 seconds 00000100:00100000:3.0:1789265227.351646:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417439744 00000100:00100000:3.0:1789265227.351651:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417439744 00000100:00100000:3.0:1789265227.351687:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789265227.351706:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+19:6513:x1876180417439744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265227.351722:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265227.351736:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc80031a00/0x9272d942b4a96673 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9666c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265227.351759:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc80031a00/0x9272d942b4a96673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9666c expref: 20 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265227.351769:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc80031a00/0x9272d942b4a96673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9666c expref: 20 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265227.351779:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc80031a00, rc 0) 00000100:00100000:3.0:1789265227.351825:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+20:6513:x1876180417439744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265227.351831:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789265227.351914:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417439744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265227.351928:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccb520a000/0x9272d942b4a9666c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96673 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265227.351938:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccb520a000/0x9272d942b4a9666c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96673 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265227.352012:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417439872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265227.352084:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265227.352103:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdf23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265227.352317:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417439872 00000100:00100000:3.0:1789265227.352321:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417439872 00000100:00100000:3.0:1789265227.352357:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789265227.352363:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+20:6513:x1876180417439872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265227.352466:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+20:6513:x1876180417439872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265227.352473:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789265227.352604:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417439872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265227.352635:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417440000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265227.352681:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265227.352715:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdf23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265227.352756:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417440000 00000100:00100000:3.0:1789265227.352760:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417440000 00000100:00100000:3.0:1789265227.352787:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1789265227.352794:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+20:6513:x1876180417440000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265227.352864:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+20:6513:x1876180417440000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265227.352880:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789265227.352996:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417440000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265227.353645:0:10354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c11f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10354:1876180417440128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265227.353710:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265227.353766:0:10354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265227.353799:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417440128 00000100:00100000:3.0:1789265227.353804:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417440128 00000100:00100000:3.0:1789265227.353867:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789265227.353876:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+20:10354:x1876180417440128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265227.354044:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+20:10354:x1876180417440128:12345-0@lo:502:llog_process_th.0 Request processed in 146us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265227.354052:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789265227.354421:0:10354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c11f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10354:1876180417440128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265227.354468:0:10354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82135180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10354:1876180417440256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265227.354506:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265227.354543:0:10354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3e20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265227.354588:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417440256 00000100:00100000:2.0:1789265227.354592:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417440256 00000100:00100000:2.0:1789265227.354631:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789265227.354640:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+20:10354:x1876180417440256:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265227.354741:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+20:10354:x1876180417440256:12345-0@lo:502:llog_process_th.0 Request processed in 102us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265227.354748:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789265227.354825:0:10354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82135180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10354:1876180417440256:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789265227.354847:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789265227.354990:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789265227.355050:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789265227.355060:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520a000/0x9272d942b4a9666c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96673 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265227.355071:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccb520a000/0x9272d942b4a9666c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96673 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265227.355088:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789265227.355090:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1789265227.355093:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789265227.355115:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520b000/0x9272d942b4a9667a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265227.355122:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccb520b000/0x9272d942b4a9667a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265227.355130:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccb520b000/0x9272d942b4a9667a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265227.355144:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c11f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417440384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265227.355182:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265227.355202:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265227.355510:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417440384 00000100:00100000:0.0:1789265227.355515:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417440384 00000100:00100000:0.0:1789265227.355556:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789265227.355563:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+20:6513:x1876180417440384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265227.355572:0:7458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265227.355584:0:7458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc8152ea00/0x9272d942b4a96681 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9667a expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265227.355605:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc8152ea00/0x9272d942b4a96681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9667a expref: 21 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265227.355614:0:7458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc8152ea00/0x9272d942b4a96681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9667a expref: 21 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265227.355623:0:7458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc8152ea00, rc 0) 00000100:00100000:0.0:1789265227.355657:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417440384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265227.355663:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789265227.355742:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c11f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417440384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265227.355755:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccb520b000/0x9272d942b4a9667a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96681 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265227.355763:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccb520b000/0x9272d942b4a9667a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96681 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265227.355810:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c11f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417440512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265227.355835:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265227.355857:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265227.355899:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417440512 00000100:00100000:0.0:1789265227.355903:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417440512 00000100:00100000:0.0:1789265227.355937:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789265227.355944:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417440512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265227.356075:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417440512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265227.356082:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789265227.356180:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c11f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417440512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265227.356207:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c11f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417440640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265227.356374:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265227.356405:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265227.356597:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417440640 00000100:00100000:0.0:1789265227.356602:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417440640 00000100:00100000:0.0:1789265227.356637:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789265227.356645:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417440640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265227.356736:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417440640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265227.356743:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789265227.356820:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c11f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417440640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265227.357649:0:10355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c11f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10355:1876180417440768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265227.357704:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265227.357759:0:10355:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265227.357788:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417440768 00000100:00100000:0.0:1789265227.357792:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417440768 00000100:00100000:0.0:1789265227.357846:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789265227.357853:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+21:10355:x1876180417440768:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265227.357940:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+21:10355:x1876180417440768:12345-0@lo:502:llog_process_th.0 Request processed in 88us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265227.357947:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789265227.358010:0:10355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c11f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10355:1876180417440768:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789265227.358063:0:10355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265227.358071:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265227.358074:0:10355:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789265227.358079:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789265227.358100:0:10355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10355:1876180417440896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265227.358136:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265227.358411:0:10355:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cd4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265227.358462:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417440896 00000100:00100000:2.0:1789265227.358466:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417440896 00000100:00100000:2.0:1789265227.358495:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789265227.358502:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+21:10355:x1876180417440896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265227.358578:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+21:10355:x1876180417440896:12345-0@lo:502:llog_process_th.0 Request processed in 76us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265227.358584:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789265227.358650:0:10355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10355:1876180417440896:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789265227.358669:0:10355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265227.358673:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265227.358674:0:10355:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789265227.358678:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1789265227.358816:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1789265227.358833:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789265227.358842:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520b000/0x9272d942b4a9667a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96681 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265227.358853:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccb520b000/0x9272d942b4a9667a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96681 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265227.358862:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789265227.358865:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fcc8a583000 from 48 10000000:01000000:2.0:1789265227.358867:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789265227.358888:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520a400/0x9272d942b4a96688 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265227.358897:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccb520a400/0x9272d942b4a96688 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265227.358912:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccb520a400/0x9272d942b4a96688 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265227.358926:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417441024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265227.358964:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265227.358984:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265227.359048:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417441024 00000100:00100000:3.0:1789265227.359053:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417441024 00000100:00100000:3.0:1789265227.359079:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789265227.359086:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417441024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265227.359094:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265227.359114:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc80030400/0x9272d942b4a9668f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96688 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265227.359135:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc80030400/0x9272d942b4a9668f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96688 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265227.359145:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc80030400/0x9272d942b4a9668f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96688 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265227.359164:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc80030400, rc 0) 00000100:00100000:3.0:1789265227.359191:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417441024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265227.359196:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789265227.359364:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417441024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265227.359376:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccb520a400/0x9272d942b4a96688 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9668f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265227.359385:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccb520a400/0x9272d942b4a96688 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9668f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265227.359428:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417441152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265227.359454:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265227.359480:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265227.359493:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417441152 00000100:00100000:2.0:1789265227.359497:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417441152 00000100:00100000:2.0:1789265227.359514:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789265227.359519:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417441152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265227.359614:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417441152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265227.359621:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789265227.359649:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417441152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265227.359672:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417441280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265227.359723:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265227.359738:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265227.359749:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417441280 00000100:00100000:2.0:1789265227.359753:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417441280 00000100:00100000:2.0:1789265227.359770:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789265227.359776:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417441280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265227.359845:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417441280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265227.359852:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789265227.359889:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417441280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265227.360531:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c11880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10356:1876180417441408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265227.360569:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265227.360598:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265227.360634:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417441408 00000100:00100000:0.0:1789265227.360639:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417441408 00000100:00100000:0.0:1789265227.360671:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789265227.360678:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+22:10356:x1876180417441408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265227.360768:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+22:10356:x1876180417441408:12345-0@lo:502:llog_process_th.0 Request processed in 90us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265227.360775:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789265227.360844:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c11880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10356:1876180417441408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265227.360877:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c11880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10356:1876180417441536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265227.360905:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265227.360924:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265227.360974:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417441536 00000100:00100000:1.0:1789265227.360978:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417441536 00000100:00100000:1.0:1789265227.361012:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789265227.361019:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+22:10356:x1876180417441536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265227.361101:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+22:10356:x1876180417441536:12345-0@lo:502:llog_process_th.0 Request processed in 83us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265227.361108:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789265227.361195:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c11880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10356:1876180417441536:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789265227.361214:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789265227.361459:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789265227.361478:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789265227.361487:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520a400/0x9272d942b4a96688 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9668f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265227.361498:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccb520a400/0x9272d942b4a96688 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9668f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265227.361507:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789265227.361517:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1789265227.361520:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789265227.361543:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe200/0x9272d942b4a96696 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265227.361551:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe200/0x9272d942b4a96696 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265227.361559:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe200/0x9272d942b4a96696 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265227.361574:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417441664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789265227.361605:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265227.361635:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdf23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265227.361680:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417441664 00000100:00100000:2.0:1789265227.361684:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417441664 00000100:00100000:2.0:1789265227.361728:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789265227.361736:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417441664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265227.361744:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265227.361762:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccb520a200/0x9272d942b4a9669d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96696 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265227.361783:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccb520a200/0x9272d942b4a9669d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96696 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265227.361794:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccb520a200/0x9272d942b4a9669d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96696 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265227.361802:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520a200, rc 0) 00000100:00100000:2.0:1789265227.361843:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417441664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265227.361849:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789265227.361915:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417441664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265227.361928:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe200/0x9272d942b4a96696 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9669d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265227.361937:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe200/0x9272d942b4a96696 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9669d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265227.361988:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82135180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417441792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265227.362054:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265227.362069:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cb4780 going to sleep for 11 seconds 00000100:00100000:1.0:1789265227.362118:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417441792 00000100:00100000:1.0:1789265227.362122:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417441792 00000100:00100000:1.0:1789265227.362153:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789265227.362160:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417441792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265227.362320:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417441792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265227.362326:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789265227.362385:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82135180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417441792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265227.362414:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82135180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417441920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265227.362452:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265227.362477:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cb4780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265227.362491:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417441920 00000100:00100000:0.0:1789265227.362494:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417441920 00000100:00100000:0.0:1789265227.362516:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789265227.362522:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417441920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265227.362593:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417441920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265227.362600:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789265227.362636:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82135180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417441920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265227.362846:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82135180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10357:1876180417442048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265227.362880:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265227.362899:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417442048 00000100:00100000:0.0:1789265227.362903:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417442048 00000100:00100000:0.0:1789265227.362920:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789265227.362925:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+23:10357:x1876180417442048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265227.363003:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+23:10357:x1876180417442048:12345-0@lo:502:llog_process_th.0 Request processed in 77us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265227.363018:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789265227.363075:0:10357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cb4180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265227.363087:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82135180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10357:1876180417442048:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265227.363107:0:10357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265227.363115:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265227.363118:0:10357:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789265227.363123:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789265227.363143:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82135180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10357:1876180417442176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265227.363174:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265227.363193:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417442176 00000100:00100000:0.0:1789265227.363196:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417442176 00000100:00100000:0.0:1789265227.363212:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789265227.363217:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+23:10357:x1876180417442176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265227.363511:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+23:10357:x1876180417442176:12345-0@lo:502:llog_process_th.0 Request processed in 292us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265227.363518:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789265227.363552:0:10357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cb4180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265227.363565:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82135180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10357:1876180417442176:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265227.363584:0:10357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265227.363590:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265227.363591:0:10357:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789265227.363595:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1789265227.363845:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1789265227.363866:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789265227.363875:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe200/0x9272d942b4a96696 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9669d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265227.363886:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe200/0x9272d942b4a96696 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9669d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265227.363896:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789265227.363904:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fcc83f119b8 from 1 10000000:01000000:1.0:1789265227.363907:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789265227.363931:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff000/0x9272d942b4a966a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265227.363939:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff000/0x9272d942b4a966a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265227.363948:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff000/0x9272d942b4a966a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265227.363964:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417442304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789265227.363993:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265227.364201:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb821819c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265227.364396:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417442304 00000100:00100000:2.0:1789265227.364402:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417442304 00000100:00100000:2.0:1789265227.364467:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789265227.364476:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417442304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265227.364485:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265227.364496:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccb520ba00/0x9272d942b4a966ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a966a4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265227.364516:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccb520ba00/0x9272d942b4a966ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a966a4 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265227.364526:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccb520ba00/0x9272d942b4a966ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a966a4 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265227.364534:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520ba00, rc 0) 00000100:00100000:2.0:1789265227.364572:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+24:6513:x1876180417442304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265227.364588:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789265227.364644:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417442304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265227.364656:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff000/0x9272d942b4a966a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a966ab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265227.364675:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff000/0x9272d942b4a966a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a966ab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265227.364737:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82135180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417442432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265227.364765:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265227.364881:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cb4180 going to sleep for 11 seconds 00000100:00100000:3.0:1789265227.364935:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417442432 00000100:00100000:3.0:1789265227.364939:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417442432 00000100:00100000:3.0:1789265227.364998:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789265227.365006:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+24:6513:x1876180417442432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265227.365092:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+24:6513:x1876180417442432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 87us (325us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789265227.365099:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789265227.365348:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82135180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417442432:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789265227.365376:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789265227.365383:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff000/0x9272d942b4a966a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a966ab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265227.365391:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff000/0x9272d942b4a966a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a966ab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265228.097594:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265228.289521:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417442560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265228.289603:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265228.289714:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417442560 00000100:00100000:0.0:1789265228.289722:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417442560 00000100:00100000:0.0:1789265228.289796:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265228.289808:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417442560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789265228.289836:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265228.289891:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417442560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265228.289899:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1789265228.289995:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccb5c11880 x1876180417442560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265228.290013:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417442560:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789265228.290507:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265228.364734:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265228.365379:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399560192 00000100:00100000:2.0:1789265228.365392:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399560192 00000100:00100000:2.0:1789265228.365495:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 242 00000100:00100000:2.0:1789265228.365508:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+8:6163:x1876180399560192:12345-192.168.203.49@tcp:101: 00010000:00010000:2.0:1789265228.365526:0:7458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265228.365555:0:7458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccb520b200/0x9272d942b4a966b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbca1 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265228.365598:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccb520b200/0x9272d942b4a966b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbca1 expref: 9 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265228.365609:0:7458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccb520b200/0x9272d942b4a966b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbca1 expref: 9 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265228.365617:0:7458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520b200, rc 0) 00000100:00100000:2.0:1789265228.365683:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+9:6163:x1876180399560192:12345-192.168.203.49@tcp:101: Request processed in 178us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265228.365699:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 242 00000100:00100000:3.0:1789265228.369386:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265228.369515:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399560320 00000100:00100000:1.0:1789265228.369525:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399560320 00000100:00100000:1.0:1789265228.369599:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 243 00000100:00100000:1.0:1789265228.369610:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+9:6163:x1876180399560320:12345-192.168.203.49@tcp:501: 00000100:00100000:1.0:1789265228.369786:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+9:6163:x1876180399560320:12345-192.168.203.49@tcp:501: Request processed in 177us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265228.369794:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 243 00000100:00100000:3.0:1789265228.375398:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265228.377354:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399560448 00000100:00100000:0.0:1789265228.377370:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399560448 00000100:00100000:0.0:1789265228.377442:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 244 00000100:00100000:0.0:1789265228.377466:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8ad99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+9:6163:x1876180399560448:12345-192.168.203.49@tcp:503: 00000100:00100000:0.0:1789265228.377621:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8ad99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+9:6163:x1876180399560448:12345-192.168.203.49@tcp:503: Request processed in 157us (2233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265228.377630:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 244 00000100:00100000:0.0:1789265228.394476:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265228.394735:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399560576 00000100:00100000:3.0:1789265228.394746:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399560576 00000100:00100000:3.0:1789265228.394814:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 245 00000100:00100000:3.0:1789265228.394824:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8ad98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f6ab780-f65a-4da8-8aa9-108982c08b32+9:6650:x1876180399560576:12345-192.168.203.49@tcp:502: 00000100:00100000:3.0:1789265228.395239:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8ad98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f6ab780-f65a-4da8-8aa9-108982c08b32+9:6650:x1876180399560576:12345-192.168.203.49@tcp:502: Request processed in 178us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265228.395258:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 245 00000100:00100000:3.0:1789265228.403445:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265228.403894:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399560704 00000100:00100000:0.0:1789265228.403906:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399560704 00000100:00100000:0.0:1789265228.403968:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 246 00000100:00100000:0.0:1789265228.403978:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8ad99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+9:6650:x1876180399560704:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789265228.404162:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8ad99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+9:6650:x1876180399560704:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 185us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265228.404170:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 246 00000100:00100000:0.0:1789265228.408857:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265228.416109:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399560832 00000100:00100000:3.0:1789265228.416124:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399560832 00000100:00100000:3.0:1789265228.416495:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 247 00000100:00100000:3.0:1789265228.416507:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc82437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f6ab780-f65a-4da8-8aa9-108982c08b32+9:6163:x1876180399560832:12345-192.168.203.49@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265228.416524:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265228.416553:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc80030000/0x9272d942b4a966b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbca8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265228.416590:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc80030000/0x9272d942b4a966b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbca8 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265228.416600:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc80030000/0x9272d942b4a966b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbca8 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265228.416609:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc80030000, rc 0) 00000100:00100000:3.0:1789265228.416677:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc82437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:6163:x1876180399560832:12345-192.168.203.49@tcp:101:ll_cfg_requeue.0 Request processed in 172us (7830us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265228.416684:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 247 00000100:00100000:1.0:1789265228.421329:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265228.421937:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399560960 00000100:00100000:0.0:1789265228.421948:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399560960 00000100:00100000:0.0:1789265228.422100:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 248 00000100:00100000:0.0:1789265228.422112:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc82d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:6163:x1876180399560960:12345-192.168.203.49@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265228.422245:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc82d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:6163:x1876180399560960:12345-192.168.203.49@tcp:501:ll_cfg_requeue.0 Request processed in 134us (923us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789265228.422252:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 248 00000100:00100000:1.0:1789265228.801736:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265228.801759:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417442688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265228.801844:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265228.801891:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417442688 00000100:00100000:1.0:1789265228.801898:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417442688 00000100:00100000:1.0:1789265228.801951:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789265228.801960:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417442688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265228.801981:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265228.802047:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417442688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265228.802055:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1789265228.802093:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83bb8700 x1876180417442688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265228.802109:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417442688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265228.802431:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417443072:0@lo:400:kworker.0 00000100:00100000:1.0:1789265228.802636:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417442816:0@lo:400:kworker.0 00000100:00100000:1.0:1789265228.802674:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265228.802714:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417443328:0@lo:400:kworker.0 00000100:00100000:1.0:1789265228.802739:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265228.802758:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417443840:0@lo:400:kworker.0 00000100:00100000:1.0:1789265228.802782:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265228.802804:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789265228.802810:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417443200:0@lo:400:kworker.0 00000100:00100000:1.0:1789265228.802847:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265228.802865:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417443712:0@lo:400:kworker.0 00000100:00100000:1.0:1789265228.802885:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265228.802918:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417444224:0@lo:400:kworker.0 00000100:00100000:1.0:1789265228.802939:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265228.802965:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417442816 00000100:00100000:1.0:1789265228.802970:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417442816 00000100:00100000:1.0:1789265228.803003:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789265228.803011:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc82d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3644:x1876180417442816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265228.803076:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc82d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3644:x1876180417442816:12345-0@lo:400:kworker.0 Request processed in 66us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265228.803083:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789265228.803108:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417443328 00000100:00100000:1.0:1789265228.803112:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417443328 00000100:00100000:1.0:1789265228.803136:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789265228.803142:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417443328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265228.803170:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417443328:12345-0@lo:400:kworker.0 Request processed in 27us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265228.803175:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789265228.803190:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417443840 00000100:00100000:1.0:1789265228.803193:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417443840 00000100:00100000:1.0:1789265228.803232:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417443712 00000100:00100000:1.0:1789265228.803235:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417443712 00000100:00100000:1.0:1789265228.803248:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417444224 00000100:00100000:1.0:1789265228.803251:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417444224 00000100:00100000:1.0:1789265228.803263:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789265228.803269:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417443840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265228.803299:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417443840:12345-0@lo:400:kworker.0 Request processed in 30us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265228.803305:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789265228.803316:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789265228.803330:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417443712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265228.803360:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417443712:12345-0@lo:400:kworker.0 Request processed in 31us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265228.803365:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789265228.803376:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789265228.803382:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417444224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265228.803410:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417444224:12345-0@lo:400:kworker.0 Request processed in 28us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265228.803416:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789265228.803448:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417443200 00000100:00100000:1.0:1789265228.803452:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417443200 00000100:00100000:1.0:1789265228.803478:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789265228.803485:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417443200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265228.803517:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417443200:12345-0@lo:400:kworker.0 Request processed in 33us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265228.803523:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789265228.803566:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417443200:0@lo:400:kworker.0 00010000:00080000:1.0:1789265228.803578:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc8376e680 x1876180417443712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265228.803588:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417443712:0@lo:400:kworker.0 00010000:00080000:1.0:1789265228.803596:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd23c380 x1876180417444224/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265228.803604:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417444224:0@lo:400:kworker.0 00000100:00100000:1.0:1789265228.803612:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417442816:0@lo:400:kworker.0 00000100:00100000:1.0:1789265228.803631:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417443328:0@lo:400:kworker.0 00010000:00080000:1.0:1789265228.803639:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd23c000 x1876180417443840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265228.803646:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417443840:0@lo:400:kworker.0 00000100:00100000:1.0:1789265228.803704:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417442944:0@lo:400:kworker.0 00000100:00100000:1.0:1789265228.803734:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265228.803755:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417443456:0@lo:400:kworker.0 00000100:00100000:1.0:1789265228.803779:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265228.803796:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876180417443968:0@lo:400:kworker.0 00000100:00100000:0.0:1789265228.803803:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417442944 00000100:00100000:0.0:1789265228.803810:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417442944 00000100:00100000:1.0:1789265228.803823:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265228.803844:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417443456 00000100:00100000:0.0:1789265228.803849:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417443456 00000100:00100000:1.0:1789265228.803859:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417443968 00000100:00100000:1.0:1789265228.803864:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417443968 00000100:00100000:0.0:1789265228.803875:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789265228.803884:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417442944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265228.803897:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789265228.803906:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417443456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265228.803917:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789265228.803929:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876180417443968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265228.804942:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417443456:12345-0@lo:400:kworker.0 Request processed in 1035us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265228.804952:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1789265228.805009:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265228.805014:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265228.805016:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265228.809415:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417442944:12345-0@lo:400:kworker.0 Request processed in 5519us (5666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265228.809432:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789265228.809601:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876180417443968:12345-0@lo:400:kworker.0 Request processed in 5674us (5777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265228.809609:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417442944:0@lo:400:kworker.0 00000100:00100000:2.0:1789265228.809615:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789265228.809633:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417443456:0@lo:400:kworker.0 00000100:00100000:1.0:1789265228.809648:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876180417443968:0@lo:400:kworker.0 00000100:00100000:3.0:1789265228.813191:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265228.813286:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417443584:0@lo:400:kworker.0 00000100:00100000:3.0:1789265228.813316:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265228.813341:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417444096:0@lo:400:kworker.0 00000100:00100000:3.0:1789265228.813359:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265228.813963:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417443584 00000100:00100000:2.0:1789265228.813973:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417443584 00000100:00100000:2.0:1789265228.814056:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417444096 00000100:00100000:2.0:1789265228.814060:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417444096 00000100:00100000:2.0:1789265228.814089:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789265228.814098:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417443584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265228.814162:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417443584:12345-0@lo:400:kworker.0 Request processed in 64us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265228.814169:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789265228.814187:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789265228.814193:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876180417444096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265228.814220:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876180417444096:12345-0@lo:400:kworker.0 Request processed in 28us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265228.814226:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1789265228.814705:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789265228.814740:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4faa00 x1876180417443584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265228.814756:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417443584:0@lo:400:kworker.0 00010000:00080000:3.0:1789265228.814767:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd23e300 x1876180417444096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265228.814775:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417444096:0@lo:400:kworker.0 00000100:00100000:0.0:1789265228.815974:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417443072 00000100:00100000:0.0:1789265228.815985:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417443072 00000100:00100000:0.0:1789265228.816209:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789265228.816220:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417443072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265228.816305:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417443072:12345-0@lo:400:kworker.0 Request processed in 88us (3123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265228.816312:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789265228.816469:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417443072:0@lo:400:kworker.0 00010000:00010000:2.0:1789265229.121975:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265230.145295:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789265230.625900:0:10395:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed65444a0 20000000:00000080:1.0:1789265230.625924:0:10395:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fccbf4f5800 uarg=0000000000000000 20000000:01000000:1.0:1789265230.625982:0:10395:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789265230.625990:0:10395:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789265230.625996:0:10395:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789265230.629844:0:10396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789265230.634000:0:10395:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789265230.639569:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789265230.639614:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789265230.639628:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789265230.639650:0:10395:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789265230.639687:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fccbd2fe600/0x9272d942b4a966c0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265230.639713:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc882b6200/0x9272d942b4a9635c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96355 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265230.639722:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc81491600/0x9272d942b4a9636a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96363 expref: 23 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265230.639728:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc81491e00/0x9272d942b4a963be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a963b7 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265230.639737:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc81490000/0x9272d942b4a964e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a964dd expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265230.639748:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a965fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc69 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265230.639757:0:10395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fccbd2fe600/0x9272d942b4a966c0 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265230.639837:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a965fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc69 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265230.639857:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a965fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc69 expref: 9 pid: 6511 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265230.639877:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1876180417444352:192.168.203.49@tcp:104: 00010000:00010000:1.0:1789265230.642994:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc81490000/0x9272d942b4a964e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a964dd expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265230.643018:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc81490000/0x9272d942b4a964e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a964dd expref: 23 pid: 6511 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265230.643065:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1876180417444480:0@lo:104: 00000100:00100000:1.0:1789265230.643132:0:10395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265230.643197:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc81491e00/0x9272d942b4a963be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a963b7 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265230.643217:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc81491e00/0x9272d942b4a963be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a963b7 expref: 23 pid: 6511 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265230.643227:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1876180417444608:0@lo:104: 00000100:00100000:1.0:1789265230.643256:0:10395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265230.643290:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc81491600/0x9272d942b4a9636a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a96363 expref: 23 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265230.643298:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc81491600/0x9272d942b4a9636a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a96363 expref: 23 pid: 7458 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265230.643320:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789265230.643331:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1876180417444736:0@lo:104: 00000100:00100000:3.0:1789265230.643336:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417444480 00000100:00100000:3.0:1789265230.643344:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417444480 00000100:00100000:1.0:1789265230.643352:0:10395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265230.643379:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc882b6200/0x9272d942b4a9635c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a96355 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265230.643387:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcc882b6200/0x9272d942b4a9635c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a96355 expref: 23 pid: 6511 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265230.643391:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417444608 00000100:00100000:3.0:1789265230.643394:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417444608 00000100:00100000:1.0:1789265230.643395:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1876180417444864:0@lo:104: 00000100:00100000:3.0:1789265230.643405:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417444736 00000100:00100000:3.0:1789265230.643407:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417444736 00000100:00100000:1.0:1789265230.643414:0:10395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265230.643417:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417444864 00000100:00100000:3.0:1789265230.643420:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417444864 00000100:00100000:1.0:1789265230.643424:0:10395:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3e2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265230.643434:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789265230.643443:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+6:10395:x1876180417444480:12345-0@lo:104: 00010000:00010000:3.0:1789265230.643467:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a964dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a964e4 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265230.643541:0:10338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00010000:00010000:3.0:1789265230.643543:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789265230.643552:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+6:10395:x1876180417444480:12345-0@lo:104: Request processed in 109us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265230.643563:0:10338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+6:10395:x1876180417444608:12345-0@lo:104: 00000100:00100000:3.0:1789265230.643564:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:0.0:1789265230.643577:0:10338:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a963b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a963be expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265230.643588:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789265230.643606:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+5:10395:x1876180417444736:12345-0@lo:104: 00010000:00010000:3.0:1789265230.643616:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6000/0x9272d942b4a96363 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9636a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265230.643641:0:10338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789265230.643650:0:10338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+5:10395:x1876180417444608:12345-0@lo:104: Request processed in 94us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265230.643657:0:10338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:3.0:1789265230.643662:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789265230.643670:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+4:10395:x1876180417444736:12345-0@lo:104: Request processed in 66us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265230.643688:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789265230.643710:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789265230.643719:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+3:10395:x1876180417444864:12345-0@lo:104: 00010000:00010000:0.0:1789265230.643725:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789265230.643727:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc81692200/0x9272d942b4a96355 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9635c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265230.643735:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a964dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a964e4 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265230.643745:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6800 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:0.0:1789265230.643750:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a964dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a964e4 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265230.643760:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1789265230.643760:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a964dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a964e4 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265230.643767:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+3:10395:x1876180417444864:12345-0@lo:104: Request processed in 50us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265230.643781:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 10000000:00010000:0.0:1789265230.643786:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a964dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a964e4 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265230.643794:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789265230.643801:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789265230.643808:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a963b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a963be expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265230.643815:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81692000 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:3.0:1789265230.643819:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a963b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a963be expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265230.643826:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a963b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a963be expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265230.643834:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a963b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a963be expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265230.643841:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a964dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a964e4 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265230.643859:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:3.0:1789265230.643860:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789265230.643883:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a963b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a963be expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265230.643885:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a964dd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a964e4 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265230.643901:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265230.643903:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a964dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a964e4 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265230.644076:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a963b7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a963be expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265230.644086:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc81692000/0x9272d942b4a963b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a963be expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265230.644100:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265230.644104:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6000/0x9272d942b4a96363 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9636a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265230.644110:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6000 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:3.0:1789265230.644113:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6000/0x9272d942b4a96363 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a9636a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265230.644120:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6000/0x9272d942b4a96363 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a9636a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265230.644127:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6000/0x9272d942b4a96363 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a9636a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265230.644145:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789265230.644155:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265230.644160:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc81692200/0x9272d942b4a96355 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9635c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265230.644162:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6000/0x9272d942b4a96363 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9636a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265230.644175:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81692200 already unused, calling callback (ffffffffc1191c20) 00010000:00010000:3.0:1789265230.644177:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1789265230.644181:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81692200/0x9272d942b4a96355 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a9635c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265230.644194:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc81692200/0x9272d942b4a96355 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a9635c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265230.644196:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6000/0x9272d942b4a96363 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9636a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265230.644206:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81692200/0x9272d942b4a96355 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a9635c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265230.644210:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6000/0x9272d942b4a96363 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9636a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265230.644215:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789265230.644240:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc81692200/0x9272d942b4a96355 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9635c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265230.644247:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265230.644254:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc81692200/0x9272d942b4a96355 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9635c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265230.644260:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc81692200/0x9272d942b4a96355 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9635c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265230.644270:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265230.644271:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265230.644273:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265230.644299:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417444992:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265230.644304:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265230.644308:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265230.644310:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265230.644320:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265230.644336:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417445120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265230.644352:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265230.645381:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417445248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265230.645744:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1876180417444480:0@lo:104: 00000100:00100000:1.0:1789265230.645760:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1876180417444608:0@lo:104: 00000100:00100000:1.0:1789265230.645768:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1876180417444736:0@lo:104: 00000100:00100000:1.0:1789265230.645775:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1876180417444864:0@lo:104: 00000100:00100000:2.0:1789265230.645851:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265230.646004:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417444992 00000100:00100000:1.0:1789265230.646012:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417444992 00010000:00010000:1.0:1789265230.646074:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc81490000/0x9272d942b4a964e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a964dd expref: 24 pid: 6511 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265230.646108:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417445120 00000100:00100000:1.0:1789265230.646111:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417445120 00010000:00010000:1.0:1789265230.646123:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc81491e00/0x9272d942b4a963be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a963b7 expref: 25 pid: 6511 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265230.646145:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789265230.646154:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+25:3644:x1876180417444992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265230.646188:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265230.646195:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc81490000/0x9272d942b4a964e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a964dd expref: 25 pid: 6511 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265230.646219:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc81490000/0x9272d942b4a964e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a964dd expref: 25 pid: 6511 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265230.646243:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81490000/0x9272d942b4a964e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a964dd expref: 25 pid: 6511 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265230.646260:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265230.646309:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789265230.646316:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3644:x1876180417444992:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (1965us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265230.646318:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3641:x1876180417445120:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265230.646324:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:2.0:1789265230.646332:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265230.646337:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc81491e00/0x9272d942b4a963be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a963b7 expref: 23 pid: 6511 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265230.646347:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc81491e00/0x9272d942b4a963be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a963b7 expref: 23 pid: 6511 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265230.646357:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81491e00/0x9272d942b4a963be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a963b7 expref: 23 pid: 6511 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265230.646369:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265230.646418:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+22:3641:x1876180417445120:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265230.646425:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789265230.647017:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417445120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265230.649943:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417445376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265230.650072:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265230.650200:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417445376 00000100:00100000:2.0:1789265230.650212:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417445376 00010000:00010000:2.0:1789265230.650269:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc882b6200/0x9272d942b4a9635c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96355 expref: 22 pid: 6511 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265230.650320:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789265230.650330:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+22:3643:x1876180417445376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265230.650349:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265230.650361:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc882b6200/0x9272d942b4a9635c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96355 expref: 22 pid: 6511 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265230.650375:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc882b6200/0x9272d942b4a9635c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a96355 expref: 22 pid: 6511 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265230.650399:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b6200/0x9272d942b4a9635c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a96355 expref: 22 pid: 6511 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265230.650420:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265230.650477:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+21:3643:x1876180417445376:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265230.650485:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789265230.650535:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417445376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789265230.653136:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265230.653137:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417444992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265230.653269:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417445248 00000100:00100000:0.0:1789265230.653279:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417445248 00010000:00010000:0.0:1789265230.653324:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc81491600/0x9272d942b4a9636a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96363 expref: 21 pid: 7458 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265230.653348:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265230.656578:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1876180417444352:192.168.203.49@tcp:104: 00010000:00010000:3.0:1789265230.656637:0:10395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fccbd2fe600/0x9272d942b4a966c0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265230.662602:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399561088 00000100:00100000:0.0:1789265230.662626:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399561088 00000100:00100000:0.0:1789265230.663170:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789265230.663205:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb09a3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+21:3642:x1876180417445248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265230.663231:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265230.663242:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc81491600/0x9272d942b4a9636a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96363 expref: 21 pid: 7458 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265230.663260:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc81491600/0x9272d942b4a9636a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a96363 expref: 21 pid: 7458 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265230.663303:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81491600/0x9272d942b4a9636a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a96363 expref: 21 pid: 7458 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265230.663325:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265230.663423:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb09a3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+20:3642:x1876180417445248:12345-0@lo:103:ldlm_bl.0 Request processed in 241us (10299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265230.663432:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789265230.663719:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417445248:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265230.665890:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a965fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc69 expref: 10 pid: 6511 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265230.665960:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 39 00000100:00100000:3.0:1789265230.665972:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:2395:x1876180399561088:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265230.665991:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265230.665997:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a965fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc69 expref: 10 pid: 6511 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265230.666011:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a965fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc69 expref: 10 pid: 6511 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265230.666076:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a965fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc69 expref: 10 pid: 6511 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265230.666099:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fccbd2fe600/0x9272d942b4a966c0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265230.666110:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2fe600/0x9272d942b4a966c0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265230.666130:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fccbd2fe600/0x9272d942b4a966c0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265230.666137:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fccbd2fe600/0x9272d942b4a966c0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265230.666145:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fccbd2fe600/0x9272d942b4a966c0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265230.666153:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fccbd2fe600/0x9272d942b4a966c0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265230.666159:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fe600 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265230.666164:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fccbd2fe600/0x9272d942b4a966c0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265230.666173:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fccbd2fe600/0x9272d942b4a966c0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265230.666198:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fccbd2fe600/0x9272d942b4a966c0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265230.666277:0:10395:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fccbd2fe600/0x9272d942b4a966c0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265230.666289:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fccbd2fe600/0x9272d942b4a966c0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265230.666329:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccbd2fe600/0x9272d942b4a966c0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265230.666351:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265230.666430:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f6ab780-f65a-4da8-8aa9-108982c08b32+9:2395:x1876180399561088:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 460us (13084us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265230.666438:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 39 00010000:00010000:2.0:1789265231.171221:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265231.362374:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417445504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265231.362482:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265231.362558:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417445504 00000100:00100000:0.0:1789265231.362567:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417445504 00000100:00100000:0.0:1789265231.363390:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789265231.363405:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417445504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789265231.363454:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789265231.363536:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417445504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265231.363544:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789265231.363722:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417445632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265231.363765:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265231.363809:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417445632 00000100:00100000:1.0:1789265231.363814:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417445632 00000100:00100000:1.0:1789265231.363844:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789265231.363851:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417445632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789265231.363872:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789265231.363920:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417445632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265231.364306:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789265231.364358:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417445632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265231.364825:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417445504:0@lo:41:osp-pre-0-1.0 10000000:01000000:2.0:1789265231.810299:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265231.810309:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fccbf44d000 from 4 10000000:01000000:2.0:1789265231.810315:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265231.810385:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520b800/0x9272d942b4a966c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265231.810412:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccb520b800/0x9272d942b4a966c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265231.810428:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccb520b800/0x9272d942b4a966c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265231.810464:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417445760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265231.812085:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265231.813782:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc9977b900 going to sleep for 11 seconds 00000100:00100000:2.0:1789265231.813823:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417445760 00000100:00100000:2.0:1789265231.813833:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417445760 00000100:00100000:2.0:1789265231.813907:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789265231.813919:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc82d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+20:6513:x1876180417445760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265231.814727:0:7458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265231.814760:0:7458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccb520b600/0x9272d942b4a966ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a966c7 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265231.814799:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccb520b600/0x9272d942b4a966ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a966c7 expref: 21 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265231.814813:0:7458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccb520b600/0x9272d942b4a966ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a966c7 expref: 21 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265231.814824:0:7458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520b600, rc 0) 00000100:00100000:2.0:1789265231.814910:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc82d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417445760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 992us (2832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265231.814919:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789265231.815818:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417445760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265231.815846:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccb520b800/0x9272d942b4a966c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a966ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265231.815859:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccb520b800/0x9272d942b4a966c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a966ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265231.817507:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417445888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265231.817614:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265231.817695:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc9977b900 going to sleep for 11 seconds 00000100:00100000:2.0:1789265231.817729:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417445888 00000100:00100000:2.0:1789265231.817737:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417445888 00000100:00100000:2.0:1789265231.817802:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789265231.817812:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417445888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265231.817998:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417445888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 186us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265231.818006:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789265231.818076:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417445888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265231.818118:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417446016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265231.818159:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265231.818175:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc9977b900 going to sleep for 11 seconds 00000100:00100000:2.0:1789265231.818188:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417446016 00000100:00100000:2.0:1789265231.818192:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417446016 00000100:00100000:2.0:1789265231.822255:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789265231.822293:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417446016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265231.822547:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417446016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 274us (4384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265231.822564:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789265231.822886:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417446016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265231.823443:0:10439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c10e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10439:1876180417446144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265231.830152:0:10439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265231.830235:0:10439:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc9977b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265231.830724:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417446144 00000100:00100000:1.0:1789265231.830738:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417446144 00000100:00100000:1.0:1789265231.830959:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789265231.830972:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+21:10439:x1876180417446144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265231.831224:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+21:10439:x1876180417446144:12345-0@lo:502:llog_process_th.0 Request processed in 248us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265231.831233:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789265231.831331:0:10439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c10e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10439:1876180417446144:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265231.831383:0:10439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265231.831404:0:10439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265231.831407:0:10439:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789265231.831415:0:10439:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fccbf44d000 00000020:00000080:0.0:1789265231.831417:0:10439:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789265231.832450:0:10439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82135180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10439:1876180417446272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265231.832555:0:10439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265231.839113:0:10439:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c270c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265231.844178:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417446272 00000100:00100000:2.0:1789265231.844206:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417446272 00000100:00100000:2.0:1789265231.844487:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789265231.844499:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+21:10439:x1876180417446272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265231.847622:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+21:10439:x1876180417446272:12345-0@lo:502:llog_process_th.0 Request processed in 3111us (15054us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265231.847639:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789265231.849166:0:10439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82135180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10439:1876180417446272:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789265231.849234:0:10439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265231.849252:0:10439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265231.849256:0:10439:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789265231.849263:0:10439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789265231.849952:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789265231.849988:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265231.850002:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520b800/0x9272d942b4a966c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a966ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265231.850016:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccb520b800/0x9272d942b4a966c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a966ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265231.850066:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265231.850070:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fccbd2a9800 from 4 10000000:01000000:2.0:1789265231.850073:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265231.850118:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a966d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265231.850128:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a966d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265231.850148:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a966d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265231.850177:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417446400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265231.850329:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265231.850381:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc9977b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265231.850568:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417446400 00000100:00100000:1.0:1789265231.850576:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417446400 00000100:00100000:1.0:1789265231.850631:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789265231.850642:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417446400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265231.850659:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265231.850743:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccbd2ffa00/0x9272d942b4a966dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a966d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265231.850773:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2ffa00/0x9272d942b4a966dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a966d5 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265231.850786:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccbd2ffa00/0x9272d942b4a966dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a966d5 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265231.850808:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2ffa00, rc 0) 00000100:00100000:1.0:1789265231.850859:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417446400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 218us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265231.850867:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789265231.850964:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417446400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265231.850982:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a966d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a966dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265231.850993:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a966d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a966dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265231.851094:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417446528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265231.851125:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265231.851147:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc9977b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265231.851160:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417446528 00000100:00100000:2.0:1789265231.851164:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417446528 00000100:00100000:2.0:1789265231.851189:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789265231.851196:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417446528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265231.851453:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417446528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265231.851461:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789265231.851502:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417446528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265231.851531:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417446656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265231.851578:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265231.851590:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc9977b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265231.851604:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417446656 00000100:00100000:2.0:1789265231.851607:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417446656 00000100:00100000:2.0:1789265231.851631:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789265231.851638:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417446656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265231.856488:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417446656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4836us (4895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265231.856506:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789265231.856616:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417446656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265231.871970:0:10442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10442:1876180417446784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265231.872104:0:10442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265231.872160:0:10442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada13180 going to sleep for 11 seconds 00000100:00100000:2.0:1789265231.873387:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417446784 00000100:00100000:2.0:1789265231.873406:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417446784 00000100:00100000:1.0:1789265231.873925:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417446912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265231.874018:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265231.874066:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789265231.874079:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+22:10442:x1876180417446784:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265231.874109:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265231.874118:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417447040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265231.874144:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265231.874176:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417446912 00000100:00100000:1.0:1789265231.874181:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417446912 00000100:00100000:1.0:1789265231.874221:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417447040 00000100:00100000:1.0:1789265231.874225:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417447040 00000100:00100000:1.0:1789265231.874239:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265231.874244:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+22:10442:x1876180417446784:12345-0@lo:502:llog_process_th.0 Request processed in 168us (2141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265231.874252:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789265231.874257:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417446912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265231.874282:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265231.874318:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417446912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265231.874325:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789265231.874341:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789265231.874348:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417447040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789265231.874361:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265231.874402:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417447040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265231.874409:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1789265231.874445:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789265231.874485:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4f9180 x1876180417447040/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265247 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265231.874512:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417447040:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789265231.874551:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd23e300 x1876180417446912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265247 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265231.874562:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417446912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265231.876590:0:10442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10442:1876180417446784:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789265231.876649:0:10442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265231.876661:0:10442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265231.876675:0:10442:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789265231.876683:0:10442:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fccbd2a9800 00000020:00000080:3.0:1789265231.876686:0:10442:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789265231.881137:0:10442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10442:1876180417447168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265231.881254:0:10442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265231.881319:0:10442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada13180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265231.881804:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417447168 00000100:00100000:0.0:1789265231.881816:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417447168 00000100:00100000:0.0:1789265231.881895:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789265231.881906:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+22:10442:x1876180417447168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265231.882109:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+22:10442:x1876180417447168:12345-0@lo:502:llog_process_th.0 Request processed in 204us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265231.882118:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789265231.883364:0:10442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10442:1876180417447168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789265231.883423:0:10442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265231.883434:0:10442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265231.883438:0:10442:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789265231.883443:0:10442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789265231.884653:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789265231.884703:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789265231.884717:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a966d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a966dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265231.884732:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a966d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a966dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265231.884746:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789265231.884750:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fccad90a000 from 4 10000000:01000000:0.0:1789265231.884753:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789265231.884806:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc8152ec00/0x9272d942b4a966e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265231.884815:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc8152ec00/0x9272d942b4a966e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265231.884848:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc8152ec00/0x9272d942b4a966e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265231.884879:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82137100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417447296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265231.884981:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265231.885058:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c27600 going to sleep for 11 seconds 00000100:00100000:2.0:1789265231.886696:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265231.886749:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417447296 00000100:00100000:2.0:1789265231.886760:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417447296 00000100:00100000:2.0:1789265231.886821:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399561216 00000100:00100000:2.0:1789265231.886825:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399561216 00000100:00100000:2.0:1789265231.886848:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789265231.886859:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417447296:12345-0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265231.886879:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 261 00010000:00010000:2.0:1789265231.886882:0:7458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1789265231.886895:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+9:6163:x1876180399561216:12345-192.168.203.49@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265231.886905:0:7458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccb520ac00/0x9272d942b4a966ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a966e3 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265231.886906:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265231.886919:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc8152fc00/0x9272d942b4a966f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbcaf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265231.886957:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccb520ac00/0x9272d942b4a966ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a966e3 expref: 23 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265231.886971:0:7458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccb520ac00/0x9272d942b4a966ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a966e3 expref: 23 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265231.886982:0:7458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520ac00, rc 0) 00000100:00100000:2.0:1789265231.887086:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417447296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 228us (2106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265231.887094:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00010000:00010000:0.0:1789265231.887138:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc8152fc00/0x9272d942b4a966f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbcaf expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265231.887149:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc8152fc00/0x9272d942b4a966f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbcaf expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265231.887157:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc8152fc00, rc 0) 00000100:00100000:2.0:1789265231.887169:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82137100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417447296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265231.887190:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc8152ec00/0x9272d942b4a966e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a966ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265231.887202:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc8152ec00/0x9272d942b4a966e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a966ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265231.887292:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:6163:x1876180399561216:12345-192.168.203.49@tcp:101:ll_cfg_requeue.0 Request processed in 401us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265231.887298:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417447424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265231.887305:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 261 00000100:00100000:2.0:1789265231.887348:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265231.887387:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc9977b900 going to sleep for 11 seconds 00000100:00100000:2.0:1789265231.889418:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417447424 00000100:00100000:2.0:1789265231.889436:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417447424 00000100:00100000:2.0:1789265231.889504:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789265231.889515:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417447424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265231.889750:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417447424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (2402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265231.889770:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789265231.890921:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417447424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265231.891040:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82137800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417447552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265231.891133:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265231.891195:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c27780 going to sleep for 11 seconds 00000100:00100000:2.0:1789265231.891469:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417447552 00000100:00100000:2.0:1789265231.891477:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417447552 00000100:00100000:2.0:1789265231.891537:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789265231.891548:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417447552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265231.891699:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265231.891730:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399561344 00000100:00100000:3.0:1789265231.891742:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399561344 00000100:00100000:3.0:1789265231.891774:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 264 00000100:00100000:3.0:1789265231.891782:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:6163:x1876180399561344:12345-192.168.203.49@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265231.891912:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:6163:x1876180399561344:12345-192.168.203.49@tcp:501:ll_cfg_requeue.0 Request processed in 130us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265231.891934:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 264 00000100:00100000:2.0:1789265231.891987:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417447552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 440us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265231.891995:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789265231.892071:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82137800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417447552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265231.897239:0:10447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82136d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10447:1876180417447680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265231.897360:0:10447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265231.897419:0:10447:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c27300 going to sleep for 11 seconds 00000100:00100000:2.0:1789265231.897474:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417447680 00000100:00100000:2.0:1789265231.897485:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417447680 00000100:00100000:2.0:1789265231.897544:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789265231.897555:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+23:10447:x1876180417447680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265231.900064:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+23:10447:x1876180417447680:12345-0@lo:502:llog_process_th.0 Request processed in 2492us (2686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265231.900085:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789265231.900122:0:10447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82136d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10447:1876180417447680:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789265231.900174:0:10447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265231.900191:0:10447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265231.900193:0:10447:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789265231.900205:0:10447:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fccad90a000 00000020:00000080:1.0:1789265231.900208:0:10447:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789265231.900320:0:10447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10447:1876180417447808:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265231.900376:0:10447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265231.900416:0:10447:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3e2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265231.900434:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265231.900461:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417447808 00000100:00100000:2.0:1789265231.900469:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417447808 00000100:00100000:0.0:1789265231.900471:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399561472 00000100:00100000:0.0:1789265231.900477:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399561472 00000100:00100000:2.0:1789265231.900516:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789265231.900527:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+23:10447:x1876180417447808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265231.900651:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+23:10447:x1876180417447808:12345-0@lo:502:llog_process_th.0 Request processed in 126us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265231.900657:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789265231.900692:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 267 00000100:00100000:2.0:1789265231.900699:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:6163:x1876180399561472:12345-192.168.203.49@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265231.900783:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:6163:x1876180399561472:12345-192.168.203.49@tcp:503:ll_cfg_requeue.0 Request processed in 83us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265231.900791:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 267 00000100:00100000:1.0:1789265231.902178:0:10447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10447:1876180417447808:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789265231.902228:0:10447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265231.902238:0:10447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265231.902241:0:10447:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789265231.902247:0:10447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789265231.903862:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789265231.903903:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265231.903917:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc8152ec00/0x9272d942b4a966e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a966ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265231.903932:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc8152ec00/0x9272d942b4a966e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a966ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265231.903945:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789265231.903949:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fcc8a583000 from 4 10000000:01000000:3.0:1789265231.903952:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789265231.903999:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a966f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265231.904009:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a966f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265231.904038:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a966f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265231.904729:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417447936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789265231.906136:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265231.906203:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada13f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265231.906776:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417447936 00000100:00100000:0.0:1789265231.906790:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417447936 00000100:00100000:0.0:1789265231.906865:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789265231.906881:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417447936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265231.906903:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265231.907004:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83da5200/0x9272d942b4a966ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a966f8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265231.907185:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83da5200/0x9272d942b4a966ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a966f8 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265231.907199:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83da5200/0x9272d942b4a966ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a966f8 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265231.907294:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5200, rc 0) 00000100:00100000:0.0:1789265231.907371:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+24:6513:x1876180417447936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 494us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265231.907379:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789265231.914741:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265231.914909:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417447936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265231.914944:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a966f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a966ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265231.914961:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a966f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a966ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265231.915184:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417448064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265231.915320:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399561600 00000100:00100000:1.0:1789265231.915328:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399561600 00000100:00100000:1.0:1789265231.915389:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 269 00000100:00100000:1.0:1789265231.915402:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:6709:x1876180399561600:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789265231.915572:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:6709:x1876180399561600:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 173us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265231.915589:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 269 00000100:00100000:3.0:1789265231.917922:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265231.918319:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada13f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265231.918391:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417448064 00000100:00100000:3.0:1789265231.918402:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417448064 00000100:00100000:3.0:1789265231.918473:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789265231.918486:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+24:6513:x1876180417448064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265231.918830:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+24:6513:x1876180417448064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 347us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265231.918841:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789265231.919283:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417448064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265231.919361:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417448192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265231.919416:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265231.919450:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada13f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265231.919466:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417448192 00000100:00100000:3.0:1789265231.919470:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417448192 00000100:00100000:3.0:1789265231.919573:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789265231.919582:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+24:6513:x1876180417448192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265231.919772:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+24:6513:x1876180417448192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265231.919779:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789265231.919820:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417448192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265231.920250:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265231.920274:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399561728 00000100:00100000:3.0:1789265231.920280:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399561728 00000100:00100000:3.0:1789265231.920309:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 272 00000100:00100000:3.0:1789265231.920317:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:6709:x1876180399561728:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789265231.920421:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:6709:x1876180399561728:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 103us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265231.920428:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 272 00000100:00100000:0.0:1789265231.923602:0:10450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82135c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10450:1876180417448320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265231.923731:0:10450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265231.923792:0:10450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c27d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265231.924018:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417448320 00000100:00100000:3.0:1789265231.924056:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417448320 00000100:00100000:3.0:1789265231.924253:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789265231.924267:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+24:10450:x1876180417448320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265231.924438:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+24:10450:x1876180417448320:12345-0@lo:502:llog_process_th.0 Request processed in 174us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265231.924447:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789265231.925250:0:10450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82135c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10450:1876180417448320:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789265231.925299:0:10450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265231.925312:0:10450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265231.925315:0:10450:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789265231.925324:0:10450:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fcc8a583000 00000020:00000080:3.0:1789265231.925327:0:10450:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789265231.925800:0:10450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10450:1876180417448448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265231.925999:0:10450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265231.926068:0:10450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada13c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265231.933036:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417448448 00000100:00100000:2.0:1789265231.933062:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417448448 00000100:00100000:2.0:1789265231.933153:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789265231.933164:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+24:10450:x1876180417448448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265231.933398:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+24:10450:x1876180417448448:12345-0@lo:502:llog_process_th.0 Request processed in 235us (7398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265231.933408:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789265231.933439:0:10450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:10450:1876180417448448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789265231.933488:0:10450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265231.933497:0:10450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265231.933501:0:10450:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789265231.933505:0:10450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789265231.936956:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789265231.937017:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265231.937167:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a966f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a966ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265231.937184:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a966f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a966ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265232.207799:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265232.207840:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265232.207878:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265232.207999:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399562368 00000100:00100000:1.0:1789265232.208013:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399562368 00000100:00100000:1.0:1789265232.208103:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 20 00000100:00100000:1.0:1789265232.208114:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399562368:12345-192.168.203.49@tcp:400:kworker.0 00010000:00010000:0.0:1789265232.208769:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265232.210764:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399562368:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 2633us (2866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265232.210786:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 20 00000100:00080000:1.0:1789265232.210841:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265232.211898:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399561856 00000100:00100000:3.0:1789265232.211915:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399561856 00000100:00100000:3.0:1789265232.211991:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 275 00000100:00100000:3.0:1789265232.212002:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:2396:x1876180399561856:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265232.212116:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:2396:x1876180399561856:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 116us (4334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265232.212125:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 275 00000100:00100000:2.0:1789265232.212793:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399562112 00000100:00100000:2.0:1789265232.212802:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399562112 00000100:00100000:2.0:1789265232.212875:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 65 00000100:00100000:2.0:1789265232.212884:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399562112:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265232.212941:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399562112:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 59us (5100us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265232.212948:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 65 00000100:00080000:0.0:1789265232.214759:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265232.226698:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265232.226755:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265232.226798:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399561984 00000100:00100000:3.0:1789265232.226811:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399561984 00000100:00100000:3.0:1789265232.226897:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 66 00000100:00100000:3.0:1789265232.226909:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399561984:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265232.227118:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399561984:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 211us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265232.227128:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 66 00000100:00100000:3.0:1789265232.227157:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399562240 00000100:00100000:3.0:1789265232.227161:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399562240 00000100:00100000:3.0:1789265232.227193:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 21 00000100:00100000:3.0:1789265232.227283:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399562240:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265232.227393:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399562240:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 112us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265232.227400:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 21 00000100:00080000:3.0:1789265232.227422:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789265232.227428:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789265233.219244:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265233.427279:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265233.427320:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417448576:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265233.427443:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265233.429277:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417448576 00000100:00100000:1.0:1789265233.429297:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417448576 00000100:00100000:1.0:1789265233.429380:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789265233.429394:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417448576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789265233.429449:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265233.429571:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417448576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 182us (2128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265233.429579:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1789265233.429614:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789265233.433071:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd23c000 x1876180417448576/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265233.433290:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417448576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265233.921339:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417448832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265233.921414:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417448960:0@lo:400:kworker.0 00000100:00100000:1.0:1789265233.921462:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417449216:0@lo:400:kworker.0 00000100:00100000:0.0:1789265233.924038:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265233.924152:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265233.924169:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417449344:0@lo:400:kworker.0 00000100:00100000:0.0:1789265233.924207:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265233.924268:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417448960 00000100:00100000:0.0:1789265233.924278:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417448960 00000100:00100000:0.0:1789265233.924338:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417449344 00000100:00100000:0.0:1789265233.924353:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417449344 00000100:00100000:0.0:1789265233.924382:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789265233.924392:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417448960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265233.924467:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417448960:12345-0@lo:400:kworker.0 Request processed in 76us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265233.924475:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789265233.924495:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789265233.924502:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417449344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265233.924533:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417449344:12345-0@lo:400:kworker.0 Request processed in 33us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265233.924539:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789265233.924588:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417449344:0@lo:400:kworker.0 00000100:00100000:0.0:1789265233.924612:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417448960:0@lo:400:kworker.0 00000100:00100000:0.0:1789265233.924695:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417449088:0@lo:400:kworker.0 00000100:00100000:0.0:1789265233.924832:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265233.924893:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417449088 00000100:00100000:0.0:1789265233.924897:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417449088 00000100:00100000:0.0:1789265233.924951:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789265233.924958:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417449088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265233.925001:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417449088:12345-0@lo:400:kworker.0 Request processed in 44us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265233.925007:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789265233.925060:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417449088:0@lo:400:kworker.0 00000100:00100000:0.0:1789265233.925592:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417449600:0@lo:400:kworker.0 00000100:00100000:0.0:1789265233.925640:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265233.925680:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265233.925687:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417449728:0@lo:400:kworker.0 00000100:00100000:0.0:1789265233.925719:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265233.925753:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417449472:0@lo:400:kworker.0 00000100:00100000:0.0:1789265233.925778:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265233.925795:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265233.925801:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417449856:0@lo:400:kworker.0 00000100:00100000:0.0:1789265233.925825:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265233.925854:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417449600 00000100:00100000:0.0:1789265233.925859:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417449600 00000100:00100000:0.0:1789265233.925906:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417449472 00000100:00100000:0.0:1789265233.925910:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417449472 00000100:00100000:0.0:1789265233.925935:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789265233.925945:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417449600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265233.926006:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417449600:12345-0@lo:400:kworker.0 Request processed in 63us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265233.926014:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789265233.926065:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789265233.926087:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417449472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265233.926127:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417449472:12345-0@lo:400:kworker.0 Request processed in 42us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265233.926134:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:0.0:1789265233.926178:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd333800 x1876180417449600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265233.926191:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417449600:0@lo:400:kworker.0 00000100:00100000:0.0:1789265233.926223:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417449472:0@lo:400:kworker.0 00000100:00100000:0.0:1789265233.926257:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417449728 00000100:00100000:0.0:1789265233.926261:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417449728 00000100:00100000:0.0:1789265233.926292:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417449856 00000100:00100000:0.0:1789265233.926295:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417449856 00000100:00100000:0.0:1789265233.926315:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789265233.926321:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417449728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265233.926361:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417449728:12345-0@lo:400:kworker.0 Request processed in 39us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265233.926368:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789265233.926379:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789265233.926385:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417449856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265233.926430:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417449856:12345-0@lo:400:kworker.0 Request processed in 46us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265233.926437:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1789265233.926464:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd332d80 x1876180417449728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265233.926474:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417449728:0@lo:400:kworker.0 00010000:00080000:0.0:1789265233.926509:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd331c00 x1876180417449856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265233.926518:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417449856:0@lo:400:kworker.0 00000100:00080000:0.0:1789265233.926543:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265233.926548:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265233.926551:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265233.929326:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417450112:0@lo:400:kworker.0 00000100:00100000:0.0:1789265233.929504:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265233.929573:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265233.929580:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417450240:0@lo:400:kworker.0 00000100:00100000:1.0:1789265233.929600:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265233.929607:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265233.929636:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417449216 00000100:00100000:0.0:1789265233.929638:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417450240 00000100:00100000:1.0:1789265233.929645:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417449216 00000100:00100000:0.0:1789265233.929645:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417450240 00000100:00100000:1.0:1789265233.929711:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789265233.929711:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265233.929721:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417450240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265233.929784:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417450240:12345-0@lo:400:kworker.0 Request processed in 64us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265233.929792:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265233.929824:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180417449984:0@lo:400:kworker.0 00000100:00100000:0.0:1789265233.929851:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265233.929872:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265233.929879:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417450368:0@lo:400:kworker.0 00000100:00100000:0.0:1789265233.929905:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265233.929933:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417450368 00000100:00100000:0.0:1789265233.929938:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417450368 00000100:00100000:1.0:1789265233.930010:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417449216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265233.930077:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417449216:12345-0@lo:400:kworker.0 Request processed in 71us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265233.930083:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789265233.930132:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417449216:0@lo:400:kworker.0 00000100:00100000:3.0:1789265233.930134:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417450112 00000100:00100000:3.0:1789265233.930138:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417450112 00000100:00100000:0.0:1789265233.930213:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789265233.930228:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417450368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265233.930267:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417450368:12345-0@lo:400:kworker.0 Request processed in 40us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265233.930274:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1789265233.930313:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd332300 x1876180417450240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265233.930328:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417450240:0@lo:400:kworker.0 00000100:00100000:1.0:1789265233.930362:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417449984 00000100:00100000:1.0:1789265233.930366:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417449984 00000100:00100000:2.0:1789265233.933140:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265233.933226:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417448832 00000100:00100000:2.0:1789265233.933237:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417448832 00000100:00100000:2.0:1789265233.933307:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789265233.933320:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417448832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265233.933354:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265233.933406:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417448832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265233.933414:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1789265233.933552:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4f1180 x1876180417448832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265233.933577:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417448832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265233.933591:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417448704:0@lo:400:kworker.0 00000100:00100000:2.0:1789265233.933635:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265233.933738:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417448704 00000100:00100000:2.0:1789265233.933742:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417448704 00000100:00100000:2.0:1789265233.933771:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789265233.933778:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3641:x1876180417448704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265233.933811:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3641:x1876180417448704:12345-0@lo:400:kworker.0 Request processed in 34us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265233.933818:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789265233.933852:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417448704:0@lo:400:kworker.0 00010000:00080000:2.0:1789265233.933919:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd332680 x1876180417450368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265233.933930:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417450368:0@lo:400:kworker.0 00000100:00100000:3.0:1789265233.934343:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789265233.934352:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417450112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265233.934409:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417450112:12345-0@lo:400:kworker.0 Request processed in 58us (4905us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265233.934427:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1789265233.935851:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265233.935865:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789265233.935869:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789265233.935949:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd330a80 x1876180417450112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265233.936457:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417450112:0@lo:400:kworker.0 00000100:00100000:1.0:1789265233.937989:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789265233.938006:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876180417449984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265233.938244:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876180417449984:12345-0@lo:400:kworker.0 Request processed in 242us (8391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265233.938252:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789265233.944337:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180417449984:0@lo:400:kworker.0 00010000:00010000:2.0:1789265234.242918:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265235.265166:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265236.291869:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265236.481480:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265236.481510:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417450496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265236.481599:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265236.481693:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417450496 00000100:00100000:0.0:1789265236.481704:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417450496 00000100:00100000:0.0:1789265236.481763:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789265236.481772:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417450496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789265236.481815:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789265236.481866:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417450496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265236.481874:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789265236.481925:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417450496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265236.486341:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417450624:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265236.486448:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265236.486574:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417450624 00000100:00100000:0.0:1789265236.486599:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417450624 00000100:00100000:0.0:1789265236.488382:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789265236.488472:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417450624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789265236.488545:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789265236.488820:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417450624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 423us (2374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265236.488829:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789265236.488873:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417450624:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265236.996891:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417450752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265236.996967:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265236.997073:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417450752 00000100:00100000:1.0:1789265236.997081:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417450752 00000100:00100000:1.0:1789265236.997135:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789265236.997146:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417450752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789265236.997175:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265236.997221:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417450752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265236.997230:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1789265236.997269:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789265236.997300:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4f3100 x1876180417450752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265252 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265236.997322:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417450752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265236.997618:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265236.997642:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417450880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265236.997678:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265236.997713:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417450880 00000100:00100000:3.0:1789265236.997716:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417450880 00000100:00100000:3.0:1789265236.997751:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789265236.997758:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417450880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265236.997782:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265236.997827:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417450880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265236.997836:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1789265236.997873:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd330000 x1876180417450880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265252 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265236.997891:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417450880:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789265236.998006:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789265237.315778:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265237.323675:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265237.323713:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265237.323739:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265237.323759:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265237.323782:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265237.323807:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399562496 00000100:00100000:3.0:1789265237.323817:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399562496 00000100:00100000:3.0:1789265237.323864:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 277 00000100:00100000:3.0:1789265237.323873:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:2394:x1876180399562496:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265237.323948:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:2394:x1876180399562496:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 77us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265237.323956:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 277 00000100:00100000:3.0:1789265237.323988:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399562624 00000100:00100000:3.0:1789265237.323992:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399562624 00000100:00100000:3.0:1789265237.324048:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399562752 00000100:00100000:3.0:1789265237.324051:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399562752 00000100:00080000:2.0:1789265237.327722:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789265237.327732:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265237.327985:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 73 00000100:00100000:3.0:1789265237.328009:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+6:2393:x1876180399562624:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265237.328118:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+6:2393:x1876180399562624:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 120us (4453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265237.330272:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 74 00000100:00100000:0.0:1789265237.330292:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399562752:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265237.330371:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399562752:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 88us (6611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265237.330379:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 74 00000100:00100000:0.0:1789265237.330414:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399562880 00000100:00100000:0.0:1789265237.330422:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399562880 00000100:00100000:0.0:1789265237.330463:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399563008 00000100:00100000:0.0:1789265237.330467:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399563008 00000100:00100000:0.0:1789265237.330489:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 26 00000100:00100000:0.0:1789265237.330496:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2393:x1876180399562880:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265237.330525:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2393:x1876180399562880:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 30us (6811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265237.330531:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 26 00000100:00100000:0.0:1789265237.330543:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 27 00000100:00100000:0.0:1789265237.330549:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd330700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399563008:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265237.330572:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd330700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399563008:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 23us (6789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265237.330594:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 27 00000100:00080000:0.0:1789265237.330721:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265237.330725:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265237.330785:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 73 00000001:02000400:0.0:1789265237.560360:0:10695:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg349-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1789265238.337226:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265238.531768:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265238.531792:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417451008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265238.531857:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265238.531915:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417451008 00000100:00100000:1.0:1789265238.531922:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417451008 00000100:00100000:1.0:1789265238.531974:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789265238.531983:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417451008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789265238.532010:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265238.532069:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417451008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265238.532076:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1789265238.532113:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd331f80 x1876180417451008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265238.532143:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417451008:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789265238.532652:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265239.041577:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417451264:0@lo:400:kworker.0 00000100:00100000:3.0:1789265239.041655:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265239.041719:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180417451776:0@lo:400:kworker.0 00000100:00100000:3.0:1789265239.041743:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265239.041767:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82868a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180417452288:0@lo:400:kworker.0 00000100:00100000:3.0:1789265239.041786:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265239.041811:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1789265239.041817:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417451136:0@lo:400:kworker.0 00000100:00100000:3.0:1789265239.041858:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265239.041876:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417451648:0@lo:400:kworker.0 00000100:00100000:3.0:1789265239.041904:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265239.041920:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82868700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417452160:0@lo:400:kworker.0 00000100:00100000:3.0:1789265239.041942:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265239.041959:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417452672:0@lo:400:kworker.0 00000100:00100000:3.0:1789265239.041978:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265239.042009:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417451264 00000100:00100000:3.0:1789265239.042016:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417451264 00000100:00100000:1.0:1789265239.042155:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417451776 00000100:00100000:1.0:1789265239.042160:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417451776 00000100:00100000:0.0:1789265239.042224:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417451392:0@lo:400:kworker.0 00000100:00100000:0.0:1789265239.042256:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265239.042275:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417451904:0@lo:400:kworker.0 00000100:00100000:0.0:1789265239.042295:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265239.042309:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417452416:0@lo:400:kworker.0 00000100:00100000:0.0:1789265239.042328:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265239.042340:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789265239.042345:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417451520:0@lo:400:kworker.0 00000100:00100000:0.0:1789265239.042362:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265239.042377:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417452032:0@lo:400:kworker.0 00000100:00100000:0.0:1789265239.042397:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265239.042413:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417452544:0@lo:400:kworker.0 00000100:00100000:0.0:1789265239.042431:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265239.042453:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417451392 00000100:00100000:0.0:1789265239.042457:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417451392 00000100:00100000:0.0:1789265239.042486:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417451520 00000100:00100000:0.0:1789265239.042489:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417451520 00000100:00100000:0.0:1789265239.042503:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789265239.042510:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417451392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265239.042558:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417451392:12345-0@lo:400:kworker.0 Request processed in 48us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265239.042573:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789265239.042588:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789265239.042594:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417451520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265239.042639:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417451520:12345-0@lo:400:kworker.0 Request processed in 46us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265239.042644:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789265239.042664:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417452160 00000100:00100000:0.0:1789265239.042668:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417452160 00000100:00100000:0.0:1789265239.042685:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417452672 00000100:00100000:0.0:1789265239.042688:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417452672 00000100:00100000:0.0:1789265239.042699:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417452032 00000100:00100000:0.0:1789265239.042701:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417452032 00000100:00100000:0.0:1789265239.042711:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417452544 00000100:00100000:0.0:1789265239.042713:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417452544 00000100:00100000:0.0:1789265239.042723:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789265239.042729:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417452160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265239.042764:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417452160:12345-0@lo:400:kworker.0 Request processed in 35us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265239.042769:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789265239.042781:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265239.042787:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417452672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265239.042812:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417452672:12345-0@lo:400:kworker.0 Request processed in 26us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265239.042817:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265239.042827:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789265239.042833:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417452032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265239.042881:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417452032:12345-0@lo:400:kworker.0 Request processed in 49us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265239.042887:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789265239.042897:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789265239.042902:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417452544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265239.042922:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417452544:12345-0@lo:400:kworker.0 Request processed in 21us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265239.042927:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789265239.042968:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417451520:0@lo:400:kworker.0 00010000:00080000:0.0:1789265239.042981:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4f1180 x1876180417452032/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265239.042990:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417452032:0@lo:400:kworker.0 00010000:00080000:0.0:1789265239.042999:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd337b80 x1876180417452544/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265239.043006:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417452544:0@lo:400:kworker.0 00000100:00100000:0.0:1789265239.043014:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417451392:0@lo:400:kworker.0 00000100:00100000:2.0:1789265239.043172:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417451136 00000100:00100000:2.0:1789265239.043177:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417451136 00000100:00100000:0.0:1789265239.043680:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417452288 00000100:00100000:0.0:1789265239.043685:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417452288 00000100:00100000:1.0:1789265239.045221:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417451648 00000100:00100000:1.0:1789265239.045231:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417451648 00000100:00100000:1.0:1789265239.045258:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417451904 00000100:00100000:1.0:1789265239.045261:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417451904 00000100:00100000:1.0:1789265239.045276:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417452416 00000100:00100000:1.0:1789265239.045279:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417452416 00000100:00100000:1.0:1789265239.045317:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789265239.045325:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417451264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265239.045402:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417451264:12345-0@lo:400:kworker.0 Request processed in 78us (3747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265239.045408:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789265239.045424:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789265239.045430:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180417451776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265239.045458:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180417451776:12345-0@lo:400:kworker.0 Request processed in 28us (3714us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265239.045463:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789265239.045475:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789265239.045481:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417451648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265239.045506:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417451648:12345-0@lo:400:kworker.0 Request processed in 26us (3610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265239.045511:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789265239.045521:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789265239.045527:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417451904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265239.045564:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417451904:12345-0@lo:400:kworker.0 Request processed in 38us (3268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265239.045570:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789265239.045581:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789265239.045586:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417452416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265239.045609:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417452416:12345-0@lo:400:kworker.0 Request processed in 23us (3281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265239.045627:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1789265239.045656:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265239.045661:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265239.045663:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265239.045666:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789265239.045748:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4f2a00 x1876180417451904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265239.045761:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417451904:0@lo:400:kworker.0 00010000:00080000:1.0:1789265239.045772:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb8286ad80 x1876180417452416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265239.045780:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417452416:0@lo:400:kworker.0 00000100:00100000:1.0:1789265239.045841:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265239.045852:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417452800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265239.045886:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265239.045929:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417452800 00000100:00100000:1.0:1789265239.045933:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417452800 00000100:00100000:1.0:1789265239.045958:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789265239.045964:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd335500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417452800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265239.045977:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265239.046009:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd335500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417452800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265239.046016:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1789265239.046059:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd336a00 x1876180417452800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265239.046084:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417452800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265239.046123:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417451648:0@lo:400:kworker.0 00010000:00080000:1.0:1789265239.046147:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb82868700 x1876180417452160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265239.046157:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82868700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417452160:0@lo:400:kworker.0 00010000:00080000:1.0:1789265239.046168:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd335180 x1876180417452672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265239.046175:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417452672:0@lo:400:kworker.0 00000100:00100000:1.0:1789265239.046185:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417451264:0@lo:400:kworker.0 00000100:00100000:1.0:1789265239.046195:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180417451776:0@lo:400:kworker.0 00000100:00100000:2.0:1789265239.047718:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789265239.047738:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3644:x1876180417451136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265239.047811:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3644:x1876180417451136:12345-0@lo:400:kworker.0 Request processed in 82us (5951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265239.047818:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789265239.047873:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417451136:0@lo:400:kworker.0 00000100:00100000:0.0:1789265239.048057:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789265239.048076:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180417452288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265239.048116:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180417452288:12345-0@lo:400:kworker.0 Request processed in 45us (6329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265239.048122:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789265239.048268:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82868a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180417452288:0@lo:400:kworker.0 00010000:00010000:0.0:1789265239.363226:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265240.385848:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265241.409883:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265241.611929:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417452928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265241.612002:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265241.612273:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417452928 00000100:00100000:0.0:1789265241.612281:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417452928 00000100:00100000:0.0:1789265241.612329:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789265241.612338:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417452928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789265241.612368:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789265241.612409:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417452928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265241.612416:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789265241.612484:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417452928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265241.612578:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265241.614081:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417453056:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265241.614141:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265241.614200:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417453056 00000100:00100000:0.0:1789265241.614207:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417453056 00000100:00100000:0.0:1789265241.614254:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789265241.614264:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417453056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789265241.614299:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789265241.614352:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417453056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265241.614359:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789265241.614467:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417453056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265242.113378:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265242.113403:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417453184:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265242.113480:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265242.113560:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417453184 00000100:00100000:3.0:1789265242.113567:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417453184 00000100:00080000:0.0:1789265242.113605:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265242.113626:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789265242.113636:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417453184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789265242.113681:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265242.113736:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417453184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265242.113744:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789265242.113996:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417453312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265242.114048:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265242.114070:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417453312 00000100:00100000:1.0:1789265242.114075:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417453312 00010000:00080000:0.0:1789265242.114088:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd337100 x1876180417453184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265242.114107:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789265242.114107:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417453184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265242.114113:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417453312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265242.114123:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789265242.114138:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265242.114157:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417453312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265242.114172:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1789265242.114199:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd337800 x1876180417453312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265242.114212:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417453312:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789265242.433696:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265242.445003:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265242.445069:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265242.445092:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265242.445128:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265242.445159:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399563520 00000100:00100000:3.0:1789265242.445168:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399563520 00000100:00100000:3.0:1789265242.445234:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 18 00000100:00100000:3.0:1789265242.445243:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+5:2392:x1876180399563520:12345-192.168.203.49@tcp:9:kworker.0 00000020:00000080:3.0:1789265242.445278:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a96611 00000100:00080000:3.0:1789265242.445287:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9fcb82f03000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789265242.445331:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789265242.445482:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+2:2392:x1876180399563520:12345-192.168.203.49@tcp:9:kworker.0 Request processed in 238us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265242.445490:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 18 00000100:00080000:3.0:1789265242.445509:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265242.445828:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399563392 00000100:00100000:1.0:1789265242.445833:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399563392 00000100:00100000:1.0:1789265242.445868:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399563264 00000100:00100000:1.0:1789265242.445871:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399563264 00000100:00100000:1.0:1789265242.445892:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 81 00000100:00100000:1.0:1789265242.445900:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399563392:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265242.445932:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399563392:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 33us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265242.445939:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 81 00000100:00100000:1.0:1789265242.445951:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 82 00000100:00100000:1.0:1789265242.445957:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399563264:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265242.445980:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399563264:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 24us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265242.445985:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 82 00010000:00010000:1.0:1789265242.446005:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789265242.446016:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265242.446019:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265242.447784:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265242.447899:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399563648 00000100:00100000:1.0:1789265242.447907:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399563648 00000100:00100000:1.0:1789265242.447971:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 19 00000100:00100000:1.0:1789265242.447980:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2392:x1876180399563648:12345-192.168.203.49@tcp:9:kworker.0 00000020:00000080:1.0:1789265242.448048:0:8914:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a96618 00000100:00080000:1.0:1789265242.448058:0:8914:0:(import.c:65:import_set_state_nolock()) ffff9fcb83c7e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789265242.448100:0:8914:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00080000:3.0:1789265242.448215:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265242.448434:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399563136 00000100:00100000:0.0:1789265242.448440:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399563136 00000100:00100000:0.0:1789265242.448479:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 279 00000100:00100000:0.0:1789265242.448487:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:2395:x1876180399563136:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265242.448531:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+2:2392:x1876180399563648:12345-192.168.203.49@tcp:9:kworker.0 Request processed in 551us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265242.448541:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 19 00010000:00010000:1.0:1789265242.448607:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265242.451251:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:2395:x1876180399563136:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 2638us (6135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265242.451267:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 279 00000001:02000400:0.0:1789265242.652808:0:10937:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg349-server.virtnet: executing yml_node 00010000:00010000:2.0:1789265243.458414:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265243.651359:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265243.651384:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417453440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265243.651466:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265243.654163:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417453440 00000100:00100000:3.0:1789265243.654177:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417453440 00000100:00100000:3.0:1789265243.654422:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789265243.654434:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417453440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789265243.654465:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265243.654553:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417453440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (3087us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265243.654562:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1789265243.654619:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccb5c11f80 x1876180417453440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265243.654640:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417453440:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789265243.659522:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265244.162869:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265244.162893:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417453568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265244.162965:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265244.163798:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417453568 00000100:00100000:1.0:1789265244.163807:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417453568 00000100:00100000:1.0:1789265244.163878:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789265244.163888:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417453568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265244.163913:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265244.163977:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417453568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265244.163984:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1789265244.164046:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd337800 x1876180417453568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265244.164138:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417453568:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789265244.165551:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265244.167727:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417453952:0@lo:400:kworker.0 00000100:00100000:3.0:1789265244.167802:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265244.167889:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417453696:0@lo:400:kworker.0 00000100:00100000:2.0:1789265244.167935:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265244.167964:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265244.167969:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417453824:0@lo:400:kworker.0 00000100:00100000:2.0:1789265244.167992:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265244.168044:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417453696 00000100:00100000:2.0:1789265244.168060:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417453696 00000100:00100000:2.0:1789265244.168106:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789265244.168115:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3643:x1876180417453696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265244.168164:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3643:x1876180417453696:12345-0@lo:400:kworker.0 Request processed in 50us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265244.168172:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789265244.168216:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417453696:0@lo:400:kworker.0 00000100:00100000:2.0:1789265244.168272:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417453824 00000100:00100000:2.0:1789265244.168275:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417453824 00000100:00100000:2.0:1789265244.168298:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789265244.168304:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417453824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265244.168341:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417453824:12345-0@lo:400:kworker.0 Request processed in 37us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265244.168347:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789265244.168372:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417453824:0@lo:400:kworker.0 00000100:00100000:1.0:1789265244.169944:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417453952 00000100:00100000:1.0:1789265244.169952:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417453952 00000100:00100000:1.0:1789265244.169997:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789265244.170006:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417453952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265244.170149:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417454080:0@lo:400:kworker.0 00000100:00100000:2.0:1789265244.170187:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265244.170237:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417454080 00000100:00100000:2.0:1789265244.170241:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417454080 00000100:00100000:2.0:1789265244.170265:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789265244.170272:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417454080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265244.170323:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417454080:12345-0@lo:400:kworker.0 Request processed in 51us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265244.170331:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789265244.170370:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417454080:0@lo:400:kworker.0 00000100:00100000:0.0:1789265244.179537:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180417454336:0@lo:400:kworker.0 00000100:00100000:0.0:1789265244.179617:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265244.179650:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180417454848:0@lo:400:kworker.0 00000100:00100000:0.0:1789265244.179670:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265244.179690:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789265244.179790:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417454336 00000100:00100000:3.0:1789265244.179798:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417454336 00000100:00100000:3.0:1789265244.179848:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417454848 00000100:00100000:3.0:1789265244.179852:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417454848 00000100:00100000:3.0:1789265244.179872:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789265244.179881:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180417454336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265244.179927:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180417454336:12345-0@lo:400:kworker.0 Request processed in 47us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265244.179934:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789265244.179949:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789265244.179954:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180417454848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265244.179978:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180417454848:12345-0@lo:400:kworker.0 Request processed in 24us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265244.179984:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789265244.180000:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417454592:0@lo:400:kworker.0 00000100:00080000:2.0:1789265244.180158:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265244.180197:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265244.180239:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417454208:0@lo:400:kworker.0 00000100:00100000:1.0:1789265244.180248:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417453952:12345-0@lo:400:kworker.0 Request processed in 10242us (12445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265244.180258:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789265244.180264:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265244.180279:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417454720:0@lo:400:kworker.0 00000100:00100000:1.0:1789265244.180292:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417454208 00000100:00100000:1.0:1789265244.180295:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417454208 00000100:00100000:0.0:1789265244.180313:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265244.180318:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789265244.180323:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417454208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265244.180345:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180417454336:0@lo:400:kworker.0 00000100:00100000:1.0:1789265244.180351:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417454208:12345-0@lo:400:kworker.0 Request processed in 28us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265244.180355:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180417454848:0@lo:400:kworker.0 00000100:00100000:1.0:1789265244.180357:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789265244.180375:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417454208:0@lo:400:kworker.0 00000100:00100000:1.0:1789265244.180390:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417454592 00000100:00100000:1.0:1789265244.180393:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417454592 00000100:00100000:0.0:1789265244.180398:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417454720 00000100:00100000:0.0:1789265244.180400:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417454720 00000100:00100000:1.0:1789265244.180419:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789265244.180423:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789265244.180425:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417454592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265244.180428:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417454720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265244.180454:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417454592:12345-0@lo:400:kworker.0 Request processed in 29us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265244.180455:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417454720:12345-0@lo:400:kworker.0 Request processed in 27us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265244.180461:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789265244.180469:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1789265244.180495:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4f2d80 x1876180417454720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265244.180504:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417454720:0@lo:400:kworker.0 00000100:00100000:2.0:1789265244.180972:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417453952:0@lo:400:kworker.0 00000100:00100000:2.0:1789265244.180995:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417454464:0@lo:400:kworker.0 00000100:00100000:2.0:1789265244.181068:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265244.181088:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417454976:0@lo:400:kworker.0 00000100:00100000:2.0:1789265244.181110:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789265244.181144:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265244.181162:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417454464 00000100:00100000:2.0:1789265244.181166:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417454464 00000100:00100000:2.0:1789265244.181192:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417454976 00000100:00100000:2.0:1789265244.181195:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417454976 00000100:00100000:2.0:1789265244.181210:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789265244.181216:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417454464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265244.181267:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417454464:12345-0@lo:400:kworker.0 Request processed in 50us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265244.181274:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789265244.181286:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789265244.181292:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417454976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265244.181316:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417454976:12345-0@lo:400:kworker.0 Request processed in 25us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265244.181321:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1789265244.181342:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789265244.181359:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4f1f80 x1876180417454464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265244.181369:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417454464:0@lo:400:kworker.0 00010000:00080000:2.0:1789265244.181378:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83bbad80 x1876180417454976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265244.181385:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417454976:0@lo:400:kworker.0 00010000:00080000:2.0:1789265244.181888:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4f0000 x1876180417454592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265244.181898:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417454592:0@lo:400:kworker.0 00000100:00100000:2.0:1789265244.181905:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417455104:0@lo:400:kworker.0 00000100:00100000:2.0:1789265244.181934:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265244.182157:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417455104 00000100:00100000:0.0:1789265244.182162:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417455104 00000100:00100000:1.0:1789265244.182427:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789265244.182435:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417455104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265244.182484:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417455104:12345-0@lo:400:kworker.0 Request processed in 51us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265244.182491:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1789265244.182546:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83bb8380 x1876180417455104/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265244.182555:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417455104:0@lo:400:kworker.0 00010000:00010000:1.0:1789265244.481695:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265245.505270:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265246.533520:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265246.722158:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417455232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265246.722226:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265246.722301:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417455232 00000100:00100000:1.0:1789265246.722308:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417455232 00000100:00100000:1.0:1789265246.722352:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789265246.722362:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417455232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265246.722404:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789265246.722452:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417455232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265246.722459:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789265246.722502:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417455232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265246.722635:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417455360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265246.722665:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265246.722739:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417455360 00000100:00100000:3.0:1789265246.722744:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417455360 00000100:00100000:3.0:1789265246.722782:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789265246.722789:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417455360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789265246.722808:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789265246.722842:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417455360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265246.722849:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789265246.722903:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417455360:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1789265247.034618:0:11122:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.105 00000100:00100000:2.0:1789265247.236202:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417455488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265247.236276:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265247.236363:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417455488 00000100:00100000:2.0:1789265247.236371:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417455488 00000100:00100000:2.0:1789265247.236436:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789265247.236447:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417455488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789265247.236476:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265247.236529:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417455488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265247.236538:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1789265247.236573:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789265247.236607:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd331500 x1876180417455488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265247.236626:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417455488:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265247.237169:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265247.237186:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417455616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265247.237224:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265247.237865:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417455616 00000100:00100000:2.0:1789265247.237872:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417455616 00000100:00100000:2.0:1789265247.237923:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789265247.237931:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417455616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265247.237947:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265247.237999:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417455616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265247.238006:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1789265247.238220:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789265247.238340:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd330380 x1876180417455616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265247.238358:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417455616:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789265247.554437:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265247.561435:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265247.561491:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265247.561519:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265247.561822:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399563776 00000100:00100000:1.0:1789265247.561831:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399563776 00000100:00100000:1.0:1789265247.561885:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 281 00000100:00100000:1.0:1789265247.561895:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:2395:x1876180399563776:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265247.561962:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:2395:x1876180399563776:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 69us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265247.561969:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 281 00000100:00100000:1.0:1789265247.561999:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399563904 00000100:00100000:1.0:1789265247.562003:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399563904 00000100:00100000:1.0:1789265247.562073:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399564032 00000100:00100000:1.0:1789265247.562085:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399564032 00000100:00100000:1.0:1789265247.562111:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 89 00000100:00100000:1.0:1789265247.562118:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399563904:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265247.562152:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399563904:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 34us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265247.562158:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 89 00000100:00100000:1.0:1789265247.562171:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 90 00000100:00100000:1.0:1789265247.562177:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf549c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399564032:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265247.562200:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf549c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399564032:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 24us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265247.562519:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 90 00000100:00080000:1.0:1789265247.562646:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265247.562651:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1789265247.758509:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5b43750b-84cf-4d62-9028-e016267b6509 00000020:00000080:2.0:1789265247.758519:0:9515:0:(genops.c:885:class_export_put()) final put ffff9fcb83c7a000/5b43750b-84cf-4d62-9028-e016267b6509 00000020:00000080:0.0:1789265247.759681:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb83c7a000/5b43750b-84cf-4d62-9028-e016267b6509 for lustre-OST0001 00000020:00000080:0.0:1789265247.759740:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb83c7e800 for lustre-OST0001 00000001:00100000:0.0:1789265247.769608:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5b43750b-84cf-4d62-9028-e016267b6509 00000020:00000080:0.0:1789265247.769616:0:8428:0:(genops.c:885:class_export_put()) final put ffff9fcb82f02800/5b43750b-84cf-4d62-9028-e016267b6509 00000020:00000080:1.0:1789265247.769742:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb82f02800/5b43750b-84cf-4d62-9028-e016267b6509 for lustre-OST0000 00000020:00000080:1.0:1789265247.769817:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb82f03000 for lustre-OST0000 00010000:00010000:1.0:1789265248.579305:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265248.770380:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417455744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265248.770448:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265248.770619:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417455744 00000100:00100000:3.0:1789265248.770627:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417455744 00000100:00100000:3.0:1789265248.770694:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789265248.770703:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd334000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417455744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789265248.770732:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789265248.770800:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265248.776003:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd334000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417455744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5289us (5543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265248.776019:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1789265248.776130:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb82ef5f80 x1876180417455744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265248.776425:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417455744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265249.281249:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417455872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265249.281320:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265249.281412:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417455872 00000100:00100000:3.0:1789265249.281432:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417455872 00000100:00100000:3.0:1789265249.281491:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789265249.281502:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417455872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265249.281525:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789265249.283386:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265249.284990:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417456256:0@lo:400:kworker.0 00000100:00100000:1.0:1789265249.285221:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417456000:0@lo:400:kworker.0 00000100:00100000:1.0:1789265249.285262:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265249.285287:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417455872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3785us (3964us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265249.285293:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417456512:0@lo:400:kworker.0 00000100:00100000:3.0:1789265249.285298:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789265249.285400:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265249.285434:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417457024:0@lo:400:kworker.0 00000100:00100000:1.0:1789265249.285458:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265249.285481:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789265249.285487:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417456128:0@lo:400:kworker.0 00000100:00100000:3.0:1789265249.285502:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417456512 00000100:00100000:1.0:1789265249.285508:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265249.285510:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417456512 00000100:00100000:1.0:1789265249.285523:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417456640:0@lo:400:kworker.0 00000100:00100000:1.0:1789265249.285541:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265249.285580:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265249.285603:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417456768:0@lo:400:kworker.0 00000100:00100000:2.0:1789265249.285626:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265249.285657:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876180417457152:0@lo:400:kworker.0 00000100:00100000:1.0:1789265249.285685:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417457024 00000100:00100000:1.0:1789265249.285689:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417457024 00000100:00100000:1.0:1789265249.285727:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789265249.285737:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417457024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265249.285783:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417457024:12345-0@lo:400:kworker.0 Request processed in 48us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265249.285790:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1789265249.287005:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd334a80 x1876180417455872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265249.287048:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417455872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265249.287090:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417456384:0@lo:400:kworker.0 00000100:00100000:0.0:1789265249.287139:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265249.287166:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417456896:0@lo:400:kworker.0 00000100:00100000:0.0:1789265249.287189:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265249.287206:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417457408:0@lo:400:kworker.0 00000100:00100000:0.0:1789265249.287900:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265249.288254:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417456896 00000100:00100000:0.0:1789265249.288297:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417456896 00000100:00100000:0.0:1789265249.288570:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417457408 00000100:00100000:0.0:1789265249.288628:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417457408 00000100:00100000:0.0:1789265249.288823:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789265249.288832:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417456896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265249.288905:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417456128 00000100:00100000:1.0:1789265249.288936:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417456640 00000100:00100000:3.0:1789265249.288938:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417456128 00000100:00100000:1.0:1789265249.288939:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417456640 00000100:00100000:3.0:1789265249.288967:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417456768 00000100:00100000:3.0:1789265249.288969:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417456768 00000100:00100000:1.0:1789265249.288971:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789265249.288977:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417456512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265249.288984:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789265249.288989:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417456640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265249.289246:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417457280:0@lo:400:kworker.0 00000100:00100000:2.0:1789265249.289282:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265249.289561:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417456512:12345-0@lo:400:kworker.0 Request processed in 581us (4158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265249.289569:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789265249.289589:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417457280 00000100:00100000:1.0:1789265249.289593:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417457280 00000100:00100000:1.0:1789265249.289615:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789265249.289631:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417456128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265249.289668:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417456128:12345-0@lo:400:kworker.0 Request processed in 37us (4158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265249.289675:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789265249.289689:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789265249.289695:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417456768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265249.289751:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417456000 00000100:00100000:2.0:1789265249.289757:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417456000 00000100:00100000:1.0:1789265249.289829:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417456768:12345-0@lo:400:kworker.0 Request processed in 134us (4201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265249.289836:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789265249.289848:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789265249.289854:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417457280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265249.289881:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417457280:12345-0@lo:400:kworker.0 Request processed in 28us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265249.289886:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789265249.289909:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789265249.289917:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417457408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265249.289954:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417457408:12345-0@lo:400:kworker.0 Request processed in 38us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265249.289961:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789265249.289992:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265249.290051:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417456512:0@lo:400:kworker.0 00010000:00080000:1.0:1789265249.290068:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83dd8380 x1876180417457024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265249.290095:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417457024:0@lo:400:kworker.0 00000100:00100000:1.0:1789265249.290130:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417456128:0@lo:400:kworker.0 00010000:00080000:1.0:1789265249.290162:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83dd9f80 x1876180417457408/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265249.290172:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417457408:0@lo:400:kworker.0 00000100:00100000:1.0:1789265249.290189:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417457152 00000100:00100000:1.0:1789265249.290191:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417457152 00000100:00100000:1.0:1789265249.290217:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789265249.290224:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876180417457152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265249.290260:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876180417457152:12345-0@lo:400:kworker.0 Request processed in 37us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265249.290267:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789265249.290297:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876180417457152:0@lo:400:kworker.0 00000100:00100000:0.0:1789265249.290521:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417456896:12345-0@lo:400:kworker.0 Request processed in 1689us (3329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265249.290528:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1789265249.290534:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc837e1180 x1876180417456896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265249.290544:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417456896:0@lo:400:kworker.0 00000100:00100000:3.0:1789265249.290628:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417456640:12345-0@lo:400:kworker.0 Request processed in 1638us (5084us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265249.290635:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789265249.290660:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417456256 00000100:00100000:3.0:1789265249.290664:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417456256 00000100:00100000:3.0:1789265249.290730:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417456384 00000100:00100000:3.0:1789265249.290734:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417456384 00000100:00100000:1.0:1789265249.290752:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417456640:0@lo:400:kworker.0 00000100:00100000:0.0:1789265249.290773:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789265249.290781:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417456256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265249.290819:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417456256:12345-0@lo:400:kworker.0 Request processed in 39us (5238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265249.290826:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789265249.290840:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789265249.290846:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417456384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265249.290886:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417456384:12345-0@lo:400:kworker.0 Request processed in 40us (3747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265249.290892:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789265249.291007:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417456384:0@lo:400:kworker.0 00000100:00080000:3.0:1789265249.291294:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265249.291300:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265249.291303:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265249.291399:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789265249.291409:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3641:x1876180417456000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265249.291539:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3641:x1876180417456000:12345-0@lo:400:kworker.0 Request processed in 131us (6275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265249.291557:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1789265249.291587:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417456000:0@lo:400:kworker.0 00000100:00100000:2.0:1789265249.291613:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417456256:0@lo:400:kworker.0 00010000:00080000:2.0:1789265249.291625:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc837e3100 x1876180417456768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265249.291635:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417456768:0@lo:400:kworker.0 00010000:00080000:2.0:1789265249.291647:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83dd8700 x1876180417457280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265249.291655:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417457280:0@lo:400:kworker.0 00000001:02000400:3.0:1789265249.510909:0:11219:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.105 00010000:00010000:0.0:1789265249.602308:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265250.625244:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265251.650388:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265251.841669:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417457536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265251.841744:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265251.841836:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417457536 00000100:00100000:3.0:1789265251.841844:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417457536 00000100:00100000:3.0:1789265251.841889:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789265251.841897:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417457536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789265251.841931:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789265251.841973:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417457536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265251.841980:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789265251.842037:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417457536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265251.842799:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417457664:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265251.842909:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265251.843190:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417457664 00000100:00100000:2.0:1789265251.843196:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417457664 00000100:00100000:2.0:1789265251.843231:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789265251.843238:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417457664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789265251.843261:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789265251.843301:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417457664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265251.843308:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789265251.843500:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417457664:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1789265251.949497:0:11317:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.105 00000100:00100000:1.0:1789265252.353486:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265252.353510:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417457792:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265252.353600:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265252.353817:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417457792 00000100:00100000:2.0:1789265252.353826:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417457792 00000100:00100000:2.0:1789265252.353893:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789265252.353904:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417457792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789265252.353932:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265252.353991:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417457792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265252.354001:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1789265252.354264:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83ddaa00 x1876180417457792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265252.354289:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417457792:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789265252.354361:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265252.354681:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417457920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265252.354717:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265252.354869:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417457920 00000100:00100000:0.0:1789265252.354874:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417457920 00000100:00100000:0.0:1789265252.354926:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789265252.354935:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417457920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265252.354959:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789265252.355018:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265252.358427:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417457920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3483us (3699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265252.358441:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1789265252.358775:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd332680 x1876180417457920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265252.358808:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417457920:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789265252.674591:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265252.679885:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265252.679921:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265252.679961:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265252.680547:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399564416 00000100:00100000:0.0:1789265252.680559:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399564416 00000100:00100000:0.0:1789265252.680643:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399564288 00000100:00100000:0.0:1789265252.680647:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399564288 00000100:00100000:0.0:1789265252.680676:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 97 00000100:00100000:0.0:1789265252.680688:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399564416:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265252.680802:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399564160 00000100:00100000:1.0:1789265252.680807:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399564160 00000100:00100000:1.0:1789265252.680840:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 283 00000100:00100000:1.0:1789265252.680848:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:2395:x1876180399564160:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265252.680919:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 98 00000100:00100000:2.0:1789265252.680929:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399564288:12345-192.168.203.49@tcp:400:kworker.0 00000100:00080000:3.0:1789265252.681015:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265252.681019:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265252.685854:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399564416:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 5158us (5919us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265252.685869:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 97 00000100:00100000:1.0:1789265252.687083:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:2395:x1876180399564160:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 6218us (7190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265252.687096:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 283 00000100:00100000:2.0:1789265252.699359:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399564288:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 18418us (19383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265252.699374:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 98 00000001:02000400:2.0:1789265253.687508:0:11365:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 12 22:07:32 EDT 2026 00010000:00010000:3.0:1789265253.697871:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265253.890860:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265253.890881:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417458048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265253.890948:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265253.891010:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417458048 00000100:00100000:3.0:1789265253.891017:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417458048 00000100:00100000:3.0:1789265253.891101:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789265253.891121:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417458048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789265253.891148:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265253.891192:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417458048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265253.891199:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1789265253.891220:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789265253.891247:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd332680 x1876180417458048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265253.891264:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417458048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265254.401411:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417458432:0@lo:400:kworker.0 00000100:00100000:1.0:1789265254.401480:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265254.401542:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417458944:0@lo:400:kworker.0 00000100:00100000:1.0:1789265254.401567:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265254.401582:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180417459456:0@lo:400:kworker.0 00000100:00100000:1.0:1789265254.401600:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265254.401624:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789265254.401629:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417458304:0@lo:400:kworker.0 00000100:00100000:1.0:1789265254.401648:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265254.401676:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180417458816:0@lo:400:kworker.0 00000100:00100000:1.0:1789265254.401693:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265254.401706:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180417459328:0@lo:400:kworker.0 00000100:00100000:1.0:1789265254.401721:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265254.401749:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417458432 00000100:00100000:1.0:1789265254.401757:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417458432 00000100:00100000:1.0:1789265254.401809:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789265254.401818:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417458432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265254.401868:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417458432:12345-0@lo:400:kworker.0 Request processed in 51us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265254.401876:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789265254.401898:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417458944 00000100:00100000:1.0:1789265254.401902:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417458944 00000100:00100000:1.0:1789265254.401931:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417459456 00000100:00100000:1.0:1789265254.401934:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417459456 00000100:00100000:1.0:1789265254.401945:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417458304 00000100:00100000:1.0:1789265254.401947:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417458304 00000100:00100000:1.0:1789265254.401956:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417458816 00000100:00100000:1.0:1789265254.401959:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417458816 00000100:00100000:1.0:1789265254.401969:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417459328 00000100:00100000:1.0:1789265254.401972:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417459328 00000100:00100000:1.0:1789265254.401985:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789265254.401991:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417458944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265254.402047:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417458944:12345-0@lo:400:kworker.0 Request processed in 30us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265254.402064:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789265254.402077:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789265254.402084:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180417459456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265254.402122:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180417459456:12345-0@lo:400:kworker.0 Request processed in 39us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265254.402128:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789265254.402141:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789265254.402147:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417458304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265254.402173:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417458304:12345-0@lo:400:kworker.0 Request processed in 26us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265254.402179:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789265254.402189:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789265254.402196:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180417458816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265254.402361:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417458176:0@lo:400:kworker.0 00000100:00100000:2.0:1789265254.402395:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265254.402422:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417458688:0@lo:400:kworker.0 00000100:00100000:2.0:1789265254.402443:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265254.402455:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417459200:0@lo:400:kworker.0 00000100:00100000:2.0:1789265254.402477:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265254.402496:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789265254.402502:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417458560:0@lo:400:kworker.0 00000100:00100000:2.0:1789265254.402535:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265254.402552:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417459072:0@lo:400:kworker.0 00000100:00100000:2.0:1789265254.402571:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265254.402585:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417459584:0@lo:400:kworker.0 00000100:00100000:2.0:1789265254.402604:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265254.402634:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417458688 00000100:00100000:2.0:1789265254.402638:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417458688 00000100:00100000:2.0:1789265254.402659:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789265254.402673:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789265254.402674:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180417459328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265254.402682:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417458688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265254.402705:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180417459328:12345-0@lo:400:kworker.0 Request processed in 34us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265254.402712:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789265254.402713:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417458688:12345-0@lo:400:kworker.0 Request processed in 33us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265254.402718:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789265254.402732:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417458560 00000100:00100000:2.0:1789265254.402735:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417458560 00000100:00100000:2.0:1789265254.402755:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789265254.402755:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265254.402760:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417458560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265254.402762:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417459712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265254.402789:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417458560:12345-0@lo:400:kworker.0 Request processed in 29us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265254.402794:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789265254.402811:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417458176 00000100:00100000:2.0:1789265254.402814:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417458176 00000100:00100000:0.0:1789265254.402818:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265254.402836:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789265254.402842:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417458176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265254.402843:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417459712 00000100:00100000:0.0:1789265254.402846:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417459712 00000100:00100000:2.0:1789265254.402869:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417458176:12345-0@lo:400:kworker.0 Request processed in 27us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265254.402874:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789265254.402874:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789265254.402880:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf548380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417459712:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265254.402897:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417459200 00000100:00100000:2.0:1789265254.402899:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417459200 00002000:00000024:0.0:1789265254.402902:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265254.402920:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417459072 00000100:00100000:2.0:1789265254.402923:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417459072 00000100:00100000:2.0:1789265254.402935:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417459584 00000100:00100000:0.0:1789265254.402935:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf548380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417459712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265254.402937:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417459584 00000100:00100000:0.0:1789265254.402941:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789265254.402946:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789265254.402951:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417459200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265254.402960:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789265254.402966:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417459072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265254.402978:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417459200:12345-0@lo:400:kworker.0 Request processed in 27us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265254.402988:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417459072:12345-0@lo:400:kworker.0 Request processed in 23us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265254.402989:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789265254.402993:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789265254.402999:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789265254.403004:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417459584:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789265254.403041:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf548e00 x1876180417459712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265254.403052:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417459584:12345-0@lo:400:kworker.0 Request processed in 48us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265254.403057:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789265254.403058:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417459712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265254.403084:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417458560:0@lo:400:kworker.0 00010000:00080000:0.0:1789265254.403105:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc837e3b80 x1876180417459072/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789265254.403112:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265254.403114:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417459072:0@lo:400:kworker.0 00000100:00080000:2.0:1789265254.403116:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265254.403118:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265254.403120:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789265254.403123:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc837e0a80 x1876180417459584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265254.403130:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417459584:0@lo:400:kworker.0 00000100:00100000:0.0:1789265254.403137:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417458176:0@lo:400:kworker.0 00000100:00100000:0.0:1789265254.403146:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417458688:0@lo:400:kworker.0 00010000:00080000:0.0:1789265254.403154:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc837e0700 x1876180417459200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265254.403169:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417459200:0@lo:400:kworker.0 00000100:00100000:0.0:1789265254.403211:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417458304:0@lo:400:kworker.0 00000100:00100000:0.0:1789265254.403222:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180417459328:0@lo:400:kworker.0 00000100:00100000:0.0:1789265254.403232:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417458432:0@lo:400:kworker.0 00010000:00080000:0.0:1789265254.403243:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc837e3100 x1876180417458944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265254.403250:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417458944:0@lo:400:kworker.0 00010000:00080000:0.0:1789265254.403258:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc837e1180 x1876180417459456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265254.403265:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180417459456:0@lo:400:kworker.0 00000100:00100000:1.0:1789265254.403352:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180417458816:12345-0@lo:400:kworker.0 Request processed in 1155us (1655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265254.403359:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789265254.403545:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180417458816:0@lo:400:kworker.0 00010000:00010000:0.0:1789265254.721224:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265255.747227:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265256.769443:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265256.963329:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417459840:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265256.963430:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265256.963463:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417459840 00000100:00100000:2.0:1789265256.963472:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417459840 00000100:00100000:0.0:1789265256.963512:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265256.963520:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417459968:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265256.963539:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789265256.963545:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265256.963552:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417459840:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265256.963575:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417459968 00000100:00100000:0.0:1789265256.963580:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417459968 00000004:00000024:2.0:1789265256.963586:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789265256.963603:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789265256.963611:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417459968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789265256.963642:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789265256.963644:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417459840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265256.963654:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789265256.963681:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417459968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265256.963689:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789265256.963726:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417459968:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265256.963736:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417459840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265257.475839:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265257.475866:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417460096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265257.475949:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265257.476037:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417460096 00000100:00100000:3.0:1789265257.476044:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417460096 00000100:00100000:3.0:1789265257.476100:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789265257.476109:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417460096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265257.476137:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265257.476180:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417460096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265257.476187:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1789265257.476231:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd331500 x1876180417460096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265257.476247:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417460096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265257.477062:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265257.477077:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417460224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265257.477121:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265257.477165:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417460224 00000100:00100000:0.0:1789265257.477170:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417460224 00000100:00100000:0.0:1789265257.477211:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789265257.477218:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf548700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417460224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789265257.477232:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265257.477266:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf548700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417460224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265257.477272:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1789265257.477302:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd3e4000 x1876180417460224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265257.477316:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417460224:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789265257.477385:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789265257.793298:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265257.801005:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265257.801104:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265257.801142:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265257.801177:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399564544 00000100:00100000:1.0:1789265257.801177:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399564672 00000100:00100000:3.0:1789265257.801187:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399564544 00000100:00100000:1.0:1789265257.801187:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399564672 00000100:00100000:1.0:1789265257.801251:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399564800 00000100:00100000:3.0:1789265257.801255:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 285 00000100:00100000:1.0:1789265257.801257:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399564800 00000100:00100000:3.0:1789265257.801271:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:2394:x1876180399564544:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265257.801288:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 105 00000100:00100000:1.0:1789265257.801297:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+6:2394:x1876180399564672:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265257.801346:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+6:2394:x1876180399564672:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 50us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265257.801417:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:2394:x1876180399564544:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 150us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265257.801426:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 285 00000100:00100000:2.0:1789265257.801509:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 106 00000100:00100000:2.0:1789265257.801519:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399564800:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265257.801566:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399564800:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 49us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265257.801574:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 106 00000100:00100000:1.0:1789265257.801693:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 105 00000100:00080000:1.0:1789265257.801721:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265257.801726:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789265258.817480:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265259.013455:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417460352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265259.013643:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265259.013737:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417460352 00000100:00100000:1.0:1789265259.013744:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417460352 00000100:00100000:1.0:1789265259.013797:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789265259.013807:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417460352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789265259.013834:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265259.013878:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417460352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265259.013885:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1789265259.013905:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789265259.013935:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd3e4000 x1876180417460352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265259.013953:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417460352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265259.521424:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417460480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265259.521508:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265259.521739:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf54f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417460736:0@lo:400:kworker.0 00000100:00100000:3.0:1789265259.521771:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265259.521793:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf54ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417461248:0@lo:400:kworker.0 00000100:00100000:3.0:1789265259.521812:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265259.521828:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf54c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180417461760:0@lo:400:kworker.0 00000100:00100000:3.0:1789265259.521872:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265259.521896:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789265259.521913:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417460608:0@lo:400:kworker.0 00000100:00100000:3.0:1789265259.521938:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265259.521956:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf54c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417461120:0@lo:400:kworker.0 00000100:00100000:3.0:1789265259.521973:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265259.521986:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf54ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417461632:0@lo:400:kworker.0 00000100:00100000:3.0:1789265259.522005:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265259.522054:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417460736 00000100:00100000:3.0:1789265259.522060:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417460736 00000100:00100000:3.0:1789265259.522098:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417461248 00000100:00100000:3.0:1789265259.522101:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417461248 00000100:00100000:3.0:1789265259.522119:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417461760 00000100:00100000:3.0:1789265259.522121:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417461760 00000100:00100000:3.0:1789265259.522131:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417461120 00000100:00100000:3.0:1789265259.522133:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417461120 00000100:00100000:3.0:1789265259.522171:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789265259.522178:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417460736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265259.522227:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417460736:12345-0@lo:400:kworker.0 Request processed in 49us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265259.522235:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789265259.522252:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789265259.522261:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417461248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265259.522288:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417461248:12345-0@lo:400:kworker.0 Request processed in 31us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265259.522294:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789265259.522304:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789265259.522316:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876180417461760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265259.522346:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876180417461760:12345-0@lo:400:kworker.0 Request processed in 31us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265259.522351:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789265259.522363:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789265259.522368:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417461120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265259.522394:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417461120:12345-0@lo:400:kworker.0 Request processed in 26us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265259.522399:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789265259.522427:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417460608 00000100:00100000:3.0:1789265259.522430:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417460608 00000100:00100000:3.0:1789265259.522454:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789265259.522461:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417460608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265259.522500:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417460608:12345-0@lo:400:kworker.0 Request processed in 40us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265259.522507:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789265259.522537:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417461632 00000100:00100000:3.0:1789265259.522541:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417461632 00000100:00100000:3.0:1789265259.522568:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789265259.522574:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417461632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265259.524316:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417460480 00000100:00100000:0.0:1789265259.524328:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417460480 00000100:00100000:0.0:1789265259.524393:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789265259.524417:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417460480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265259.524440:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265259.524518:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417460480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (3009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265259.524525:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789265259.524624:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf54dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417460992:0@lo:400:kworker.0 00000100:00100000:1.0:1789265259.524665:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265259.524702:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf54e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417461504:0@lo:400:kworker.0 00000100:00100000:1.0:1789265259.524726:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789265259.524765:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf549f80 x1876180417460480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265259.524789:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417460480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265259.524815:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789265259.524823:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf54ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417460864:0@lo:400:kworker.0 00000100:00100000:1.0:1789265259.524847:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265259.524864:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf54e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417461376:0@lo:400:kworker.0 00000100:00100000:1.0:1789265259.524937:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265259.524959:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf54f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180417461888:0@lo:400:kworker.0 00000100:00100000:1.0:1789265259.524980:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265259.525007:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417461504 00000100:00100000:1.0:1789265259.525011:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417461504 00000100:00100000:1.0:1789265259.525073:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789265259.525080:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417461504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265259.525181:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417460992 00000100:00100000:0.0:1789265259.525187:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417460992 00000100:00100000:0.0:1789265259.525214:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417460864 00000100:00100000:0.0:1789265259.525216:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417460864 00000100:00100000:0.0:1789265259.525229:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789265259.525234:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417460992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265259.525278:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417460992:12345-0@lo:400:kworker.0 Request processed in 43us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265259.525284:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789265259.525295:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789265259.525300:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417460864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265259.525323:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417460864:12345-0@lo:400:kworker.0 Request processed in 23us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265259.525328:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789265259.525357:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf54ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417460864:0@lo:400:kworker.0 00000100:00100000:0.0:1789265259.525365:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf54dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417460992:0@lo:400:kworker.0 00000100:00080000:2.0:1789265259.525446:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265259.525451:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789265259.525460:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265259.525470:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417461376 00000100:00100000:2.0:1789265259.525474:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417461376 00000100:00100000:2.0:1789265259.525519:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417461888 00000100:00100000:2.0:1789265259.525522:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417461888 00000100:00100000:2.0:1789265259.525538:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789265259.525544:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417461376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265259.525576:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417461376:12345-0@lo:400:kworker.0 Request processed in 33us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265259.525582:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789265259.525592:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789265259.525597:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180417461888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265259.525616:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180417461888:12345-0@lo:400:kworker.0 Request processed in 20us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265259.525622:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789265259.525645:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417460608:0@lo:400:kworker.0 00000100:00100000:2.0:1789265259.525657:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf54c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417461120:0@lo:400:kworker.0 00000100:00100000:2.0:1789265259.525667:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf54f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417460736:0@lo:400:kworker.0 00000100:00100000:2.0:1789265259.525677:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf54ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417461248:0@lo:400:kworker.0 00000100:00100000:2.0:1789265259.525685:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf54c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180417461760:0@lo:400:kworker.0 00000100:00080000:0.0:1789265259.525775:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789265259.525793:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf54e300 x1876180417461376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265259.525804:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf54e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417461376:0@lo:400:kworker.0 00010000:00080000:0.0:1789265259.525822:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf54f480 x1876180417461888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265259.525830:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf54f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180417461888:0@lo:400:kworker.0 00000100:00100000:3.0:1789265259.528561:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417461632:12345-0@lo:400:kworker.0 Request processed in 5977us (6544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265259.528575:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789265259.529114:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417461504:12345-0@lo:400:kworker.0 Request processed in 4033us (4385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265259.529121:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1789265259.529221:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf54e680 x1876180417461504/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265259.529235:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf54e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417461504:0@lo:400:kworker.0 00010000:00080000:2.0:1789265259.529545:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf54ce00 x1876180417461632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265259.529556:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf54ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417461632:0@lo:400:kworker.0 00010000:00010000:1.0:1789265259.843837:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265260.865164:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265261.891362:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265262.086347:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417462016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265262.086417:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265262.086630:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417462016 00000100:00100000:3.0:1789265262.086637:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417462016 00000100:00100000:3.0:1789265262.086679:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789265262.086686:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417462016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789265262.086715:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789265262.086758:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417462016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265262.086765:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789265262.086811:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417462016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265262.087209:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417462144:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265262.087239:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265262.087335:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417462144 00000100:00100000:3.0:1789265262.087339:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417462144 00000100:00100000:3.0:1789265262.087365:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789265262.087371:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417462144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265262.087390:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789265262.087424:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417462144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265262.087430:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789265262.088398:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417462144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265262.593311:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265262.593342:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417462272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265262.593442:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265262.593614:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417462272 00000100:00100000:1.0:1789265262.593624:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417462272 00000100:00100000:1.0:1789265262.593700:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789265262.593713:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf549880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417462272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789265262.593763:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265262.593820:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf549880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417462272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265262.593827:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1789265262.593878:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83b91880 x1876180417462272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265262.594049:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417462272:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789265262.594169:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265262.598244:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417462400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265262.598347:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265262.598463:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417462400 00000100:00100000:0.0:1789265262.598473:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417462400 00000100:00100000:0.0:1789265262.598558:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789265262.598569:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417462400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265262.598599:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789265262.601122:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265262.603861:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417462400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5277us (5497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265262.603879:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1789265262.604258:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83b91880 x1876180417462400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265262.604293:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417462400:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789265262.913775:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265262.926933:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265262.926980:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265262.927009:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265262.927068:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399565184 00000100:00100000:2.0:1789265262.927078:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399565184 00000100:00100000:2.0:1789265262.927134:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399565056 00000100:00100000:2.0:1789265262.927138:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399565056 00000100:00100000:2.0:1789265262.927162:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 113 00000100:00100000:2.0:1789265262.927173:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399565184:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265262.927244:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399565184:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 72us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265262.927250:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 113 00000100:00100000:2.0:1789265262.927267:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 114 00000100:00100000:2.0:1789265262.927274:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+6:2396:x1876180399565056:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265262.927296:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+6:2396:x1876180399565056:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 23us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265262.927302:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 114 00000100:00100000:3.0:1789265262.927417:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399564928 00000100:00100000:3.0:1789265262.927422:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399564928 00000100:00100000:3.0:1789265262.927469:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 287 00000100:00100000:3.0:1789265262.927487:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:2396:x1876180399564928:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265262.927514:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:2396:x1876180399564928:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 28us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265262.927520:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 287 00000100:00080000:3.0:1789265262.927546:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265262.927549:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789265263.945536:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265264.129792:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417462528:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265264.129866:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265264.129999:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417462528 00000100:00100000:2.0:1789265264.130007:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417462528 00000100:00100000:2.0:1789265264.130161:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789265264.130171:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417462528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789265264.130214:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265264.130262:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417462528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265264.130269:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1789265264.130432:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789265264.130664:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83b91880 x1876180417462528/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265264.130684:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417462528:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265264.641293:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265264.641327:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417462656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265264.641423:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265264.641525:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417462656 00000100:00100000:3.0:1789265264.641535:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417462656 00000100:00100000:3.0:1789265264.641610:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789265264.641621:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417462656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265264.641652:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265264.641962:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417462912:0@lo:400:kworker.0 00000100:00100000:1.0:1789265264.642051:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265264.642077:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417463424:0@lo:400:kworker.0 00000100:00100000:1.0:1789265264.642100:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265264.642125:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417463936:0@lo:400:kworker.0 00000100:00100000:1.0:1789265264.642146:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265264.642172:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789265264.642178:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417463040:0@lo:400:kworker.0 00000100:00100000:1.0:1789265264.642205:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265264.642229:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417463552:0@lo:400:kworker.0 00000100:00100000:1.0:1789265264.642251:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265264.642268:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417464064:0@lo:400:kworker.0 00000100:00100000:1.0:1789265264.642291:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265264.642320:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417462912 00000100:00100000:1.0:1789265264.642325:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417462912 00000100:00100000:1.0:1789265264.642352:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417463424 00000100:00100000:1.0:1789265264.642355:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417463424 00000100:00100000:1.0:1789265264.642371:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417463936 00000100:00100000:1.0:1789265264.642374:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417463936 00000100:00100000:1.0:1789265264.642386:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417463552 00000100:00100000:1.0:1789265264.642389:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417463552 00000100:00100000:1.0:1789265264.642400:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417464064 00000100:00100000:1.0:1789265264.642403:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417464064 00000100:00100000:1.0:1789265264.642416:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789265264.642423:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417462912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265264.642484:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417462912:12345-0@lo:400:kworker.0 Request processed in 60us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265264.642493:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789265264.642520:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789265264.642526:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417463424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265264.642555:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417463424:12345-0@lo:400:kworker.0 Request processed in 29us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265264.642562:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789265264.642573:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789265264.642578:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417463936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265264.642604:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417463936:12345-0@lo:400:kworker.0 Request processed in 25us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265264.642610:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789265264.642620:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789265264.642626:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417463552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265264.642650:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417463552:12345-0@lo:400:kworker.0 Request processed in 24us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265264.642656:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789265264.642666:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789265264.642671:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417464064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265264.642694:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417464064:12345-0@lo:400:kworker.0 Request processed in 23us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265264.643900:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417462656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2273us (2469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265264.643914:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1789265264.643963:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265264.643969:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265264.643974:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265264.644001:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417462784:0@lo:400:kworker.0 00000100:00100000:3.0:1789265264.644078:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265264.644125:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417463296:0@lo:400:kworker.0 00000100:00100000:3.0:1789265264.644167:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265264.644181:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417463808:0@lo:400:kworker.0 00000100:00100000:3.0:1789265264.644208:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789265264.644253:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83b91880 x1876180417462656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265264.644281:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417462656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265264.644315:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789265264.644322:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417463168:0@lo:400:kworker.0 00000100:00100000:3.0:1789265264.644348:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265264.644368:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417463680:0@lo:400:kworker.0 00000100:00100000:3.0:1789265264.644389:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265264.644423:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417462784 00000100:00100000:3.0:1789265264.644431:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417462784 00000100:00100000:3.0:1789265264.644490:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789265264.644500:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417462784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265264.644547:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417462784:12345-0@lo:400:kworker.0 Request processed in 48us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265264.644554:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789265264.644582:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417463040 00000100:00100000:3.0:1789265264.644586:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417463040 00000100:00100000:3.0:1789265264.644609:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417463168 00000100:00100000:3.0:1789265264.644612:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417463168 00000100:00100000:3.0:1789265264.644626:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789265264.644632:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417463040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265264.644669:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417463040:12345-0@lo:400:kworker.0 Request processed in 37us (2462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265264.644686:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789265264.644944:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417463808 00000100:00100000:2.0:1789265264.644949:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417463808 00000100:00100000:2.0:1789265264.644989:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417463680 00000100:00100000:2.0:1789265264.644992:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417463680 00000100:00100000:2.0:1789265264.645014:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789265264.645034:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417463808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265264.645074:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417463808:12345-0@lo:400:kworker.0 Request processed in 54us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265264.645080:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789265264.645093:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789265264.645098:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417463680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265264.645119:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417463680:12345-0@lo:400:kworker.0 Request processed in 21us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265264.645125:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789265264.645347:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789265264.645379:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417463296 00000100:00100000:1.0:1789265264.645383:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417463296 00000100:00100000:1.0:1789265264.645401:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789265264.645407:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417463296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265264.645459:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417463296:12345-0@lo:400:kworker.0 Request processed in 51us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265264.645474:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789265264.645591:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789265264.645602:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417463168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265264.645636:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417463168:12345-0@lo:400:kworker.0 Request processed in 37us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265264.645714:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417463040:0@lo:400:kworker.0 00010000:00080000:1.0:1789265264.645734:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc8376ce00 x1876180417463552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265264.645746:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417463552:0@lo:400:kworker.0 00010000:00080000:1.0:1789265264.645759:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccb5c12a00 x1876180417464064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265264.645768:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417464064:0@lo:400:kworker.0 00000100:00100000:1.0:1789265264.645780:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417462912:0@lo:400:kworker.0 00000100:00100000:1.0:1789265264.645792:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417463424:0@lo:400:kworker.0 00000100:00100000:1.0:1789265264.645803:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417463936:0@lo:400:kworker.0 00000100:00100000:2.0:1789265264.646917:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417463168:0@lo:400:kworker.0 00010000:00080000:2.0:1789265264.646935:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc8376ca80 x1876180417463680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265264.646945:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417463680:0@lo:400:kworker.0 00000100:00100000:2.0:1789265264.646967:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417462784:0@lo:400:kworker.0 00000100:00100000:2.0:1789265264.646991:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417463296:0@lo:400:kworker.0 00010000:00080000:2.0:1789265264.647004:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccb5c10700 x1876180417463808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265264.647013:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417463808:0@lo:400:kworker.0 00000100:00100000:3.0:1789265264.647358:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1789265264.647535:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789265264.972129:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265265.993016:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265267.009503:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265267.201510:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf54bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417464192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265267.201612:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265267.201807:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417464192 00000100:00100000:0.0:1789265267.201818:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417464192 00000100:00100000:0.0:1789265267.201882:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789265267.201893:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417464192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789265267.201937:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789265267.202060:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417464192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 168us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265267.202068:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789265267.202238:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf54bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417464192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265267.202625:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265267.202636:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf54ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417464320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265267.202679:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265267.202786:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417464320 00000100:00100000:3.0:1789265267.202792:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417464320 00000100:00100000:3.0:1789265267.202833:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789265267.202841:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417464320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265267.202865:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789265267.202916:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417464320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265267.202923:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789265267.203002:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf54ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417464320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265267.713431:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417464448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265267.713530:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265267.713709:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417464576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265267.713742:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265267.713790:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417464448 00000100:00100000:2.0:1789265267.713800:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417464448 00000100:00100000:2.0:1789265267.713865:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417464576 00000100:00100000:2.0:1789265267.713868:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417464576 00000100:00100000:2.0:1789265267.713889:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789265267.713898:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417464448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265267.713933:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265267.713977:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417464448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265267.713984:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789265267.714019:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789265267.714055:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417464576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789265267.714066:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265267.714098:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417464576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265267.714103:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1789265267.714120:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789265267.714160:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83ddaa00 x1876180417464576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265267.714181:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417464576:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1789265267.714495:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83bb9880 x1876180417464448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265267.714511:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417464448:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789265268.033589:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265268.042894:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265268.042944:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265268.042980:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265268.043152:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399565568 00000100:00100000:1.0:1789265268.043165:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399565568 00000100:00100000:1.0:1789265268.043241:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399565440 00000100:00100000:1.0:1789265268.043244:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399565440 00000100:00100000:1.0:1789265268.043269:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 121 00000100:00100000:1.0:1789265268.043279:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399565568:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265268.043375:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399565568:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 97us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265268.043401:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 121 00000100:00100000:1.0:1789265268.043439:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 122 00000100:00100000:1.0:1789265268.043447:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399565440:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265268.043477:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399565440:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 31us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265268.043483:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 122 00000100:00080000:2.0:1789265268.044296:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265268.044305:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265268.044707:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399565312 00000100:00100000:3.0:1789265268.044718:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399565312 00000100:00100000:3.0:1789265268.044809:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 289 00000100:00100000:3.0:1789265268.044820:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:2395:x1876180399565312:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265268.044894:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:2395:x1876180399565312:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 76us (2014us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265268.044916:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 289 00000001:02000400:1.0:1789265268.355604:0:11994:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 22:07:47 (1789265267) === 00000100:00100000:2.0:1789265268.964420:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265268.964770:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399565696 00000100:00100000:3.0:1789265268.964783:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399565696 00000100:00100000:3.0:1789265268.964856:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 290 00000100:00100000:3.0:1789265268.964869:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:8723:x1876180399565696:12345-192.168.203.49@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789265268.964891:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265268.964913:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc882b6600/0x9272d942b4a96706 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbcb6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265268.964950:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc882b6600/0x9272d942b4a96706 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbcb6 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265268.965132:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc882b6600/0x9272d942b4a96706 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbcb6 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265268.965144:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6600, rc 0) 00000100:00100000:3.0:1789265268.965230:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+11:8723:x1876180399565696:12345-192.168.203.49@tcp:101:mount.lustre.0 Request processed in 363us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265268.965237:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 290 00000100:00100000:1.0:1789265268.985898:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265268.986075:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399565824 00000100:00100000:2.0:1789265268.986089:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399565824 00000100:00100000:2.0:1789265268.986162:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 291 00000100:00100000:2.0:1789265268.986175:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f6ab780-f65a-4da8-8aa9-108982c08b32+11:8723:x1876180399565824:12345-192.168.203.49@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789265268.986560:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f6ab780-f65a-4da8-8aa9-108982c08b32+11:8723:x1876180399565824:12345-192.168.203.49@tcp:501:mount.lustre.0 Request processed in 386us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265268.986569:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 291 00000100:00100000:1.0:1789265268.990872:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265268.990980:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399565952 00000100:00100000:3.0:1789265268.990993:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399565952 00000100:00100000:3.0:1789265268.991104:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 292 00000100:00100000:3.0:1789265268.991116:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+11:8723:x1876180399565952:12345-192.168.203.49@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789265268.991375:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+11:8723:x1876180399565952:12345-192.168.203.49@tcp:503:mount.lustre.0 Request processed in 260us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265268.991384:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 292 00000100:00100000:3.0:1789265269.006310:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265269.006618:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399566080 00000100:00100000:0.0:1789265269.006631:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399566080 00000100:00100000:0.0:1789265269.006712:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 293 00000100:00100000:0.0:1789265269.006723:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+11:8727:x1876180399566080:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789265269.006944:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+11:8727:x1876180399566080:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 223us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265269.006961:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 293 00000100:00100000:1.0:1789265269.044885:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265269.045064:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399566208 00000100:00100000:3.0:1789265269.045079:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399566208 00000100:00100000:3.0:1789265269.045162:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 294 00000100:00100000:3.0:1789265269.045175:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+11:8727:x1876180399566208:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789265269.045391:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+11:8727:x1876180399566208:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 218us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265269.045401:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 294 00000100:00100000:1.0:1789265269.050086:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265269.057017:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399566336 00000100:00100000:0.0:1789265269.057083:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399566336 00000100:00100000:0.0:1789265269.057177:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 295 00000100:00100000:0.0:1789265269.057188:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+11:8727:x1876180399566336:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789265269.057399:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+11:8727:x1876180399566336:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 212us (7384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265269.057408:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 295 00010000:00010000:3.0:1789265269.057594:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265269.061109:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265269.061217:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399566464 00000100:00100000:3.0:1789265269.061231:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399566464 00000100:00100000:3.0:1789265269.061312:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 296 00000100:00100000:3.0:1789265269.061325:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+11:8723:x1876180399566464:12345-192.168.203.49@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789265269.061348:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265269.061373:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc882b6000/0x9272d942b4a9670d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbce7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265269.061424:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc882b6000/0x9272d942b4a9670d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbce7 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265269.061439:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc882b6000/0x9272d942b4a9670d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbce7 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265269.061452:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6000, rc 0) 00000100:00100000:3.0:1789265269.061531:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+12:8723:x1876180399566464:12345-192.168.203.49@tcp:101:mount.lustre.0 Request processed in 208us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265269.061544:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 296 00000100:00100000:1.0:1789265269.068113:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265269.068363:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399566592 00000100:00100000:0.0:1789265269.068377:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399566592 00000100:00100000:0.0:1789265269.068475:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 297 00000100:00100000:0.0:1789265269.068487:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+12:8723:x1876180399566592:12345-192.168.203.49@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789265269.068520:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789265269.068564:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789265269.068569:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789265269.068573:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789265269.068599:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789265269.068602:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789265269.078193:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+12:8723:x1876180399566592:12345-192.168.203.49@tcp:256:mount.lustre.0 Request processed in 9691us (10082us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265269.078213:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 297 00000100:00100000:3.0:1789265269.101168:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265269.101379:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399566720 00000100:00100000:2.0:1789265269.101393:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399566720 00000100:00100000:2.0:1789265269.101475:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 298 00000100:00100000:2.0:1789265269.101487:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+12:8723:x1876180399566720:12345-192.168.203.49@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789265269.101530:0:7458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265269.101556:0:7458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccb520bc00/0x9272d942b4a96714 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbcee expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265269.101596:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccb520bc00/0x9272d942b4a96714 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbcee expref: 13 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265269.101609:0:7458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccb520bc00/0x9272d942b4a96714 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbcee expref: 13 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265269.101619:0:7458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520bc00, rc 0) 00000100:00100000:2.0:1789265269.101708:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:8723:x1876180399566720:12345-192.168.203.49@tcp:101:mount.lustre.0 Request processed in 223us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265269.101717:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 298 00000100:00100000:1.0:1789265269.105180:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265269.105301:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399566848 00000100:00100000:2.0:1789265269.105315:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399566848 00000100:00100000:2.0:1789265269.105391:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 299 00000100:00100000:2.0:1789265269.105403:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:8723:x1876180399566848:12345-192.168.203.49@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789265269.105794:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:8723:x1876180399566848:12345-192.168.203.49@tcp:501:mount.lustre.0 Request processed in 392us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265269.105804:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 299 00000100:00100000:1.0:1789265269.116565:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265269.116693:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399566976 00000100:00100000:2.0:1789265269.116706:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399566976 00000100:00100000:2.0:1789265269.116777:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 300 00000100:00100000:2.0:1789265269.116789:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:8723:x1876180399566976:12345-192.168.203.49@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789265269.117132:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:8723:x1876180399566976:12345-192.168.203.49@tcp:503:mount.lustre.0 Request processed in 343us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265269.117150:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 300 00000100:00100000:3.0:1789265269.123690:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265269.123855:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399567104 00000100:00100000:0.0:1789265269.123867:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399567104 00000100:00100000:0.0:1789265269.123952:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 301 00000100:00100000:0.0:1789265269.123964:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:8733:x1876180399567104:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789265269.124204:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:8733:x1876180399567104:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 241us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265269.124213:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 301 00000100:00100000:1.0:1789265269.132878:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265269.133151:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399567232 00000100:00100000:2.0:1789265269.133165:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399567232 00000100:00100000:2.0:1789265269.133242:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 302 00000100:00100000:2.0:1789265269.133255:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:8733:x1876180399567232:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265269.133465:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:8733:x1876180399567232:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 211us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265269.133474:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 302 00000100:00100000:1.0:1789265269.151336:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265269.151379:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265269.151421:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265269.151460:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265269.151498:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399568000 00000100:00100000:1.0:1789265269.151507:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399568000 00000100:00100000:1.0:1789265269.151554:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399568128 00000100:00100000:1.0:1789265269.151558:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399568128 00000100:00100000:1.0:1789265269.151570:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399567360 00000100:00100000:1.0:1789265269.151572:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399567360 00000100:00100000:1.0:1789265269.151578:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399567616 00000100:00100000:1.0:1789265269.151579:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399567616 00000100:00100000:1.0:1789265269.151601:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 123 00000100:00100000:1.0:1789265269.151607:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+6:2394:x1876180399568000:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265269.151669:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+6:2394:x1876180399568000:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 61us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265269.151676:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 123 00000100:00100000:1.0:1789265269.151691:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 124 00000100:00100000:1.0:1789265269.151697:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399568128:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265269.151722:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399568128:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 25us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265269.151728:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 124 00000100:00100000:1.0:1789265269.151740:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 16 00000100:00100000:1.0:1789265269.151744:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1876180399567360:12345-192.168.203.49@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789265269.151765:0:6516:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a0766e4d-45ff-4def-8795-0d9246c8f4c4@192.168.203.49@tcp t0 exp 0000000000000000 cur 320 last 0 00000020:00000080:1.0:1789265269.151800:0:6516:0:(genops.c:1385:class_connect()) connect: client a0766e4d-45ff-4def-8795-0d9246c8f4c4, cookie 0x9272d942b4a9671b 00000004:00100000:1.0:1789265269.151825:0:6516:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789265269.151938:0:6516:0:(import.c:65:import_set_state_nolock()) ffff9fcb8391b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265269.151974:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:2392:x1876180399567360:12345-192.168.203.49@tcp:38:mount.lustre.0 Request processed in 228us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265269.151981:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 16 00000100:00100000:1.0:1789265269.151993:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 17 00000100:00100000:1.0:1789265269.152928:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1876180399567616:12345-192.168.203.49@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789265269.153466:0:6516:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from a0766e4d-45ff-4def-8795-0d9246c8f4c4@192.168.203.49@tcp t0 exp 0000000000000000 cur 320 last 0 00000020:00000080:1.0:1789265269.153500:0:6516:0:(genops.c:1385:class_connect()) connect: client a0766e4d-45ff-4def-8795-0d9246c8f4c4, cookie 0x9272d942b4a96722 00000004:00100000:1.0:1789265269.153524:0:6516:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789265269.155223:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265269.155307:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265269.155735:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399567488 00000100:00100000:2.0:1789265269.155745:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399567488 00000100:00100000:2.0:1789265269.155812:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399567872 00000100:00100000:2.0:1789265269.155816:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399567872 00000100:00100000:2.0:1789265269.155837:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 18 00000100:00100000:2.0:1789265269.155846:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf549180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+7:0:x1876180399567488:12345-192.168.203.49@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789265269.155879:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00080000:1.0:1789265269.155908:0:6516:0:(import.c:65:import_set_state_nolock()) ffff9fcb8391f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265269.156009:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf549180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+7:0:x1876180399567488:12345-192.168.203.49@tcp:41:mount.lustre.0 Request processed in 163us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265269.156017:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 18 00000100:00100000:2.0:1789265269.156053:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 19 00000100:00100000:2.0:1789265269.156060:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:8723:x1876180399567872:12345-192.168.203.49@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789265269.156072:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789265269.156094:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:8723:x1876180399567872:12345-192.168.203.49@tcp:41:mount.lustre.0 Request processed in 34us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265269.156094:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:2392:x1876180399567616:12345-192.168.203.49@tcp:38:mount.lustre.0 Request processed in 4095us (4633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265269.156101:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 19 00000100:00100000:1.0:1789265269.156205:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 17 00000100:00080000:0.0:1789265269.156386:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265269.159771:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265269.164803:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399568256 00000100:00100000:2.0:1789265269.164818:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399568256 00000100:00100000:2.0:1789265269.164902:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 20 00000100:00100000:2.0:1789265269.164912:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:8723:x1876180399568256:12345-192.168.203.49@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789265269.165018:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:8723:x1876180399568256:12345-192.168.203.49@tcp:40:mount.lustre.0 Request processed in 107us (5256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265269.165043:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 20 00000100:00100000:2.0:1789265269.167584:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265269.168424:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399567744 00000100:00100000:1.0:1789265269.168436:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399567744 00000100:00100000:1.0:1789265269.168564:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 21 00000100:00100000:1.0:1789265269.168574:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:0:x1876180399567744:12345-192.168.203.49@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789265269.168609:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789265269.168765:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:0:x1876180399567744:12345-192.168.203.49@tcp:41:mount.lustre.0 Request processed in 192us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265269.168773:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 21 00000100:00080000:0.0:1789265269.170223:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265269.172017:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265269.172095:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265269.172214:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265269.172248:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265269.172282:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265269.172313:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265269.172334:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265269.172360:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399568896 00000100:00100000:3.0:1789265269.172369:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399568896 00000100:00100000:3.0:1789265269.172473:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399569152 00000100:00100000:3.0:1789265269.172477:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399569152 00000100:00100000:3.0:1789265269.172497:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399569024 00000100:00100000:3.0:1789265269.172499:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399569024 00000100:00100000:3.0:1789265269.172514:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 125 00000100:00100000:3.0:1789265269.172522:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+6:2393:x1876180399568896:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265269.172589:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+6:2393:x1876180399568896:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 68us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265269.172596:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 125 00000100:00100000:3.0:1789265269.172612:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 126 00000100:00100000:3.0:1789265269.172617:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:2393:x1876180399569152:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265269.172640:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:2393:x1876180399569152:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 23us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265269.172647:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 126 00000100:00100000:3.0:1789265269.172659:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 127 00000100:00100000:3.0:1789265269.172673:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2393:x1876180399569024:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265269.172699:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2393:x1876180399569024:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 28us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265269.172705:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 127 00000100:00100000:2.0:1789265269.172859:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399568384 00000100:00100000:2.0:1789265269.172864:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399568384 00000100:00100000:2.0:1789265269.172890:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399568512 00000100:00100000:2.0:1789265269.172893:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399568512 00000100:00100000:2.0:1789265269.172913:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 20 00000100:00100000:2.0:1789265269.172918:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1876180399568384:12345-192.168.203.49@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789265269.172946:0:8435:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a0766e4d-45ff-4def-8795-0d9246c8f4c4@192.168.203.49@tcp t0 exp 0000000000000000 cur 320 last 0 00000020:00000080:2.0:1789265269.172985:0:8435:0:(genops.c:1385:class_connect()) connect: client a0766e4d-45ff-4def-8795-0d9246c8f4c4, cookie 0x9272d942b4a96729 00002000:00100000:2.0:1789265269.172997:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a0766e4d-45ff-4def-8795-0d9246c8f4c4/ffff9fccbd324800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789265269.173015:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789265269.173109:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789265269.173140:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9fccbd323000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265269.173174:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:2392:x1876180399568384:12345-192.168.203.49@tcp:8:mount.lustre.0 Request processed in 254us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265269.173181:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 20 00000100:00100000:2.0:1789265269.173196:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 21 00000100:00100000:2.0:1789265269.173200:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1876180399568512:12345-192.168.203.49@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789265269.173216:0:8435:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a0766e4d-45ff-4def-8795-0d9246c8f4c4@192.168.203.49@tcp t0 exp 0000000000000000 cur 320 last 0 00000020:00000080:2.0:1789265269.173240:0:8435:0:(genops.c:1385:class_connect()) connect: client a0766e4d-45ff-4def-8795-0d9246c8f4c4, cookie 0x9272d942b4a96730 00002000:00100000:2.0:1789265269.173245:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a0766e4d-45ff-4def-8795-0d9246c8f4c4/ffff9fccbd326000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789265269.173254:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789265269.173288:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789265269.173301:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9fccbd320800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265269.173326:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:2392:x1876180399568512:12345-192.168.203.49@tcp:8:mount.lustre.0 Request processed in 124us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265269.173333:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 21 00000100:00100000:0.0:1789265269.174555:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399568768 00000100:00100000:0.0:1789265269.174567:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399568768 00000100:00100000:0.0:1789265269.174613:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 303 00000100:00100000:0.0:1789265269.174620:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2393:x1876180399568768:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265269.174683:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2393:x1876180399568768:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 63us (2370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265269.174691:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 303 00000100:00100000:1.0:1789265269.175380:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399568640 00000100:00100000:1.0:1789265269.175387:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399568640 00000100:00100000:1.0:1789265269.175434:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5 00000100:00100000:1.0:1789265269.175442:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:8723:x1876180399568640:12345-192.168.203.49@tcp:900:mount.lustre.0 00000100:00100000:1.0:1789265269.175541:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:8723:x1876180399568640:12345-192.168.203.49@tcp:900:mount.lustre.0 Request processed in 100us (3445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265269.175548:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5 00000100:00100000:2.0:1789265269.179129:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265269.179222:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399569280 00000100:00100000:3.0:1789265269.179232:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399569280 00000100:00100000:3.0:1789265269.179288:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1 00000100:00100000:3.0:1789265269.179298:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:8723:x1876180399569280:12345-192.168.203.49@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789265269.179384:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789265269.179468:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:8723:x1876180399569280:12345-192.168.203.49@tcp:33:mount.lustre.0 Request processed in 170us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265269.179476:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1 00000100:00100000:2.0:1789265269.249964:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417464704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265269.250056:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265269.250143:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417464704 00000100:00100000:3.0:1789265269.250220:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417464704 00000100:00100000:3.0:1789265269.250289:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789265269.250300:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417464704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789265269.250322:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265269.250382:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417464704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265269.250389:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1789265269.250487:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccb5c13b80 x1876180417464704/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265269.250507:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417464704:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789265269.251009:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265269.761256:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417464832:0@lo:400:kworker.0 00000100:00100000:3.0:1789265269.761338:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265269.761385:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb5c12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417464960:0@lo:400:kworker.0 00000100:00100000:3.0:1789265269.761420:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417465344:0@lo:400:kworker.0 00000100:00100000:0.0:1789265269.761440:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265269.761489:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417465472:0@lo:400:kworker.0 00000100:00100000:3.0:1789265269.761522:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417464960 00000100:00100000:3.0:1789265269.761529:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417464960 00000100:00100000:0.0:1789265269.761532:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265269.761556:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417465984:0@lo:400:kworker.0 00000100:00100000:0.0:1789265269.761582:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265269.761597:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417465472 00000100:00100000:3.0:1789265269.761603:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417465472 00000100:00100000:0.0:1789265269.761606:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789265269.761615:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417465088:0@lo:400:kworker.0 00000100:00100000:3.0:1789265269.761640:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417465984 00000100:00100000:3.0:1789265269.761645:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417465984 00000100:00100000:0.0:1789265269.761646:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265269.761669:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417465600:0@lo:400:kworker.0 00000100:00100000:3.0:1789265269.761673:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789265269.761685:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417464960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265269.761698:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265269.761711:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417466112:0@lo:400:kworker.0 00000100:00100000:3.0:1789265269.761747:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417464960:12345-0@lo:400:kworker.0 Request processed in 62us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265269.761756:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265269.761757:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789265269.761778:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417465600 00000100:00100000:3.0:1789265269.761781:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417465600 00000100:00100000:0.0:1789265269.761795:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417464960:0@lo:400:kworker.0 00000100:00100000:3.0:1789265269.761799:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417466112 00000100:00100000:3.0:1789265269.761804:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417466112 00000100:00100000:3.0:1789265269.761825:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789265269.761833:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417465472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265269.761839:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789265269.761851:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417465984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265269.761876:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417465472:12345-0@lo:400:kworker.0 Request processed in 44us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265269.761884:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789265269.761904:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789265269.761906:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417465984:12345-0@lo:400:kworker.0 Request processed in 57us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265269.761915:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417465600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265269.761920:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789265269.761941:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789265269.761951:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417466112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265269.761956:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417465600:12345-0@lo:400:kworker.0 Request processed in 43us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265269.761963:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1789265269.761982:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265269.761986:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265269.762009:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417466112:12345-0@lo:400:kworker.0 Request processed in 59us (262us total) trans 0 rc 0/0 00010000:00080000:3.0:1789265269.762012:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83d26300 x1876180417465600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265269.762053:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417465600:0@lo:400:kworker.0 00000100:00100000:0.0:1789265269.762063:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00010000:00080000:3.0:1789265269.762083:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4f8a80 x1876180417466112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265269.762093:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417466112:0@lo:400:kworker.0 00000100:00100000:3.0:1789265269.762107:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417465472:0@lo:400:kworker.0 00000100:00100000:3.0:1789265269.762119:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417465984:0@lo:400:kworker.0 00000100:00100000:0.0:1789265269.762135:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265269.762160:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417465856:0@lo:400:kworker.0 00000100:00100000:3.0:1789265269.762164:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417465344 00000100:00100000:3.0:1789265269.762168:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417465344 00000100:00100000:3.0:1789265269.762203:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789265269.762209:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265269.762217:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417465344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265269.762237:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417466368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265269.762263:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417465344:12345-0@lo:400:kworker.0 Request processed in 49us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265269.762273:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789265269.762274:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265269.762310:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417465344:0@lo:400:kworker.0 00000100:00100000:3.0:1789265269.762321:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417466368 00000100:00100000:3.0:1789265269.762327:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417466368 00000100:00100000:0.0:1789265269.762327:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789265269.762335:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417465216:0@lo:400:kworker.0 00000100:00100000:3.0:1789265269.762368:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789265269.762371:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265269.762380:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417466368:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265269.762393:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417465728:0@lo:400:kworker.0 00002000:00000024:3.0:1789265269.762397:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265269.762446:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417466368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265269.762453:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1789265269.762467:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265269.762487:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417465088 00000100:00100000:3.0:1789265269.762491:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417465088 00000100:00100000:3.0:1789265269.762516:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417465216 00000100:00100000:3.0:1789265269.762519:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417465216 00000100:00100000:3.0:1789265269.762531:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789265269.762545:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417465088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265269.762552:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265269.762570:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417466240:0@lo:400:kworker.0 00000100:00100000:0.0:1789265269.762595:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265269.762600:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417465088:12345-0@lo:400:kworker.0 Request processed in 55us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265269.762608:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:0.0:1789265269.762626:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83e2dc00 x1876180417466368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265269.762627:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789265269.762639:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0920050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417465216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265269.762648:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417466368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265269.762675:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417465856 00000100:00100000:0.0:1789265269.762679:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417465856 00000100:00100000:3.0:1789265269.762684:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0920050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417465216:12345-0@lo:400:kworker.0 Request processed in 46us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265269.762691:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789265269.762716:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417465728 00000100:00100000:0.0:1789265269.762720:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417465728 00000100:00100000:0.0:1789265269.762737:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417466240 00000100:00100000:0.0:1789265269.762740:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417466240 00000100:00100000:0.0:1789265269.762759:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789265269.762767:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417465856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265269.762809:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417465856:12345-0@lo:400:kworker.0 Request processed in 43us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265269.762816:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789265269.762844:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789265269.762850:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417465728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265269.762886:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417465728:12345-0@lo:400:kworker.0 Request processed in 36us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265269.762893:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789265269.762910:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789265269.762918:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417466240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265269.762949:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417466240:12345-0@lo:400:kworker.0 Request processed in 31us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265269.762954:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1789265269.762974:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265269.763012:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417465088:0@lo:400:kworker.0 00000100:00100000:1.0:1789265269.763132:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417464832 00000100:00100000:1.0:1789265269.763136:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417464832 00000100:00100000:1.0:1789265269.763173:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789265269.763179:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417464832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265269.768267:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417465216:0@lo:400:kworker.0 00010000:00080000:2.0:1789265269.768396:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83d24e00 x1876180417465728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265269.768421:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417465728:0@lo:400:kworker.0 00010000:00080000:2.0:1789265269.768439:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4fb100 x1876180417466240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265269.768447:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417466240:0@lo:400:kworker.0 00010000:00080000:2.0:1789265269.768459:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83d27480 x1876180417465856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265269.768467:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417465856:0@lo:400:kworker.0 00000100:00100000:1.0:1789265269.768649:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417464832:12345-0@lo:400:kworker.0 Request processed in 5467us (7309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265269.768661:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789265269.769059:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb5c13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417464832:0@lo:400:kworker.0 00010000:00010000:1.0:1789265270.083483:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265271.111239:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265272.130145:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265272.321183:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265272.321206:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417466496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265272.321267:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265272.321330:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417466496 00000100:00100000:1.0:1789265272.321337:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417466496 00000100:00100000:1.0:1789265272.321381:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789265272.321401:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417466496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789265272.321435:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789265272.321631:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417466496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 242us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265272.321639:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789265272.323405:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417466496:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265272.323502:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265272.323515:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417466624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265272.323571:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265272.323621:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417466624 00000100:00100000:3.0:1789265272.323628:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417466624 00000100:00100000:3.0:1789265272.323805:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789265272.323818:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417466624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265272.323852:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789265272.323904:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417466624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265272.323913:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789265272.323976:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417466624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265272.833313:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265272.833334:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417466752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265272.833426:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265272.833597:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265272.833613:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417466880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265272.833644:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265272.835382:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417466752 00000100:00100000:2.0:1789265272.835405:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417466752 00000100:00100000:2.0:1789265272.835482:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417466880 00000100:00100000:2.0:1789265272.835486:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417466880 00000100:00100000:2.0:1789265272.835508:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789265272.835517:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417466752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789265272.835546:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265272.835618:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417466752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (2192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265272.835625:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789265272.835641:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789265272.835647:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417466880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265272.835657:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265272.835697:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417466880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (2053us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265272.835704:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1789265272.835765:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd3e5c00 x1876180417466752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265272.835782:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417466752:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789265272.836590:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789265272.836627:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4fa300 x1876180417466880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265272.836643:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417466880:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789265273.153644:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265274.181619:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265274.184574:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265274.184634:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265274.184663:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265274.184691:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265274.184712:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265274.184732:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265274.184760:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265274.184813:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399569664 00000100:00100000:0.0:1789265274.184825:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399569664 00000100:00100000:0.0:1789265274.184897:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399569920 00000100:00100000:0.0:1789265274.184902:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399569920 00000100:00100000:0.0:1789265274.184920:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399569536 00000100:00100000:0.0:1789265274.184923:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399569536 00000100:00100000:0.0:1789265274.184938:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399569792 00000100:00100000:0.0:1789265274.184941:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399569792 00000100:00100000:0.0:1789265274.184961:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 134 00000100:00100000:0.0:1789265274.184972:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399569664:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265274.185105:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399569664:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 134us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265274.185113:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 134 00000100:00100000:0.0:1789265274.185134:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 135 00000100:00100000:0.0:1789265274.185142:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:2394:x1876180399569920:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265274.185170:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:2394:x1876180399569920:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 29us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265274.185177:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 135 00000100:00100000:0.0:1789265274.185192:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 136 00000100:00100000:0.0:1789265274.185198:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+6:2394:x1876180399569536:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265274.185296:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+6:2394:x1876180399569536:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 26us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265274.185303:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 136 00000100:00100000:0.0:1789265274.185317:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 137 00000100:00100000:0.0:1789265274.185324:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:2394:x1876180399569792:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265274.185351:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:2394:x1876180399569792:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 28us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265274.185366:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 137 00000100:00100000:0.0:1789265274.185404:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399570176 00000100:00100000:0.0:1789265274.185409:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399570176 00000100:00100000:0.0:1789265274.185440:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399570048 00000100:00100000:0.0:1789265274.185444:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399570048 00000100:00100000:0.0:1789265274.185468:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 48 00000100:00100000:0.0:1789265274.185475:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:2394:x1876180399570176:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265274.185506:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:2394:x1876180399570176:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 31us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265274.185512:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 48 00000100:00100000:0.0:1789265274.185524:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 49 00000100:00100000:0.0:1789265274.185531:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:2394:x1876180399570048:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265274.185555:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:2394:x1876180399570048:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 25us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265274.185561:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 49 00000100:00080000:0.0:1789265274.185591:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265274.185596:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265274.185599:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265274.185601:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265274.186427:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399569408 00000100:00100000:3.0:1789265274.186440:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399569408 00000100:00100000:3.0:1789265274.186519:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 305 00000100:00100000:3.0:1789265274.186529:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2394:x1876180399569408:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265274.186604:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2394:x1876180399569408:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 77us (2044us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265274.186684:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 305 00000001:02000400:2.0:1789265274.306413:0:12187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg349-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:0.0:1789265274.369336:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265274.369372:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417467008:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265274.369491:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265274.370078:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417467008 00000100:00100000:2.0:1789265274.370089:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417467008 00000100:00100000:2.0:1789265274.370167:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789265274.370179:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417467008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789265274.370218:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265274.370309:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417467008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 131us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265274.370329:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1789265274.370398:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4f9500 x1876180417467008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265274.370423:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417467008:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789265274.372433:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265274.882178:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417467520:0@lo:400:kworker.0 00000100:00100000:1.0:1789265274.882263:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265274.882320:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417468032:0@lo:400:kworker.0 00000100:00100000:1.0:1789265274.882343:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265274.882357:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417468544:0@lo:400:kworker.0 00000100:00100000:1.0:1789265274.882383:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265274.882414:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1789265274.882419:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417467136:0@lo:400:kworker.0 00000100:00100000:1.0:1789265274.882446:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265274.882473:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417467648:0@lo:400:kworker.0 00000100:00100000:1.0:1789265274.882496:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265274.882511:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417468160:0@lo:400:kworker.0 00000100:00100000:1.0:1789265274.882527:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265274.882538:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417468672:0@lo:400:kworker.0 00000100:00100000:1.0:1789265274.882553:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265274.882574:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417467392:0@lo:400:kworker.0 00000100:00100000:1.0:1789265274.882598:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265274.882613:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417467904:0@lo:400:kworker.0 00000100:00100000:1.0:1789265274.882632:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265274.882646:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417468416:0@lo:400:kworker.0 00000100:00100000:1.0:1789265274.882668:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265274.882684:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789265274.882689:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417467264:0@lo:400:kworker.0 00000100:00100000:1.0:1789265274.882712:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265274.882728:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417467776:0@lo:400:kworker.0 00000100:00100000:1.0:1789265274.882749:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265274.882763:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180417468288:0@lo:400:kworker.0 00000100:00100000:1.0:1789265274.882784:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265274.882810:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417467520 00000100:00100000:1.0:1789265274.882819:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417467520 00000100:00100000:1.0:1789265274.882869:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417467392 00000100:00100000:1.0:1789265274.882873:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417467392 00000100:00100000:1.0:1789265274.882890:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789265274.882899:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417467520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265274.882977:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417467520:12345-0@lo:400:kworker.0 Request processed in 78us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265274.882986:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789265274.883005:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789265274.883011:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417467392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265274.883066:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417467392:12345-0@lo:400:kworker.0 Request processed in 56us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265274.883072:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789265274.883111:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417467392:0@lo:400:kworker.0 00000100:00100000:1.0:1789265274.883145:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417467520:0@lo:400:kworker.0 00000100:00100000:0.0:1789265274.884684:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417468032 00000100:00100000:0.0:1789265274.884700:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417468032 00000100:00100000:2.0:1789265274.884747:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417468544 00000100:00100000:2.0:1789265274.884764:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417468544 00000100:00100000:0.0:1789265274.884770:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417468160 00000100:00100000:0.0:1789265274.884785:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417468160 00000100:00100000:2.0:1789265274.884826:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417468672 00000100:00100000:2.0:1789265274.884832:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417468672 00000100:00100000:1.0:1789265274.887207:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265274.887234:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417468800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265274.887322:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265274.887395:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417468800 00000100:00100000:1.0:1789265274.887403:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417468800 00000100:00100000:1.0:1789265274.887462:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789265274.887473:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180417468800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265274.887503:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265274.887550:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180417468800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265274.887558:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1789265274.887599:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb8286b480 x1876180417468800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265274.887621:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417468800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265274.887702:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417467648 00000100:00100000:1.0:1789265274.887706:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417467648 00000100:00100000:1.0:1789265274.887730:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417467904 00000100:00100000:1.0:1789265274.887733:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417467904 00000100:00100000:1.0:1789265274.887753:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417468416 00000100:00100000:1.0:1789265274.887756:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417468416 00000100:00100000:1.0:1789265274.887769:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417467264 00000100:00100000:1.0:1789265274.887772:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417467264 00000100:00100000:1.0:1789265274.887783:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417467776 00000100:00100000:1.0:1789265274.887786:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417467776 00000100:00100000:1.0:1789265274.887799:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417468288 00000100:00100000:1.0:1789265274.887802:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417468288 00000100:00100000:1.0:1789265274.887815:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789265274.887822:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417467648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265274.887868:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417467648:12345-0@lo:400:kworker.0 Request processed in 46us (5370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265274.887875:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789265274.887886:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789265274.887892:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82869500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417467904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265274.887925:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82869500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417467904:12345-0@lo:400:kworker.0 Request processed in 33us (5291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265274.887930:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789265274.887941:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789265274.887947:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876180417468416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265274.887975:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876180417468416:12345-0@lo:400:kworker.0 Request processed in 28us (5306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265274.887982:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789265274.887992:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789265274.888006:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417467264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265274.888070:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417467264:12345-0@lo:400:kworker.0 Request processed in 65us (5357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265274.888078:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789265274.888091:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789265274.888096:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417467776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265274.888122:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417467776:12345-0@lo:400:kworker.0 Request processed in 26us (5373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265274.888127:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789265274.888153:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789265274.888160:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876180417468288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265274.888186:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876180417468288:12345-0@lo:400:kworker.0 Request processed in 28us (5401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265274.888191:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789265274.888237:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417467648:0@lo:400:kworker.0 00000100:00100000:1.0:1789265274.888267:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417467264:0@lo:400:kworker.0 00000100:00100000:1.0:1789265274.888279:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417467776:0@lo:400:kworker.0 00000100:00100000:1.0:1789265274.888289:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180417468288:0@lo:400:kworker.0 00010000:00080000:1.0:1789265274.888301:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb82136300 x1876180417467904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265274.888309:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417467904:0@lo:400:kworker.0 00010000:00080000:1.0:1789265274.888320:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb82135c00 x1876180417468416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265274.888341:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417468416:0@lo:400:kworker.0 00000100:00080000:1.0:1789265274.888401:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265274.888409:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265274.888414:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265274.888417:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265274.888487:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789265274.888501:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417468032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265274.888552:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417468032:12345-0@lo:400:kworker.0 Request processed in 56us (6207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265274.888558:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000001:00100000:3.0:1789265274.890432:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a0766e4d-45ff-4def-8795-0d9246c8f4c4 00000100:00100000:3.0:1789265274.890507:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417467136 00000100:00100000:3.0:1789265274.890518:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417467136 00000100:00100000:3.0:1789265274.890569:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1789265274.890578:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3643:x1876180417467136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265274.890658:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3643:x1876180417467136:12345-0@lo:400:kworker.0 Request processed in 81us (8210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265274.890665:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1789265274.890715:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789265274.890725:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417468544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265274.890759:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417468544:12345-0@lo:400:kworker.0 Request processed in 37us (8384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265274.890766:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789265274.892629:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789265274.892652:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417468160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265274.892779:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417468160:12345-0@lo:400:kworker.0 Request processed in 135us (10250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265274.892794:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789265274.892940:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417468672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265274.893018:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417468672:12345-0@lo:400:kworker.0 Request processed in 212us (10463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265274.893348:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417467136:0@lo:400:kworker.0 00010000:00080000:1.0:1789265274.893368:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb82137480 x1876180417468160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265274.893391:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417468160:0@lo:400:kworker.0 00010000:00080000:1.0:1789265274.893404:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb82135180 x1876180417468672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265274.893412:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417468672:0@lo:400:kworker.0 00010000:00080000:1.0:1789265274.893425:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb82134380 x1876180417468032/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265274.893432:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417468032:0@lo:400:kworker.0 00010000:00080000:1.0:1789265274.893444:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb82137800 x1876180417468544/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265274.893451:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417468544:0@lo:400:kworker.0 00000001:00100000:3.0:1789265274.895431:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a0766e4d-45ff-4def-8795-0d9246c8f4c4 00000100:00100000:0.0:1789265274.896914:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789265274.896967:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000001:00100000:3.0:1789265274.898549:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a0766e4d-45ff-4def-8795-0d9246c8f4c4 00000001:00100000:0.0:1789265274.899323:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a0766e4d-45ff-4def-8795-0d9246c8f4c4 00010000:00010000:3.0:1789265275.213416:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265276.226460:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265277.249222:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265277.441401:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417468928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265277.441496:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265277.441618:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417468928 00000100:00100000:3.0:1789265277.441626:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417468928 00000100:00100000:3.0:1789265277.441678:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789265277.441688:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417468928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265277.441733:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789265277.441783:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417468928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265277.441801:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789265277.441841:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417468928:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265277.441848:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417469056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265277.441876:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265277.442075:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417469056 00000100:00100000:0.0:1789265277.442080:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417469056 00000100:00100000:0.0:1789265277.442115:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789265277.442122:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417469056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789265277.442140:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789265277.442189:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417469056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265277.442195:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789265277.442234:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417469056:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265277.953279:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417469184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265277.953348:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265277.953808:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417469184 00000100:00100000:3.0:1789265277.953817:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417469184 00000100:00100000:3.0:1789265277.953918:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789265277.953929:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417469184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265277.953957:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265277.959155:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417469184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5221us (5800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265277.959178:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1789265277.959212:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265277.961038:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265277.961058:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417469312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265277.961122:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265277.961189:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417469312 00000100:00100000:3.0:1789265277.961196:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417469312 00000100:00100000:3.0:1789265277.961243:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789265277.961252:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417469312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789265277.961273:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265277.961313:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417469312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265277.961328:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1789265277.961367:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789265277.961393:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83e2e300 x1876180417469312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265277.961410:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417469312:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1789265277.963934:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc8376df80 x1876180417469184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265277.963961:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417469184:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789265278.273269:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265279.299266:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265279.310366:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265279.310456:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265279.310488:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265279.310526:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265279.310544:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265279.310571:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265279.310578:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399570432 00000100:00100000:1.0:1789265279.310590:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399570432 00000100:00100000:0.0:1789265279.310600:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265279.310651:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399570560 00000100:00100000:1.0:1789265279.310656:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399570560 00000100:00100000:1.0:1789265279.310669:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399570688 00000100:00100000:1.0:1789265279.310672:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399570688 00000100:00100000:1.0:1789265279.310685:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399570816 00000100:00100000:1.0:1789265279.310688:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399570816 00000100:00100000:2.0:1789265279.310709:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 144 00000100:00100000:3.0:1789265279.310751:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399570304 00000100:00100000:3.0:1789265279.310757:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399570304 00000100:00100000:3.0:1789265279.310809:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 307 00000100:00100000:3.0:1789265279.310818:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2393:x1876180399570304:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265279.310956:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+6:2393:x1876180399570432:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265279.310990:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+6:2393:x1876180399570432:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 39us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265279.311013:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2393:x1876180399570304:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 197us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265279.311050:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 307 00000100:00100000:1.0:1789265279.314828:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 145 00000100:00100000:1.0:1789265279.314853:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2393:x1876180399570560:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265279.314864:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 144 00000100:00100000:1.0:1789265279.314940:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2393:x1876180399570560:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 99us (4451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265279.314949:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 145 00000100:00100000:2.0:1789265279.314961:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 146 00000100:00100000:2.0:1789265279.315007:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399570688:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265279.315058:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399570688:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 53us (4531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265279.315066:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 146 00000100:00100000:2.0:1789265279.315080:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 147 00000100:00100000:2.0:1789265279.315087:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399570816:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265279.315113:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399570816:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 27us (4568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265279.315119:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 147 00000100:00100000:2.0:1789265279.315159:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399570944 00000100:00100000:2.0:1789265279.315166:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399570944 00000100:00100000:2.0:1789265279.315206:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399571072 00000100:00100000:2.0:1789265279.315209:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399571072 00000100:00100000:2.0:1789265279.315230:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 54 00000100:00100000:2.0:1789265279.315236:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399570944:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265279.315264:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399570944:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 28us (4693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265279.315271:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 54 00000100:00100000:2.0:1789265279.315283:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 55 00000100:00100000:2.0:1789265279.315290:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399571072:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265279.315309:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399571072:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 21us (4711us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265279.315315:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 55 00000100:00080000:2.0:1789265279.315485:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265279.315495:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789265279.315498:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789265279.315500:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265279.490239:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417469440:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265279.490306:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265279.492729:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417469440 00000100:00100000:1.0:1789265279.492744:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417469440 00000100:00100000:1.0:1789265279.492819:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789265279.492829:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417469440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789265279.492860:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789265279.493083:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265279.493249:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417469440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 421us (2940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265279.493258:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:1.0:1789265279.493311:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd3e4a80 x1876180417469440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265279.493333:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417469440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265280.001196:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265280.001218:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417469568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265280.001288:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265280.001915:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417469568 00000100:00100000:3.0:1789265280.001923:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417469568 00000100:00100000:3.0:1789265280.001979:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789265280.001989:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417469568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265280.002011:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265280.002245:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417469568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265280.002254:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789265280.002281:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417469824:0@lo:400:kworker.0 00000100:00100000:3.0:1789265280.002313:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265280.002334:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417470336:0@lo:400:kworker.0 00000100:00100000:3.0:1789265280.002366:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265280.002427:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876180417470848:0@lo:400:kworker.0 00000100:00100000:3.0:1789265280.002466:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265280.002493:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789265280.002501:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417469952:0@lo:400:kworker.0 00000100:00100000:3.0:1789265280.002542:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265280.002562:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417470464:0@lo:400:kworker.0 00000100:00100000:3.0:1789265280.002580:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265280.002593:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417470976:0@lo:400:kworker.0 00000100:00100000:3.0:1789265280.002608:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265280.002723:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417469824 00000100:00100000:1.0:1789265280.002728:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417469824 00000100:00100000:1.0:1789265280.002751:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417470336 00000100:00100000:1.0:1789265280.002754:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417470336 00000100:00100000:1.0:1789265280.002767:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417470848 00000100:00100000:1.0:1789265280.002770:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417470848 00000100:00100000:1.0:1789265280.002779:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417470464 00000100:00100000:1.0:1789265280.002781:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417470464 00000100:00100000:1.0:1789265280.002790:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417470976 00000100:00100000:1.0:1789265280.002792:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417470976 00000100:00100000:1.0:1789265280.002803:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789265280.002809:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417469824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265280.002843:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417469824:12345-0@lo:400:kworker.0 Request processed in 33us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265280.002849:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789265280.002859:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789265280.002864:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417470336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265280.002885:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417470336:12345-0@lo:400:kworker.0 Request processed in 22us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265280.002891:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789265280.002901:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789265280.002906:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876180417470848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265280.002949:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876180417470848:12345-0@lo:400:kworker.0 Request processed in 43us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265280.002955:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789265280.002973:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789265280.002978:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417470464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265280.003002:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417470464:12345-0@lo:400:kworker.0 Request processed in 24us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265280.003007:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789265280.003016:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789265280.003039:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417470976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265280.003061:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417470976:12345-0@lo:400:kworker.0 Request processed in 40us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265280.003066:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789265280.003094:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417469952 00000100:00100000:1.0:1789265280.003097:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417469952 00000100:00100000:1.0:1789265280.003118:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789265280.003124:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417469952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265280.003276:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417469952:12345-0@lo:400:kworker.0 Request processed in 151us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265280.003284:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:3.0:1789265280.003359:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265280.003363:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265280.003365:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265280.003391:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417469696:0@lo:400:kworker.0 00000100:00100000:3.0:1789265280.003436:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265280.003472:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417470208:0@lo:400:kworker.0 00000100:00100000:3.0:1789265280.003496:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265280.003510:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417470720:0@lo:400:kworker.0 00000100:00100000:3.0:1789265280.003531:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789265280.003559:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb8286b480 x1876180417469568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265280.003577:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417469568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265280.003594:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789265280.003598:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417470080:0@lo:400:kworker.0 00000100:00100000:3.0:1789265280.003619:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265280.003761:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417470208 00000100:00100000:0.0:1789265280.003765:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417470208 00000100:00100000:0.0:1789265280.003793:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789265280.003799:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417470208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265280.003847:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417469696 00000100:00100000:1.0:1789265280.003852:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417469696 00000100:00100000:1.0:1789265280.003879:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1789265280.003885:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8ad99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3644:x1876180417469696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265280.006139:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417469952:0@lo:400:kworker.0 00010000:00080000:2.0:1789265280.006160:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83e2d880 x1876180417470464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265280.006171:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417470464:0@lo:400:kworker.0 00010000:00080000:2.0:1789265280.006183:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83e2d500 x1876180417470976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265280.006191:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417470976:0@lo:400:kworker.0 00000100:00100000:2.0:1789265280.006203:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417469824:0@lo:400:kworker.0 00000100:00100000:2.0:1789265280.006213:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417470336:0@lo:400:kworker.0 00000100:00100000:2.0:1789265280.006224:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876180417470848:0@lo:400:kworker.0 00000100:00100000:2.0:1789265280.006279:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417470720 00000100:00100000:2.0:1789265280.006284:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417470720 00000100:00100000:2.0:1789265280.006329:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789265280.006349:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417470720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265280.007848:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417470208:12345-0@lo:400:kworker.0 Request processed in 4042us (4345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265280.007860:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789265280.007900:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417470080 00000100:00100000:0.0:1789265280.007906:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417470080 00000100:00100000:0.0:1789265280.007935:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789265280.007942:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417470080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265280.007984:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417470080:12345-0@lo:400:kworker.0 Request processed in 43us (4364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265280.007990:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789265280.008498:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8ad99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3644:x1876180417469696:12345-0@lo:400:kworker.0 Request processed in 4611us (5059us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265280.008508:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1789265280.008978:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417470080:0@lo:400:kworker.0 00000100:00100000:3.0:1789265280.008997:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417470592:0@lo:400:kworker.0 00000100:00100000:3.0:1789265280.009043:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265280.009063:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417471104:0@lo:400:kworker.0 00000100:00100000:3.0:1789265280.009093:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265280.009112:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417469696:0@lo:400:kworker.0 00000100:00100000:3.0:1789265280.009123:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417470208:0@lo:400:kworker.0 00000100:00100000:3.0:1789265280.009170:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417470592 00000100:00100000:3.0:1789265280.009174:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417470592 00000100:00100000:3.0:1789265280.009198:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417471104 00000100:00100000:3.0:1789265280.009200:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417471104 00000100:00100000:3.0:1789265280.009213:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789265280.009219:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417470592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265280.009254:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417470592:12345-0@lo:400:kworker.0 Request processed in 35us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265280.009260:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789265280.009271:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789265280.009276:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa290e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417471104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265280.009297:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa290e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417471104:12345-0@lo:400:kworker.0 Request processed in 21us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265280.009313:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1789265280.009329:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789265280.009354:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83e2fb80 x1876180417470592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265280.009365:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417470592:0@lo:400:kworker.0 00010000:00080000:3.0:1789265280.009373:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83e2f100 x1876180417471104/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265280.009387:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417471104:0@lo:400:kworker.0 00000100:00100000:3.0:1789265280.010574:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417470720:12345-0@lo:400:kworker.0 Request processed in 4232us (7036us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265280.010586:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1789265280.012527:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83e2d180 x1876180417470720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265280.012545:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417470720:0@lo:400:kworker.0 00010000:00010000:3.0:1789265280.321409:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265281.346200:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789265282.097928:0:12503:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789265282.098307:0:12503:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789265282.369154:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265282.561378:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417471232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265282.563175:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265282.563432:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417471232 00000100:00100000:1.0:1789265282.563449:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417471232 00000100:00100000:1.0:1789265282.563545:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789265282.563558:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417471232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789265282.563817:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789265282.564004:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417471232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 445us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265282.564016:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789265282.564179:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417471232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265282.569554:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265282.569651:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417471360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265282.569874:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265282.569932:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417471360 00000100:00100000:2.0:1789265282.569940:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417471360 00000100:00100000:2.0:1789265282.569987:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789265282.569995:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417471360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789265282.570050:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789265282.570098:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417471360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265282.570106:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789265282.570153:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417471360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265283.074453:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417471488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265283.074551:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265283.074659:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417471488 00000100:00100000:0.0:1789265283.074669:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417471488 00000100:00100000:0.0:1789265283.074736:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789265283.074748:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd335180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417471488:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265283.074878:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265283.074889:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417471616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265283.074925:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789265283.074938:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265283.074970:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417471616 00000100:00100000:3.0:1789265283.074975:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417471616 00000100:00100000:3.0:1789265283.075003:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789265283.075010:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417471616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789265283.075058:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265283.075099:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd335180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417471488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 349us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265283.075129:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1789265283.075174:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789265283.075233:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc8376df80 x1876180417471488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265283.075258:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417471488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265283.075873:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417471616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 858us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265283.075884:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1789265283.075938:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccaa293480 x1876180417471616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265283.075960:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417471616:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789265283.397633:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789265284.298549:0:12601:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789265284.299435:0:12601:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789265284.418001:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265284.426512:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265284.426558:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265284.426582:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265284.426604:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265284.426622:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265284.426638:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265284.426673:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265284.426701:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399571456 00000100:00100000:2.0:1789265284.426711:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399571456 00000100:00100000:2.0:1789265284.426764:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399571712 00000100:00100000:2.0:1789265284.426767:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399571712 00000100:00100000:2.0:1789265284.426780:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399571328 00000100:00100000:2.0:1789265284.426782:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399571328 00000100:00100000:2.0:1789265284.426792:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399571584 00000100:00100000:2.0:1789265284.426794:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399571584 00000100:00100000:2.0:1789265284.426819:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 154 00000100:00100000:2.0:1789265284.426842:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399571456:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265284.426935:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399571456:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 108us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265284.426942:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 154 00000100:00100000:2.0:1789265284.426960:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 155 00000100:00100000:2.0:1789265284.426967:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2396:x1876180399571712:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265284.426992:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2396:x1876180399571712:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 25us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265284.426998:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 155 00000100:00100000:2.0:1789265284.427009:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 156 00000100:00100000:2.0:1789265284.427014:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+6:2396:x1876180399571328:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265284.427068:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+6:2396:x1876180399571328:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 54us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265284.427074:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 156 00000100:00100000:2.0:1789265284.427086:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 157 00000100:00100000:2.0:1789265284.427091:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2396:x1876180399571584:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265284.427117:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2396:x1876180399571584:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 26us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265284.427123:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 157 00000100:00100000:2.0:1789265284.427142:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399571968 00000100:00100000:2.0:1789265284.427146:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399571968 00000100:00100000:2.0:1789265284.427170:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399571840 00000100:00100000:2.0:1789265284.427173:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399571840 00000100:00100000:2.0:1789265284.427203:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 59 00000100:00100000:2.0:1789265284.427209:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2396:x1876180399571968:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265284.427246:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2396:x1876180399571968:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 37us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265284.427252:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 59 00000100:00100000:2.0:1789265284.427265:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 60 00000100:00100000:2.0:1789265284.427271:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2396:x1876180399571840:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265284.427305:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2396:x1876180399571840:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 35us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265284.427320:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 60 00000100:00080000:2.0:1789265284.427346:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789265284.427349:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265284.427353:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265284.427355:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265284.428292:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399571200 00000100:00100000:3.0:1789265284.428302:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399571200 00000100:00100000:3.0:1789265284.428368:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 309 00000100:00100000:3.0:1789265284.428376:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8ad98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2396:x1876180399571200:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265284.428435:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8ad98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2396:x1876180399571200:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 59us (1933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265284.428442:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 309 00000100:00100000:0.0:1789265284.609268:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265284.609775:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417471744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265284.609849:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265284.613352:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417471744 00000100:00100000:1.0:1789265284.613366:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417471744 00000100:00100000:1.0:1789265284.613541:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789265284.613552:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417471744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789265284.613581:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265284.613730:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417471744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 179us (3879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265284.613739:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:3.0:1789265284.613780:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83e2f480 x1876180417471744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265284.613801:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417471744:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789265284.614317:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265285.126121:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417471872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265285.126211:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265285.127856:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417471872 00000100:00100000:3.0:1789265285.127867:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417471872 00000100:00100000:3.0:1789265285.127932:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789265285.127942:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417471872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265285.127967:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265285.128064:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417471872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (1854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265285.128071:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1789265285.128094:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789265285.128129:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccaa293480 x1876180417471872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265285.128150:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417471872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265285.129663:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417472000:0@lo:400:kworker.0 00000100:00100000:1.0:1789265285.129725:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265285.129824:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417472128:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.129867:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265285.129910:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417472128 00000100:00100000:2.0:1789265285.129916:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417472128 00000100:00100000:2.0:1789265285.129957:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789265285.129966:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417472128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.130012:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417472128:12345-0@lo:400:kworker.0 Request processed in 46us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265285.130019:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789265285.130083:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417472128:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.130129:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417472256:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.130172:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265285.130206:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417472256 00000100:00100000:2.0:1789265285.130210:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417472256 00000100:00100000:2.0:1789265285.130234:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789265285.130240:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417472256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.130276:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417472256:12345-0@lo:400:kworker.0 Request processed in 37us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265285.130282:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789265285.130320:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417472256:0@lo:400:kworker.0 00000100:00100000:3.0:1789265285.130853:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417472000 00000100:00100000:3.0:1789265285.130859:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417472000 00000100:00100000:3.0:1789265285.130894:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1789265285.130901:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8ad99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417472000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.131139:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417472384:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.131171:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265285.131204:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417472384 00000100:00100000:2.0:1789265285.131208:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417472384 00000100:00100000:2.0:1789265285.131233:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789265285.131240:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417472384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.131277:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417472384:12345-0@lo:400:kworker.0 Request processed in 37us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265285.131283:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789265285.131328:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417472384:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.131371:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265285.131378:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417472512:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.131402:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265285.131425:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417472512 00000100:00100000:2.0:1789265285.131428:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417472512 00000100:00100000:2.0:1789265285.131462:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789265285.131468:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417472512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.131509:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417472512:12345-0@lo:400:kworker.0 Request processed in 41us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265285.131516:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789265285.131542:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417472512:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.131572:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417472640:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.131595:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265285.131632:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417472640 00000100:00100000:2.0:1789265285.131636:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417472640 00000100:00100000:2.0:1789265285.131678:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789265285.131685:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417472640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.131716:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417472640:12345-0@lo:400:kworker.0 Request processed in 32us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265285.131722:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:2.0:1789265285.131738:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265285.131757:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417472640:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.131785:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417472768:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.131808:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265285.132069:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417472768 00000100:00100000:2.0:1789265285.132073:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417472768 00000100:00100000:2.0:1789265285.132103:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789265285.132109:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417472768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.132146:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417472768:12345-0@lo:400:kworker.0 Request processed in 37us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265285.132152:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:2.0:1789265285.132166:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789265285.132195:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83e2df80 x1876180417472768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265285.132205:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417472768:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.132234:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417472896:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.132259:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265285.132285:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417472896 00000100:00100000:2.0:1789265285.132288:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417472896 00000100:00100000:2.0:1789265285.132327:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789265285.132335:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417472896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.132368:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417472896:12345-0@lo:400:kworker.0 Request processed in 35us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265285.132374:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1789265285.132387:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789265285.132405:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83e2df80 x1876180417472896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265285.132415:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417472896:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.132441:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265285.132511:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417473024:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.132538:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265285.132561:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417473024 00000100:00100000:2.0:1789265285.132565:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417473024 00000100:00100000:2.0:1789265285.132595:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789265285.132602:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417473024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.132635:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417473024:12345-0@lo:400:kworker.0 Request processed in 34us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265285.132707:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1789265285.132730:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789265285.132750:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83e2df80 x1876180417473024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265285.132760:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417473024:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.132793:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417473152:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.132817:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265285.132981:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417473152 00000100:00100000:2.0:1789265285.132986:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417473152 00000100:00100000:2.0:1789265285.133017:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789265285.133045:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417473152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.133081:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417473152:12345-0@lo:400:kworker.0 Request processed in 58us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265285.133087:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:2.0:1789265285.133100:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265285.133117:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417473152:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.133146:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180417473280:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.133168:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265285.133194:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417473280 00000100:00100000:2.0:1789265285.133198:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417473280 00000100:00100000:2.0:1789265285.133223:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789265285.133230:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180417473280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.133263:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180417473280:12345-0@lo:400:kworker.0 Request processed in 33us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265285.133268:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:2.0:1789265285.133281:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789265285.133297:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd332300 x1876180417473280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265285.133326:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180417473280:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.133359:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417473408:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.133382:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265285.133407:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417473408 00000100:00100000:2.0:1789265285.133410:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417473408 00000100:00100000:2.0:1789265285.133431:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789265285.133437:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417473408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.133739:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417473408:12345-0@lo:400:kworker.0 Request processed in 301us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265285.133746:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1789265285.133773:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd332300 x1876180417473408/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265285.133783:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417473408:0@lo:400:kworker.0 00000100:00100000:3.0:1789265285.137782:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8ad99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417472000:12345-0@lo:400:kworker.0 Request processed in 6870us (8046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265285.137797:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1789265285.142976:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417472000:0@lo:400:kworker.0 00010000:00010000:0.0:1789265285.442130:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789265286.347546:0:12700:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789265286.347787:0:12700:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789265286.465191:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265287.490520:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265287.682486:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82868a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417473536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265287.682566:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265287.682681:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265287.682691:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417473664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265287.682719:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265287.682763:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417473536 00000100:00100000:0.0:1789265287.682770:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417473536 00000100:00100000:0.0:1789265287.682813:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417473664 00000100:00100000:0.0:1789265287.682816:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417473664 00000100:00100000:0.0:1789265287.682835:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789265287.682844:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417473536:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265287.682850:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789265287.682861:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417473664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789265287.682881:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000004:00000024:2.0:1789265287.682883:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789265287.682935:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417473664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265287.682941:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417473536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265287.682949:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789265287.682959:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789265287.682992:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82868a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417473536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265287.683304:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417473664:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265288.193231:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265288.193252:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417473792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265288.193327:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265288.193529:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417473792 00000100:00100000:0.0:1789265288.193537:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417473792 00000100:00100000:0.0:1789265288.193596:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789265288.193605:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417473792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265288.193638:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265288.193678:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417473792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265288.193685:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1789265288.193805:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd336d80 x1876180417473792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265288.193822:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417473792:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789265288.198297:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265288.198430:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265288.198465:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417473920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265288.198536:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265288.198686:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417473920 00000100:00100000:3.0:1789265288.198694:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417473920 00000100:00100000:3.0:1789265288.198764:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789265288.198775:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417473920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789265288.198798:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265288.198855:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417473920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265288.198862:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1789265288.199040:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789265288.199235:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd337800 x1876180417473920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265288.199255:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417473920:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789265288.513254:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789265288.706784:0:12797:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265288.707048:0:12797:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789265289.538204:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265289.544157:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265289.544194:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265289.544227:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265289.544246:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265289.544265:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399572224 00000100:00100000:0.0:1789265289.544284:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399572224 00000100:00100000:2.0:1789265289.544288:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265289.544314:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399572480 00000100:00100000:2.0:1789265289.544319:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399572480 00000100:00100000:0.0:1789265289.544350:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399572352 00000100:00100000:0.0:1789265289.544355:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399572352 00000100:00100000:2.0:1789265289.546618:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399572608 00000100:00100000:2.0:1789265289.546631:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399572608 00000100:00100000:2.0:1789265289.546671:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 164 00000100:00100000:2.0:1789265289.546682:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+6:2393:x1876180399572224:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265289.546765:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+6:2393:x1876180399572224:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 85us (2616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265289.546773:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 164 00000100:00100000:2.0:1789265289.546788:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 165 00000100:00100000:2.0:1789265289.546793:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399572480:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265289.546815:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399572480:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 21us (2620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265289.546821:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 165 00000100:00100000:2.0:1789265289.546834:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 166 00000100:00100000:2.0:1789265289.546841:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2393:x1876180399572352:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265289.546875:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2393:x1876180399572352:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 34us (2628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265289.546881:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 166 00000100:00080000:1.0:1789265289.547370:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265289.547375:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265289.547456:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 167 00000100:00100000:1.0:1789265289.547465:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399572608:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265289.547494:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399572608:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 32us (3219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265289.547500:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 167 00000100:00100000:1.0:1789265289.547700:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399572096 00000100:00100000:1.0:1789265289.547706:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399572096 00000100:00100000:1.0:1789265289.547744:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 311 00000100:00100000:1.0:1789265289.547752:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc82437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2393:x1876180399572096:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265289.547779:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc82437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2393:x1876180399572096:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 29us (3552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265289.547785:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 311 00000100:00100000:2.0:1789265289.551480:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265289.551577:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265289.551969:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399572736 00000100:00100000:3.0:1789265289.551978:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399572736 00000100:00100000:3.0:1789265289.552055:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399572864 00000100:00100000:3.0:1789265289.552059:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399572864 00000100:00100000:3.0:1789265289.552083:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 22 00000100:00100000:3.0:1789265289.552092:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2392:x1876180399572736:12345-192.168.203.49@tcp:9:kworker.0 00000020:00000080:3.0:1789265289.552569:0:8435:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a96729 00000100:00080000:3.0:1789265289.552579:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9fccbd323000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789265289.552629:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789265289.552784:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a0766e4d-45ff-4def-8795-0d9246c8f4c4+2:2392:x1876180399572736:12345-192.168.203.49@tcp:9:kworker.0 Request processed in 692us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265289.552792:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 22 00000100:00100000:3.0:1789265289.552811:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23 00000100:00100000:3.0:1789265289.552817:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2392:x1876180399572864:12345-192.168.203.49@tcp:9:kworker.0 00000020:00000080:3.0:1789265289.552830:0:8435:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a96730 00000100:00080000:3.0:1789265289.552835:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9fccbd320800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789265289.552857:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789265289.552937:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a0766e4d-45ff-4def-8795-0d9246c8f4c4+2:2392:x1876180399572864:12345-192.168.203.49@tcp:9:kworker.0 Request processed in 120us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265289.552944:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23 00010000:00010000:3.0:1789265289.552972:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265289.552978:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789265289.553219:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265289.553223:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265289.729956:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417474048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265289.730051:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265289.730367:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417474048 00000100:00100000:3.0:1789265289.730375:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417474048 00000100:00100000:3.0:1789265289.730439:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789265289.730448:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417474048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789265289.730475:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265289.730518:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417474048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265289.730524:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1789265289.730711:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789265289.730739:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccaa293480 x1876180417474048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265289.730756:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417474048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265290.242820:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417474176:0@lo:400:kworker.0 00000100:00100000:2.0:1789265290.242889:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265290.242937:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417474688:0@lo:400:kworker.0 00000100:00100000:2.0:1789265290.242962:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265290.242980:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417475200:0@lo:400:kworker.0 00000100:00100000:2.0:1789265290.243000:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265290.243015:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417475712:0@lo:400:kworker.0 00000100:00100000:2.0:1789265290.243054:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265290.243076:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789265290.243202:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417474304:0@lo:400:kworker.0 00000100:00100000:2.0:1789265290.243246:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265290.243263:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417474816:0@lo:400:kworker.0 00000100:00100000:2.0:1789265290.243295:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265290.243308:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417475328:0@lo:400:kworker.0 00000100:00100000:2.0:1789265290.243324:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265290.243352:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417474432:0@lo:400:kworker.0 00000100:00100000:2.0:1789265290.243375:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265290.243399:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417474944:0@lo:400:kworker.0 00000100:00100000:2.0:1789265290.243422:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265290.243438:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417475456:0@lo:400:kworker.0 00000100:00100000:2.0:1789265290.243456:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265290.243467:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789265290.243472:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417474560:0@lo:400:kworker.0 00000100:00100000:2.0:1789265290.243488:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265290.243502:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417475072:0@lo:400:kworker.0 00000100:00100000:2.0:1789265290.243519:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265290.243533:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417475584:0@lo:400:kworker.0 00000100:00100000:2.0:1789265290.243551:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265290.243582:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417474176 00000100:00100000:2.0:1789265290.243588:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417474176 00000100:00100000:2.0:1789265290.243630:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1789265290.243638:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc82d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3643:x1876180417474176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265290.243688:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc82d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3643:x1876180417474176:12345-0@lo:400:kworker.0 Request processed in 50us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265290.243696:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1789265290.243727:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417474688 00000100:00100000:2.0:1789265290.243731:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417474688 00000100:00100000:2.0:1789265290.243749:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417474304 00000100:00100000:2.0:1789265290.243751:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417474304 00000100:00100000:2.0:1789265290.243761:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417474816 00000100:00100000:2.0:1789265290.243764:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417474816 00000100:00100000:2.0:1789265290.243785:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417475328 00000100:00100000:2.0:1789265290.243788:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417475328 00000100:00100000:2.0:1789265290.243799:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417474944 00000100:00100000:2.0:1789265290.243801:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417474944 00000100:00100000:2.0:1789265290.243837:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417475456 00000100:00100000:2.0:1789265290.243840:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417475456 00000100:00100000:2.0:1789265290.243852:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789265290.243858:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417474688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265290.243889:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417474688:12345-0@lo:400:kworker.0 Request processed in 31us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265290.243895:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789265290.243908:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789265290.243913:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417474304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265290.243937:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417474304:12345-0@lo:400:kworker.0 Request processed in 25us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265290.243943:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789265290.243953:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789265290.243958:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417474816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265290.243980:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417474816:12345-0@lo:400:kworker.0 Request processed in 22us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265290.243985:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789265290.243995:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789265290.244000:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417475328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265290.244020:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417475328:12345-0@lo:400:kworker.0 Request processed in 20us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265290.244051:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789265290.244062:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789265290.244068:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417474944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265290.244400:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789265290.244410:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417475456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265290.246518:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcca955df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417475840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265290.249287:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417474432 00000100:00100000:0.0:1789265290.249298:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417474432 00000100:00100000:0.0:1789265290.249339:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417474560 00000100:00100000:0.0:1789265290.249341:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417474560 00000100:00100000:0.0:1789265290.249357:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789265290.249365:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417474432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265290.249486:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789265290.249495:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417474560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265290.249746:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417474432:12345-0@lo:400:kworker.0 Request processed in 380us (6368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265290.249754:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789265290.249780:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417475200 00000100:00100000:0.0:1789265290.249784:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417475200 00000100:00100000:0.0:1789265290.249806:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417475712 00000100:00100000:0.0:1789265290.249832:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417475712 00000100:00100000:0.0:1789265290.249850:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417475072 00000100:00100000:0.0:1789265290.249852:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417475072 00000100:00100000:0.0:1789265290.249862:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417475584 00000100:00100000:0.0:1789265290.249865:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417475584 00000100:00100000:0.0:1789265290.249876:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789265290.249882:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417475200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265290.249918:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417475200:12345-0@lo:400:kworker.0 Request processed in 36us (6916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265290.249924:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789265290.249935:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789265290.249940:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417475712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265290.249967:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417475712:12345-0@lo:400:kworker.0 Request processed in 27us (6913us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265290.249973:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789265290.249982:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789265290.249987:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417475072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265290.250201:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417474560:12345-0@lo:400:kworker.0 Request processed in 707us (6711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265290.250208:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789265290.250235:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789265290.250243:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417475584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265290.250286:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417475584:12345-0@lo:400:kworker.0 Request processed in 44us (6733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265290.250293:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789265290.253638:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417474944:12345-0@lo:400:kworker.0 Request processed in 9562us (10207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265290.253659:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:2.0:1789265290.253705:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265290.253709:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789265290.253712:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789265290.253715:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265290.255593:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417475072:12345-0@lo:400:kworker.0 Request processed in 5597us (12064us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265290.255617:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789265290.255837:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417475456:12345-0@lo:400:kworker.0 Request processed in 11428us (12378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265290.255846:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789265290.258766:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265290.258882:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417475840 00000100:00100000:1.0:1789265290.258892:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417475840 00000100:00100000:1.0:1789265290.258941:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789265290.258950:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417475840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265290.258973:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265290.259010:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417475840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265290.259017:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1789265290.259163:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcca955df80 x1876180417475840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265290.259183:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcca955df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417475840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265290.259766:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417474560:0@lo:400:kworker.0 00010000:00080000:2.0:1789265290.259782:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83c99880 x1876180417475072/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265290.259792:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417475072:0@lo:400:kworker.0 00010000:00080000:2.0:1789265290.259804:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83c99500 x1876180417475584/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265290.260791:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417474304:0@lo:400:kworker.0 00000100:00100000:3.0:1789265290.260805:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417474816:0@lo:400:kworker.0 00000100:00100000:2.0:1789265290.260904:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417475584:0@lo:400:kworker.0 00000100:00100000:2.0:1789265290.260920:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417474432:0@lo:400:kworker.0 00010000:00080000:2.0:1789265290.260931:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83c99f80 x1876180417474944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265290.260939:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417474944:0@lo:400:kworker.0 00010000:00080000:2.0:1789265290.260949:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83c9aa00 x1876180417475456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265290.260956:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417475456:0@lo:400:kworker.0 00000100:00100000:3.0:1789265290.261243:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417475328:0@lo:400:kworker.0 00000100:00100000:3.0:1789265290.261253:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417474176:0@lo:400:kworker.0 00000100:00100000:3.0:1789265290.261264:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417474688:0@lo:400:kworker.0 00010000:00080000:3.0:1789265290.261287:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83c9bb80 x1876180417475200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265290.261296:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417475200:0@lo:400:kworker.0 00010000:00080000:3.0:1789265290.261306:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83c9b100 x1876180417475712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265290.261313:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417475712:0@lo:400:kworker.0 00000020:00000004:2.0:1789265290.530774:0:12894:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265290.531007:0:12894:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789265290.569516:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265291.585347:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265292.611327:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265292.802326:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265292.802351:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417475968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265292.802417:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265292.802481:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417475968 00000100:00100000:3.0:1789265292.802488:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417475968 00000100:00100000:3.0:1789265292.802531:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789265292.802540:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417475968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265292.802574:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789265292.802620:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417475968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265292.802628:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789265292.802675:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417475968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265292.804467:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcca955df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417476096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265292.804526:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265292.804864:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417476096 00000100:00100000:2.0:1789265292.804871:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417476096 00000100:00100000:2.0:1789265292.804919:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789265292.804927:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417476096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789265292.804954:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789265292.808422:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417476096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3485us (3884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265292.808437:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789265292.808593:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcca955df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417476096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265293.313851:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcca955df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417476224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265293.313918:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265293.313971:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417476352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265293.321505:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417476224 00000100:00100000:1.0:1789265293.321519:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417476224 00000100:00100000:1.0:1789265293.321586:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789265293.321596:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417476224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265293.321641:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789265293.321705:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265293.324813:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265293.324995:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417476352 00000100:00100000:0.0:1789265293.325004:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417476352 00000100:00100000:0.0:1789265293.325239:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789265293.325273:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417476352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789265293.325302:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265293.325372:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417476352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265293.325381:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1789265293.325435:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789265293.325467:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd337100 x1876180417476352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265293.325487:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417476352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265293.326048:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417476224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4449us (12125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265293.326058:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:3.0:1789265293.327521:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcca955df80 x1876180417476224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265293.327548:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcca955df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417476224:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789265293.638293:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789265294.367156:0:13040:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789265294.657324:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265294.667831:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265294.667876:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265294.667910:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265294.667943:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265294.667967:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265294.668074:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399572992 00000100:00100000:3.0:1789265294.668085:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399572992 00000100:00100000:3.0:1789265294.668137:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 313 00000100:00100000:3.0:1789265294.668148:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc82d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2395:x1876180399572992:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265294.668217:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc82d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2395:x1876180399572992:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 72us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265294.668224:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 313 00000100:00100000:2.0:1789265294.669592:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399573248 00000100:00100000:2.0:1789265294.669604:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399573248 00000100:00100000:2.0:1789265294.669781:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399573504 00000100:00100000:2.0:1789265294.669785:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399573504 00000100:00100000:2.0:1789265294.669806:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399573120 00000100:00100000:2.0:1789265294.669809:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399573120 00000100:00100000:2.0:1789265294.670206:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399573376 00000100:00100000:2.0:1789265294.670211:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399573376 00000100:00100000:2.0:1789265294.670230:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 174 00000100:00100000:2.0:1789265294.670250:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399573248:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265294.670311:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399573248:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 73us (2434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265294.670318:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 174 00000100:00100000:2.0:1789265294.670334:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 175 00000100:00100000:2.0:1789265294.670353:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2395:x1876180399573504:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265294.670379:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2395:x1876180399573504:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 27us (2469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265294.670387:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 175 00000100:00100000:2.0:1789265294.670399:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 176 00000100:00100000:2.0:1789265294.670406:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399573120:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265294.670428:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399573120:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 23us (2484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265294.670434:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 176 00000100:00100000:2.0:1789265294.670443:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 177 00000100:00100000:2.0:1789265294.670448:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2395:x1876180399573376:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265294.670467:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2395:x1876180399573376:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 19us (2501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265294.670472:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 177 00000100:00080000:2.0:1789265294.670492:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265294.670496:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265294.849750:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265294.849777:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417476480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265294.849867:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265294.850140:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417476480 00000100:00100000:3.0:1789265294.850148:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417476480 00000100:00100000:3.0:1789265294.850218:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789265294.850228:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417476480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789265294.850269:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265294.850325:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417476480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265294.850332:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1789265294.850416:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789265294.850551:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccaa293800 x1876180417476480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265294.850570:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417476480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265295.361477:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265295.361581:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417476608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265295.361956:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265295.362150:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417476608 00000100:00100000:1.0:1789265295.362161:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417476608 00000100:00100000:1.0:1789265295.362258:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789265295.362271:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417476608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265295.362302:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265295.362372:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417476608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265295.362455:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789265295.362539:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417476736:0@lo:400:kworker.0 00000100:00100000:2.0:1789265295.362588:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789265295.362595:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265295.362622:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417477248:0@lo:400:kworker.0 00000100:00100000:2.0:1789265295.362652:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265295.362676:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417477760:0@lo:400:kworker.0 00000100:00100000:2.0:1789265295.362702:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265295.362732:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789265295.362809:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417476864:0@lo:400:kworker.0 00000100:00100000:2.0:1789265295.362892:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265295.362908:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417477376:0@lo:400:kworker.0 00000100:00100000:2.0:1789265295.362925:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265295.362940:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417477888:0@lo:400:kworker.0 00000100:00100000:2.0:1789265295.362956:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265295.362986:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417477760 00000100:00100000:1.0:1789265295.362991:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417476992:0@lo:400:kworker.0 00000100:00100000:2.0:1789265295.362999:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417477760 00000100:00100000:1.0:1789265295.363053:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265295.363079:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417477504:0@lo:400:kworker.0 00000100:00100000:2.0:1789265295.363089:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789265295.363101:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417477760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265295.363109:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265295.363131:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417478016:0@lo:400:kworker.0 00000100:00100000:2.0:1789265295.363162:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417477760:12345-0@lo:400:kworker.0 Request processed in 64us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265295.363167:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265295.363176:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789265295.363203:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417477248 00000100:00100000:2.0:1789265295.363208:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417477248 00010000:00080000:1.0:1789265295.363210:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc837e0a80 x1876180417476608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265295.363231:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417476864 00000100:00100000:1.0:1789265295.363245:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417476608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265295.363257:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417476864 00000100:00100000:1.0:1789265295.363273:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789265295.363276:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417477376 00000100:00100000:2.0:1789265295.363281:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417477376 00000100:00100000:1.0:1789265295.363282:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417477120:0@lo:400:kworker.0 00000100:00100000:2.0:1789265295.363299:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417477888 00000100:00100000:2.0:1789265295.363304:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417477888 00000100:00100000:2.0:1789265295.363324:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417477504 00000100:00100000:1.0:1789265295.363326:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265295.363329:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417477504 00000100:00100000:2.0:1789265295.363348:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417478016 00000100:00100000:2.0:1789265295.363352:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417478016 00000100:00100000:1.0:1789265295.363352:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417477632:0@lo:400:kworker.0 00000100:00100000:2.0:1789265295.363375:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789265295.363385:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417477248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265295.363425:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417477248:12345-0@lo:400:kworker.0 Request processed in 43us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265295.363442:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789265295.363455:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789265295.363460:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417476864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265295.363490:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417476736 00000100:00100000:2.0:1789265295.363497:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417476864:12345-0@lo:400:kworker.0 Request processed in 37us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265295.363503:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789265295.363515:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789265295.363521:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417477376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265295.363547:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417477376:12345-0@lo:400:kworker.0 Request processed in 27us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265295.363553:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789265295.363563:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789265295.363569:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417477888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265295.363593:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417477888:12345-0@lo:400:kworker.0 Request processed in 25us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265295.363600:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789265295.363610:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789265295.363617:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417477504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265295.363645:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417477504:12345-0@lo:400:kworker.0 Request processed in 29us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265295.363651:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789265295.363662:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789265295.363669:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417478016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265295.363697:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417478016:12345-0@lo:400:kworker.0 Request processed in 29us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265295.363711:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789265295.364206:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417476864:0@lo:400:kworker.0 00000100:00100000:2.0:1789265295.364222:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417477376:0@lo:400:kworker.0 00000100:00100000:2.0:1789265295.364241:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417477888:0@lo:400:kworker.0 00000100:00100000:2.0:1789265295.364256:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417477248:0@lo:400:kworker.0 00010000:00080000:2.0:1789265295.364269:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83c9b100 x1876180417477760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265295.364434:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417477760:0@lo:400:kworker.0 00000100:00080000:2.0:1789265295.364586:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789265295.364592:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265295.364596:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265295.364653:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417476992 00000100:00100000:2.0:1789265295.364660:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417476992 00000100:00100000:2.0:1789265295.364901:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417477120 00000100:00100000:2.0:1789265295.364905:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417477120 00000100:00100000:2.0:1789265295.364925:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789265295.364933:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417476992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265295.365008:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417476992:12345-0@lo:400:kworker.0 Request processed in 75us (1955us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265295.365015:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789265295.365071:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789265295.365080:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417477120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265295.365115:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417477120:12345-0@lo:400:kworker.0 Request processed in 38us (1790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265295.365137:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789265295.365695:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417476736 00000100:00100000:2.0:1789265295.365804:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1789265295.365984:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc82d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3643:x1876180417476736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265295.366086:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc82d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3643:x1876180417476736:12345-0@lo:400:kworker.0 Request processed in 276us (3501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265295.366094:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1789265295.366203:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417476736:0@lo:400:kworker.0 00000100:00100000:1.0:1789265295.367461:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265295.367621:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417477632 00000100:00100000:1.0:1789265295.367622:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417476992:0@lo:400:kworker.0 00000100:00100000:2.0:1789265295.367631:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417477632 00010000:00080000:1.0:1789265295.367656:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83d45880 x1876180417477504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265295.367669:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417477504:0@lo:400:kworker.0 00010000:00080000:1.0:1789265295.367687:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83c9b480 x1876180417478016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265295.367697:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417478016:0@lo:400:kworker.0 00000100:00100000:1.0:1789265295.367732:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417477120:0@lo:400:kworker.0 00000100:00080000:1.0:1789265295.367770:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265295.367877:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789265295.367892:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417477632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265295.367972:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417477632:12345-0@lo:400:kworker.0 Request processed in 83us (4589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265295.367981:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1789265295.368139:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83d47b80 x1876180417477632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265295.368151:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417477632:0@lo:400:kworker.0 00010000:00010000:3.0:1789265295.681886:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789265295.882642:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a0766e4d-45ff-4def-8795-0d9246c8f4c4 00000020:00000080:1.0:1789265295.882651:0:8428:0:(genops.c:885:class_export_put()) final put ffff9fccbd324800/a0766e4d-45ff-4def-8795-0d9246c8f4c4 00000020:00000080:2.0:1789265295.882718:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbd324800/a0766e4d-45ff-4def-8795-0d9246c8f4c4 for lustre-OST0000 00000020:00000080:2.0:1789265295.882805:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccbd323000 for lustre-OST0000 00000001:00100000:3.0:1789265295.883312:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a0766e4d-45ff-4def-8795-0d9246c8f4c4 00000020:00000080:3.0:1789265295.883318:0:9515:0:(genops.c:885:class_export_put()) final put ffff9fccbd326000/a0766e4d-45ff-4def-8795-0d9246c8f4c4 00000020:00000080:1.0:1789265295.884195:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbd326000/a0766e4d-45ff-4def-8795-0d9246c8f4c4 for lustre-OST0001 00000020:00000080:1.0:1789265295.884270:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccbd320800 for lustre-OST0001 00010000:00010000:0.0:1789265296.706569:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265297.729260:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265297.921507:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417478144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265297.921619:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265297.921707:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265297.921716:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417478272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265297.921757:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265297.921788:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417478144 00000100:00100000:2.0:1789265297.921807:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417478144 00000100:00100000:2.0:1789265297.921851:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417478272 00000100:00100000:2.0:1789265297.921854:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417478272 00000100:00100000:2.0:1789265297.921870:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789265297.921878:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417478144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789265297.921923:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789265297.921969:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417478144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265297.921978:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789265297.921995:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789265297.922001:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417478272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789265297.922018:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789265297.922071:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417478272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265297.922077:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789265297.922119:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417478272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265297.922151:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417478144:0@lo:41:osp-pre-1-0.0 00000020:00000080:0.0:1789265298.214602:0:13187:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe81881750 20000000:00000080:0.0:1789265298.214619:0:13187:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fcb83bfe000 uarg=0000000000000000 20000000:01000000:0.0:1789265298.214662:0:13187:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789265298.214669:0:13187:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789265298.214744:0:13187:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789265298.215418:0:13188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789265298.215647:0:13187:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789265298.238448:0:13187:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789265298.240982:0:13187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fccbd2ff800/0x9272d942b4a96737 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.241125:0:13187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fccb520b600/0x9272d942b4a966ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a966c7 expref: 23 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.241135:0:13187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fccbd2ffa00/0x9272d942b4a966dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a966d5 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.241158:0:13187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fccb520ac00/0x9272d942b4a966ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a966e3 expref: 23 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.241168:0:13187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc8152fc00/0x9272d942b4a966f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbcaf expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.241176:0:13187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcb83da5200/0x9272d942b4a966ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a966f8 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.241183:0:13187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fccb520bc00/0x9272d942b4a96714 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbcee expref: 12 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.241191:0:13187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fccbd2ff800/0x9272d942b4a96737 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.241245:0:13187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fccb520bc00/0x9272d942b4a96714 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbcee expref: 12 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.241261:0:13187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fccb520bc00/0x9272d942b4a96714 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbcee expref: 12 pid: 7458 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265298.241275:0:13187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82134380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1876180417478400:192.168.203.49@tcp:104: 00010000:00010000:1.0:1789265298.241389:0:13187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcb83da5200/0x9272d942b4a966ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a966f8 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.241398:0:13187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fcb83da5200/0x9272d942b4a966ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a966f8 expref: 23 pid: 6511 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265298.241408:0:13187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82135180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1876180417478528:0@lo:104: 00000100:00100000:1.0:1789265298.241456:0:13187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265298.241497:0:13187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc8152fc00/0x9272d942b4a966f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbcaf expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.241507:0:13187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcc8152fc00/0x9272d942b4a966f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbcaf expref: 12 pid: 6508 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265298.241514:0:13187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82135c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1876180417478656:192.168.203.49@tcp:104: 00010000:00010000:1.0:1789265298.241543:0:13187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fccb520ac00/0x9272d942b4a966ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a966e3 expref: 23 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.241550:0:13187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fccb520ac00/0x9272d942b4a966ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a966e3 expref: 23 pid: 7458 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265298.241556:0:13187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82136300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1876180417478784:0@lo:104: 00000100:00100000:1.0:1789265298.241576:0:13187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265298.241649:0:13187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fccbd2ffa00/0x9272d942b4a966dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a966d5 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.241658:0:13187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fccbd2ffa00/0x9272d942b4a966dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a966d5 expref: 23 pid: 6508 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265298.241666:0:13187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82135500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1876180417478912:0@lo:104: 00000100:00100000:1.0:1789265298.241687:0:13187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265298.241710:0:13187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fccb520b600/0x9272d942b4a966ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a966c7 expref: 23 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.241717:0:13187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fccb520b600/0x9272d942b4a966ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a966c7 expref: 23 pid: 7458 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265298.241734:0:13187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1876180417479040:0@lo:104: 00000100:00100000:1.0:1789265298.241756:0:13187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265298.241767:0:13187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc913b7240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265298.241839:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417478528 00000100:00100000:0.0:1789265298.241846:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417478528 00000100:00100000:0.0:1789265298.241885:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417478784 00000100:00100000:0.0:1789265298.241896:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417478784 00000100:00100000:0.0:1789265298.241909:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417478912 00000100:00100000:0.0:1789265298.241911:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417478912 00000100:00100000:0.0:1789265298.241920:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417479040 00000100:00100000:0.0:1789265298.241922:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417479040 00000100:00100000:0.0:1789265298.241936:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789265298.241942:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789265298.241944:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82137480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+6:13187:x1876180417478528:12345-0@lo:104: 00000100:00100000:3.0:1789265298.241950:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82134700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+6:13187:x1876180417478784:12345-0@lo:104: 00010000:00010000:0.0:1789265298.241956:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a966f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a966ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.241958:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc8152ec00/0x9272d942b4a966e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a966ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.242014:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789265298.242019:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82137480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+6:13187:x1876180417478528:12345-0@lo:104: Request processed in 77us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265298.242043:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789265298.242059:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789265298.242064:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+5:13187:x1876180417478912:12345-0@lo:104: 00010000:00010000:0.0:1789265298.242071:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a966d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a966dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.242344:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789265298.242351:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82134700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+5:13187:x1876180417478784:12345-0@lo:104: Request processed in 402us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265298.242358:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789265298.242383:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789265298.242391:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+4:13187:x1876180417479040:12345-0@lo:104: 00010000:00010000:3.0:1789265298.242399:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fccb520b800/0x9272d942b4a966c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a966ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.242435:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789265298.242440:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+4:13187:x1876180417479040:12345-0@lo:104: Request processed in 51us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265298.242447:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1789265298.242468:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789265298.242474:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a966f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a966ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.242481:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6a00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:3.0:1789265298.242492:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a966f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a966ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.242501:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a966f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a966ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265298.242508:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a966f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a966ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265298.242513:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789265298.242539:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a966f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a966ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.242546:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265298.242564:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a966f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a966ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.242572:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a966f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a966ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.242584:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265298.242587:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc8152ec00/0x9272d942b4a966e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a966ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.242593:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc8152ec00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:3.0:1789265298.242596:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc8152ec00/0x9272d942b4a966e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a966ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.242604:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc8152ec00/0x9272d942b4a966e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a966ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265298.242618:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc8152ec00/0x9272d942b4a966e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a966ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265298.242623:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789265298.242638:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc8152ec00/0x9272d942b4a966e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a966ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.242643:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265298.242656:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc8152ec00/0x9272d942b4a966e3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a966ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.242662:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc8152ec00/0x9272d942b4a966e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a966ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.242672:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265298.242674:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fccb520b800/0x9272d942b4a966c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a966ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.242679:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520b800 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:3.0:1789265298.242681:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fccb520b800/0x9272d942b4a966c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a966ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.242686:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fccb520b800/0x9272d942b4a966c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a966ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265298.242691:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fccb520b800/0x9272d942b4a966c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a966ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265298.242696:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789265298.242715:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fccb520b800/0x9272d942b4a966c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a966ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.242721:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265298.242726:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fccb520b800/0x9272d942b4a966c7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a966ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.242732:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fccb520b800/0x9272d942b4a966c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a966ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.242740:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265298.242742:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265298.242744:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265298.242806:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789265298.242812:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+3:13187:x1876180417478912:12345-0@lo:104: Request processed in 748us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265298.242819:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789265298.242868:0:13187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82135180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1876180417478528:0@lo:104: 00000100:00100000:1.0:1789265298.242880:0:13187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82136300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1876180417478784:0@lo:104: 00000100:00100000:1.0:1789265298.242887:0:13187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82135500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1876180417478912:0@lo:104: 00000100:00100000:1.0:1789265298.242893:0:13187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1876180417479040:0@lo:104: 00000100:00100000:1.0:1789265298.242920:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265298.242932:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417479168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265298.242965:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265298.243006:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417479296:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265298.245271:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265298.245288:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a966d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a966dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.245300:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520aa00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265298.245304:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a966d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a966dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.245314:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a966d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a966dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265298.245322:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a966d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a966dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265298.245327:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789265298.245429:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a966d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a966dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.245436:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265298.245459:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a966d5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a966dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.245466:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a966d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a966dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.245499:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265298.245501:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265298.245503:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265298.245527:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265298.245546:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417479552:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265298.245671:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265298.246739:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265298.246933:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417479424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265298.246968:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265298.247013:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417479168 00000100:00100000:2.0:1789265298.247875:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417479168 00010000:00010000:2.0:1789265298.247921:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcb83da5200/0x9272d942b4a966ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a966f8 expref: 24 pid: 6511 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265298.247957:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417479552 00000100:00100000:2.0:1789265298.247961:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417479552 00010000:00010000:2.0:1789265298.247973:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fccbd2ffa00/0x9272d942b4a966dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a966d5 expref: 25 pid: 6508 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265298.247983:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417479424 00000100:00100000:2.0:1789265298.247985:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417479424 00010000:00010000:2.0:1789265298.247997:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fccb520b600/0x9272d942b4a966ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a966c7 expref: 26 pid: 7458 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265298.248042:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789265298.248051:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+26:3643:x1876180417479168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265298.248065:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265298.248071:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcb83da5200/0x9272d942b4a966ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a966f8 expref: 26 pid: 6511 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.248081:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcb83da5200/0x9272d942b4a966ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a966f8 expref: 26 pid: 6511 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.248098:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb83da5200/0x9272d942b4a966ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a966f8 expref: 26 pid: 6511 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.248113:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265298.248155:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+25:3643:x1876180417479168:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (5189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265298.248162:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789265298.248179:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789265298.248184:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3644:x1876180417479552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265298.248192:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265298.248197:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fccbd2ffa00/0x9272d942b4a966dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a966d5 expref: 24 pid: 6508 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.248205:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fccbd2ffa00/0x9272d942b4a966dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a966d5 expref: 24 pid: 6508 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.248225:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccbd2ffa00/0x9272d942b4a966dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a966d5 expref: 24 pid: 6508 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.248245:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265298.248276:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+23:3644:x1876180417479552:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265298.248282:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789265298.248294:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789265298.248300:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+22:3642:x1876180417479424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265298.248308:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265298.248312:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fccb520b600/0x9272d942b4a966ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a966c7 expref: 22 pid: 7458 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.248320:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fccb520b600/0x9272d942b4a966ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a966c7 expref: 22 pid: 7458 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.248329:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccb520b600/0x9272d942b4a966ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a966c7 expref: 22 pid: 7458 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.248338:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265298.248366:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+21:3642:x1876180417479424:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265298.248376:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789265298.248424:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417479168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265298.248459:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417479424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265298.248479:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417479552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265298.249048:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265298.250543:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417479296 00000100:00100000:2.0:1789265298.250554:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417479296 00010000:00010000:2.0:1789265298.250601:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fccb520ac00/0x9272d942b4a966ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a966e3 expref: 21 pid: 7458 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265298.250645:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789265298.250653:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+21:3641:x1876180417479296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265298.250666:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265298.250670:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fccb520ac00/0x9272d942b4a966ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a966e3 expref: 21 pid: 7458 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.250681:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fccb520ac00/0x9272d942b4a966ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a966e3 expref: 21 pid: 7458 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.250697:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccb520ac00/0x9272d942b4a966ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a966e3 expref: 21 pid: 7458 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.250711:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265298.250772:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+20:3641:x1876180417479296:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265298.250779:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789265298.251017:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417479296:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265298.251227:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265298.251321:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265298.251399:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399573632 00000100:00100000:0.0:1789265298.251404:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399573632 00010000:00010000:0.0:1789265298.251426:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc8152fc00/0x9272d942b4a966f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbcaf expref: 13 pid: 6508 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265298.251455:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 44 00000100:00100000:0.0:1789265298.251473:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2396:x1876180399573632:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265298.251483:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265298.251488:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc8152fc00/0x9272d942b4a966f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbcaf expref: 13 pid: 6508 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.251498:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc8152fc00/0x9272d942b4a966f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbcaf expref: 13 pid: 6508 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.251511:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265298.251552:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2396:x1876180399573632:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 81us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265298.251559:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 44 00000100:00100000:3.0:1789265298.251863:0:13187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82134380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1876180417478400:192.168.203.49@tcp:104: 00010000:00010000:3.0:1789265298.251875:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc8152fc00/0x9272d942b4a966f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbcaf expref: 12 pid: 6508 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265298.251890:0:13187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82135c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1876180417478656:192.168.203.49@tcp:104: 00010000:00010000:3.0:1789265298.251920:0:13187:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fccbd2ff800/0x9272d942b4a96737 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265298.255434:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265298.255505:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399573760 00000100:00100000:3.0:1789265298.255515:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399573760 00010000:00010000:3.0:1789265298.255556:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fccb520bc00/0x9272d942b4a96714 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbcee expref: 12 pid: 7458 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265298.255601:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 45 00000100:00100000:3.0:1789265298.255612:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb09a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f6ab780-f65a-4da8-8aa9-108982c08b32+12:2396:x1876180399573760:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265298.255629:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265298.255649:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fccb520bc00/0x9272d942b4a96714 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbcee expref: 12 pid: 7458 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.255661:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fccb520bc00/0x9272d942b4a96714 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbcee expref: 12 pid: 7458 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.255678:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccb520bc00/0x9272d942b4a96714 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbcee expref: 12 pid: 7458 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.255698:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fccbd2ff800/0x9272d942b4a96737 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.255707:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2ff800/0x9272d942b4a96737 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.255722:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fccbd2ff800/0x9272d942b4a96737 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.255729:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fccbd2ff800/0x9272d942b4a96737 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.255735:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fccbd2ff800/0x9272d942b4a96737 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.255741:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fccbd2ff800/0x9272d942b4a96737 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.255746:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff800 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265298.255751:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fccbd2ff800/0x9272d942b4a96737 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.255769:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fccbd2ff800/0x9272d942b4a96737 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.255795:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fccbd2ff800/0x9272d942b4a96737 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.255806:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265298.255856:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb09a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f6ab780-f65a-4da8-8aa9-108982c08b32+11:2396:x1876180399573760:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 245us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265298.255864:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 45 00010000:00010000:2.0:1789265298.256236:0:13187:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fccbd2ff800/0x9272d942b4a96737 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.256246:0:13187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fccbd2ff800/0x9272d942b4a96737 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.256252:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccbd2ff800/0x9272d942b4a96737 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265298.436409:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265298.436432:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417479680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265298.436502:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265298.436550:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417479680 00000100:00100000:1.0:1789265298.436557:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417479680 00000100:00100000:1.0:1789265298.436616:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789265298.436625:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417479680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265298.436652:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265298.436695:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417479680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265298.436715:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1789265298.436736:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789265298.436765:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4f8a80 x1876180417479680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265298.436782:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417479680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265298.440254:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265298.440277:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417479808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265298.440343:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265298.440391:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417479808 00000100:00100000:3.0:1789265298.440399:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417479808 00000100:00100000:3.0:1789265298.440454:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789265298.440464:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417479808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789265298.440487:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265298.440530:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417479808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265298.440537:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:3.0:1789265298.440576:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83bb8a80 x1876180417479808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265298.440594:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417479808:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789265298.440615:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789265298.753909:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265299.777166:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789265299.777303:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265299.777314:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fccbf44d000 from 7 10000000:01000000:2.0:1789265299.777319:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265299.777363:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a9673e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265299.777376:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a9673e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265299.777388:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a9673e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265299.777414:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417479936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265299.777481:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265299.778942:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265299.785795:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417479936 00000100:00100000:1.0:1789265299.785811:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417479936 00000100:00100000:1.0:1789265299.785872:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1789265299.785882:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+20:6513:x1876180417479936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265299.785909:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265299.785930:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a96745 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9673e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265299.785961:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a96745 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9673e expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265299.785974:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a96745 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9673e expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265299.785984:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fe800, rc 0) 00000100:00100000:1.0:1789265299.786087:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417479936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (8605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265299.786094:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1789265299.788837:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417479936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265299.788868:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a9673e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96745 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265299.788880:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a9673e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96745 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265299.789139:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265299.789246:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399573888 00000100:00100000:1.0:1789265299.789253:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399573888 00000100:00100000:1.0:1789265299.789309:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 316 00000100:00100000:1.0:1789265299.789319:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+11:2396:x1876180399573888:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265299.789403:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+11:2396:x1876180399573888:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 85us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265299.789412:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 316 00000100:00100000:2.0:1789265299.790363:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417480064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265299.790408:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265299.790448:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265299.790709:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417480064 00000100:00100000:1.0:1789265299.790714:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417480064 00000100:00100000:1.0:1789265299.790749:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789265299.790768:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417480064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265299.790885:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417480064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265299.791617:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417480064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265299.791657:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417480192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265299.791699:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265299.791729:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265299.792294:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417480192 00000100:00100000:2.0:1789265299.792300:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417480192 00000100:00100000:1.0:1789265299.792364:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789265299.793656:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265299.796108:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399574016 00000100:00100000:0.0:1789265299.796118:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399574016 00000100:00100000:0.0:1789265299.796179:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 184 00000100:00100000:0.0:1789265299.796189:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+6:2396:x1876180399574016:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265299.797472:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789265299.797489:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417480192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265299.797632:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417480192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (5932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265299.797639:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789265299.797724:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417480192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789265299.799464:0:13217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789265299.799538:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789265299.799558:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265299.799571:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a9673e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96745 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265299.799581:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a9673e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96745 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265299.799591:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265299.799593:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fccbd2a9800 from 7 10000000:01000000:2.0:1789265299.799596:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265299.799629:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520b600/0x9272d942b4a9674c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265299.799636:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccb520b600/0x9272d942b4a9674c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265299.799645:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccb520b600/0x9272d942b4a9674c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265299.799973:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417480320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265299.800065:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265299.800100:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da0480 going to sleep for 11 seconds 00000100:00100000:2.0:1789265299.800119:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417480320 00000100:00100000:2.0:1789265299.800125:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417480320 00000100:00100000:2.0:1789265299.800167:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789265299.800175:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417480320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265299.800187:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265299.800814:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccb520ac00/0x9272d942b4a96753 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9674c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265299.800846:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccb520ac00/0x9272d942b4a96753 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9674c expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265299.800857:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccb520ac00/0x9272d942b4a96753 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9674c expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265299.800866:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520ac00, rc 0) 00000100:00100000:2.0:1789265299.800928:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417480320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 752us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265299.800935:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789265299.800987:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417480320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265299.801002:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccb520b600/0x9272d942b4a9674c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96753 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265299.801012:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccb520b600/0x9272d942b4a9674c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96753 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265299.801093:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417480448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265299.801135:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265299.801152:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da0480 going to sleep for 11 seconds 00000100:00100000:2.0:1789265299.801168:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417480448 00000100:00100000:2.0:1789265299.801171:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417480448 00000100:00100000:2.0:1789265299.801213:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789265299.801221:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417480448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265299.801335:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417480448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265299.801343:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789265299.801373:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417480448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265299.801398:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417480576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265299.801434:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265299.801448:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da0480 going to sleep for 11 seconds 00000100:00100000:2.0:1789265299.801459:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417480576 00000100:00100000:2.0:1789265299.801462:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417480576 00000100:00100000:2.0:1789265299.801482:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1789265299.801487:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417480576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265299.801558:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417480576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265299.801565:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1789265299.801604:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417480576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265299.803621:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+6:2396:x1876180399574016:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 7423us (9959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265299.803635:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 184 00000100:00080000:0.0:1789265299.803844:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1789265299.807921:0:13218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789265299.808622:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789265299.808648:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265299.808726:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520b600/0x9272d942b4a9674c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96753 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265299.808817:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccb520b600/0x9272d942b4a9674c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96753 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265299.808827:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789265299.808829:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fccad90a000 from 7 10000000:01000000:3.0:1789265299.808832:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789265299.808869:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a9675a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265299.808877:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a9675a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265299.808887:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a9675a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265299.808912:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417480704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789265299.808975:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265299.809044:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc99446d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265299.810001:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265299.810059:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265299.810104:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399574272 00000100:00100000:0.0:1789265299.810112:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399574272 00000100:00100000:0.0:1789265299.810178:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399574144 00000100:00100000:0.0:1789265299.810182:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399574144 00000100:00100000:0.0:1789265299.810235:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 185 00000100:00100000:0.0:1789265299.810245:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2395:x1876180399574272:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265299.810308:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2395:x1876180399574272:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 64us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265299.810315:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 185 00000100:00100000:0.0:1789265299.810331:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 186 00000100:00100000:0.0:1789265299.810338:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399574144:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265299.810361:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399574144:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 24us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265299.810367:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 186 00000100:00080000:0.0:1789265299.810383:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789265299.810387:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265299.810418:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265299.810527:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417480704 00000100:00100000:1.0:1789265299.810531:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417480704 00000100:00100000:1.0:1789265299.810558:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1789265299.810564:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417480704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265299.810574:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265299.810588:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccbd2ff200/0x9272d942b4a96761 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9675a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265299.810610:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2ff200/0x9272d942b4a96761 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9675a expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265299.810620:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccbd2ff200/0x9272d942b4a96761 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9675a expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265299.810628:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2ff200, rc 0) 00000100:00100000:1.0:1789265299.810679:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417480704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265299.810685:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1789265299.810736:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417480704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265299.810762:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a9675a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96761 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265299.810772:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a9675a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96761 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265299.810836:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417480832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265299.810862:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265299.810885:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3ea3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265299.810897:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417480832 00000100:00100000:1.0:1789265299.810900:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417480832 00000100:00100000:1.0:1789265299.810917:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789265299.810923:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417480832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265299.811009:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417480832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265299.811016:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789265299.811056:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417480832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265299.811078:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417480960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265299.811112:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265299.811123:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3ea3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265299.811132:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417480960 00000100:00100000:1.0:1789265299.811134:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417480960 00000100:00100000:1.0:1789265299.811155:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789265299.811160:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417480960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265299.811236:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417480960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265299.811242:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789265299.811275:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417480960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789265299.811913:0:13220:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789265299.811960:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789265299.811975:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789265299.811983:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a9675a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96761 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265299.811991:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a9675a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96761 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265299.812001:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789265299.812004:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fcc8a583000 from 7 10000000:01000000:1.0:1789265299.812007:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789265299.812050:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffc00/0x9272d942b4a96768 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265299.812058:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffc00/0x9272d942b4a96768 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265299.812067:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffc00/0x9272d942b4a96768 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265299.812081:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417481088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789265299.812110:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265299.812134:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3ead80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265299.812149:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417481088 00000100:00100000:1.0:1789265299.812153:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417481088 00000100:00100000:1.0:1789265299.812177:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1789265299.812184:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417481088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265299.812191:0:7458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265299.812200:0:7458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccbd2fec00/0x9272d942b4a9676f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a96768 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265299.812227:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2fec00/0x9272d942b4a9676f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a96768 expref: 24 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265299.812236:0:7458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccbd2fec00/0x9272d942b4a9676f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96768 expref: 24 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265299.812244:0:7458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fec00, rc 0) 00000100:00100000:1.0:1789265299.812270:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+24:6513:x1876180417481088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265299.812275:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1789265299.812307:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417481088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265299.812318:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffc00/0x9272d942b4a96768 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9676f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265299.812326:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffc00/0x9272d942b4a96768 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9676f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265299.812363:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417481216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265299.812387:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265299.812407:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3ead80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265299.812419:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417481216 00000100:00100000:1.0:1789265299.812423:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417481216 00000100:00100000:1.0:1789265299.812442:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1789265299.812447:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+24:6513:x1876180417481216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265299.812536:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+24:6513:x1876180417481216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265299.812542:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1789265299.812573:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417481216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265299.812596:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417481344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265299.812633:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265299.812645:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3ead80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265299.812656:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417481344 00000100:00100000:1.0:1789265299.812659:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417481344 00000100:00100000:1.0:1789265299.812678:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1789265299.812684:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+24:6513:x1876180417481344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265299.812751:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+24:6513:x1876180417481344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265299.812758:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1789265299.812795:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417481344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265299.816072:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399574400 00000100:00100000:3.0:1789265299.816085:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399574400 00000100:00100000:3.0:1789265299.816169:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 187 00000100:00100000:3.0:1789265299.816179:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2395:x1876180399574400:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265299.816262:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2395:x1876180399574400:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 85us (5844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265299.816270:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 187 00000100:00080000:0.0:1789265299.819349:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1789265299.821956:0:13221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789265299.822415:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789265299.822441:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789265299.822454:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffc00/0x9272d942b4a96768 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9676f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265299.822466:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffc00/0x9272d942b4a96768 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9676f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265299.970082:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417481472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265299.970161:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265299.970247:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417481472 00000100:00100000:1.0:1789265299.970256:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417481472 00000100:00100000:1.0:1789265299.970322:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789265299.970332:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417481472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789265299.970360:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265299.970410:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417481472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265299.970425:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:1.0:1789265299.970481:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83bb8a80 x1876180417481472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265299.970499:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417481472:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789265299.970594:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265300.171293:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265300.171365:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399574528 00000100:00100000:1.0:1789265300.171376:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399574528 00000100:00100000:1.0:1789265300.171434:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 328 00000100:00100000:1.0:1789265300.171444:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f6ab780-f65a-4da8-8aa9-108982c08b32+11:6163:x1876180399574528:12345-192.168.203.49@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265300.171459:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265300.171477:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccbd2ff800/0x9272d942b4a96776 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbd1f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265300.171507:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2ff800/0x9272d942b4a96776 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd1f expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265300.171518:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccbd2ff800/0x9272d942b4a96776 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd1f expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265300.171526:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2ff800, rc 0) 00000100:00100000:1.0:1789265300.171586:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f6ab780-f65a-4da8-8aa9-108982c08b32+12:6163:x1876180399574528:12345-192.168.203.49@tcp:101:ll_cfg_requeue.0 Request processed in 143us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265300.171594:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 328 00000100:00100000:0.0:1789265300.191256:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265300.198625:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399574656 00000100:00100000:1.0:1789265300.198641:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399574656 00000100:00100000:1.0:1789265300.198724:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 329 00000100:00100000:1.0:1789265300.198735:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+12:6163:x1876180399574656:12345-192.168.203.49@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265300.198905:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+12:6163:x1876180399574656:12345-192.168.203.49@tcp:501:ll_cfg_requeue.0 Request processed in 171us (7658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265300.198913:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 329 00000100:00100000:0.0:1789265300.206184:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265300.209269:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399574784 00000100:00100000:1.0:1789265300.209283:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399574784 00000100:00100000:0.0:1789265300.209760:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 330 00000100:00100000:0.0:1789265300.209771:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f6ab780-f65a-4da8-8aa9-108982c08b32+12:6163:x1876180399574784:12345-192.168.203.49@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265300.209920:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f6ab780-f65a-4da8-8aa9-108982c08b32+12:6163:x1876180399574784:12345-192.168.203.49@tcp:503:ll_cfg_requeue.0 Request processed in 151us (3748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265300.209929:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 330 00000100:00100000:0.0:1789265300.219098:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265300.219688:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399574912 00000100:00100000:3.0:1789265300.219698:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399574912 00000100:00100000:0.0:1789265300.219876:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 331 00000100:00100000:0.0:1789265300.219888:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+12:6163:x1876180399574912:12345-192.168.203.49@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265300.219904:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265300.219921:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83da5c00/0x9272d942b4a9677d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbd26 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265300.219951:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83da5c00/0x9272d942b4a9677d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd26 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265300.219962:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83da5c00/0x9272d942b4a9677d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd26 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265300.219972:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5c00, rc 0) 00000100:00100000:0.0:1789265300.220046:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:6163:x1876180399574912:12345-192.168.203.49@tcp:101:ll_cfg_requeue.0 Request processed in 161us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265300.220052:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 331 00000100:00100000:0.0:1789265300.223068:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265300.223148:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399575040 00000100:00100000:1.0:1789265300.223157:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399575040 00000100:00100000:1.0:1789265300.223254:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 332 00000100:00100000:1.0:1789265300.223264:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:6163:x1876180399575040:12345-192.168.203.49@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265300.223407:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:6163:x1876180399575040:12345-192.168.203.49@tcp:501:ll_cfg_requeue.0 Request processed in 144us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265300.223415:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 332 00000100:00100000:2.0:1789265300.228396:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265300.228494:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399575168 00000100:00100000:1.0:1789265300.228504:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399575168 00000100:00100000:1.0:1789265300.228565:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 333 00000100:00100000:1.0:1789265300.228575:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:6163:x1876180399575168:12345-192.168.203.49@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265300.228924:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:6163:x1876180399575168:12345-192.168.203.49@tcp:503:ll_cfg_requeue.0 Request processed in 350us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265300.228933:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 333 00000100:00100000:1.0:1789265300.482468:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417481600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265300.482596:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265300.483716:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417481600 00000100:00100000:1.0:1789265300.483726:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417481600 00000100:00100000:1.0:1789265300.483783:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789265300.483794:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417481600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265300.483826:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265300.483890:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417481600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265300.483898:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1789265300.483929:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789265300.483961:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4fa300 x1876180417481600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265300.483979:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417481600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265300.485857:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417481728:0@lo:400:kworker.0 00000100:00100000:1.0:1789265300.485921:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265300.485952:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180417482240:0@lo:400:kworker.0 00000100:00100000:1.0:1789265300.485973:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265300.485990:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180417482752:0@lo:400:kworker.0 00000100:00100000:1.0:1789265300.486008:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265300.486048:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789265300.486054:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417482112:0@lo:400:kworker.0 00000100:00100000:2.0:1789265300.487913:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417481984:0@lo:400:kworker.0 00000100:00100000:2.0:1789265300.487967:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265300.488003:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417482496:0@lo:400:kworker.0 00000100:00100000:2.0:1789265300.488046:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265300.488071:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789265300.488077:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417481856:0@lo:400:kworker.0 00000100:00100000:2.0:1789265300.488145:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265300.488162:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417482368:0@lo:400:kworker.0 00000100:00100000:2.0:1789265300.488185:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265300.488229:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417482880:0@lo:400:kworker.0 00000100:00100000:2.0:1789265300.488251:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265300.488288:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417481984 00000100:00100000:2.0:1789265300.488296:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417481984 00000100:00100000:2.0:1789265300.488341:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417481856 00000100:00100000:2.0:1789265300.488344:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417481856 00000100:00100000:3.0:1789265300.488346:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789265300.488358:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789265300.488365:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417481856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265300.488416:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417481856:12345-0@lo:400:kworker.0 Request processed in 52us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265300.488424:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789265300.488446:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417482496 00000100:00100000:2.0:1789265300.488449:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417482496 00000100:00100000:2.0:1789265300.488481:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789265300.488488:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417482496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265300.488520:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417481984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265300.488557:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417481984:12345-0@lo:400:kworker.0 Request processed in 43us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265300.488564:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789265300.488622:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265300.488636:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417482624:0@lo:400:kworker.0 00000100:00100000:1.0:1789265300.488658:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265300.488687:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417481728 00000100:00100000:1.0:1789265300.488691:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417481728 00000100:00100000:1.0:1789265300.488711:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417482240 00000100:00100000:1.0:1789265300.488714:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417482240 00000100:00100000:1.0:1789265300.488727:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417482752 00000100:00100000:1.0:1789265300.488730:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417482752 00000100:00100000:1.0:1789265300.488741:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417482368 00000100:00100000:1.0:1789265300.488748:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417482368 00000100:00100000:1.0:1789265300.488764:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417482880 00000100:00100000:1.0:1789265300.488766:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417482880 00000100:00100000:1.0:1789265300.488777:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417482112 00000100:00100000:1.0:1789265300.488779:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417482112 00000100:00100000:1.0:1789265300.488792:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789265300.488797:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417481728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265300.488832:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417481728:12345-0@lo:400:kworker.0 Request processed in 35us (2911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265300.488839:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789265300.488851:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789265300.488857:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180417482240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265300.488897:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180417482240:12345-0@lo:400:kworker.0 Request processed in 39us (2922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265300.488903:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789265300.488915:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789265300.488921:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180417482752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265300.488949:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180417482752:12345-0@lo:400:kworker.0 Request processed in 28us (2938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265300.488954:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789265300.488966:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789265300.488971:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417482368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265300.488998:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417482368:12345-0@lo:400:kworker.0 Request processed in 26us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265300.489003:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789265300.489014:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789265300.489019:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876180417482880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265300.489074:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876180417482880:12345-0@lo:400:kworker.0 Request processed in 55us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265300.489081:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789265300.489093:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789265300.489098:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417482112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265300.489123:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417482112:12345-0@lo:400:kworker.0 Request processed in 25us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265300.489129:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:1.0:1789265300.489151:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265300.489155:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265300.489157:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265300.489166:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417482624 00000100:00100000:1.0:1789265300.489169:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417482624 00000100:00100000:1.0:1789265300.489197:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789265300.489359:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417482624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265300.489390:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417482624:12345-0@lo:400:kworker.0 Request processed in 33us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265300.489395:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1789265300.489481:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265300.490622:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417482112:0@lo:400:kworker.0 00010000:00080000:1.0:1789265300.490651:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83f41f80 x1876180417482624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265300.490661:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417482624:0@lo:400:kworker.0 00000100:00100000:1.0:1789265300.490672:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417481728:0@lo:400:kworker.0 00000100:00100000:1.0:1789265300.490681:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180417482240:0@lo:400:kworker.0 00000100:00100000:1.0:1789265300.490702:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180417482752:0@lo:400:kworker.0 00000100:00100000:2.0:1789265300.490948:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417482496:12345-0@lo:400:kworker.0 Request processed in 2458us (2899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265300.490957:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789265300.490998:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417481856:0@lo:400:kworker.0 00010000:00080000:2.0:1789265300.491011:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4fb480 x1876180417482368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265300.491047:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417482368:0@lo:400:kworker.0 00010000:00080000:2.0:1789265300.491061:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83f43b80 x1876180417482880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265300.491070:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417482880:0@lo:400:kworker.0 00000100:00100000:2.0:1789265300.491080:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417481984:0@lo:400:kworker.0 00010000:00080000:2.0:1789265300.491089:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83f40700 x1876180417482496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265300.491097:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417482496:0@lo:400:kworker.0 00010000:00010000:2.0:1789265300.807444:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265301.825346:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789265302.697928:0:13386:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg349-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789265302.850702:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265303.041393:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417483008:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265303.041465:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265303.041704:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417483008 00000100:00100000:2.0:1789265303.041712:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417483008 00000100:00100000:2.0:1789265303.041774:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789265303.041784:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417483008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789265303.041975:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789265303.042134:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417483008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 351us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265303.042142:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789265303.043152:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265303.043168:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417483136:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265303.043224:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265303.043502:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417483136 00000100:00100000:3.0:1789265303.043509:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417483136 00000100:00100000:3.0:1789265303.043559:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789265303.043567:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417483136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789265303.043594:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789265303.043636:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417483136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265303.043643:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789265303.043754:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417483136:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265303.048508:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417483008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265303.553581:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417483264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265303.553654:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265303.553971:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417483392:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265303.554016:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265303.554129:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417483264 00000100:00100000:0.0:1789265303.554143:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417483264 00000100:00100000:0.0:1789265303.554208:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417483392 00000100:00100000:0.0:1789265303.554211:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417483392 00000100:00100000:0.0:1789265303.554239:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789265303.554248:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417483264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265303.554277:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265303.554325:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417483264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265303.554333:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789265303.554348:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789265303.554355:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417483392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789265303.554363:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265303.554389:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417483392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265303.554395:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1789265303.554427:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd336d80 x1876180417483392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265303.554445:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417483392:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1789265303.554473:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83f41f80 x1876180417483264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265303.554485:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417483264:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789265303.554893:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789265303.875492:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265304.900947:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265304.910422:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265304.910463:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265304.910534:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265304.910978:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399575296 00000100:00100000:3.0:1789265304.910988:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399575296 00000100:00100000:3.0:1789265304.911067:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 334 00000100:00100000:3.0:1789265304.911078:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2395:x1876180399575296:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265304.911151:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2395:x1876180399575296:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 76us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265304.911160:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 334 00000100:00100000:1.0:1789265304.914015:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265304.914281:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399575552 00000100:00100000:0.0:1789265304.914292:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399575552 00000100:00100000:1.0:1789265304.914679:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265304.916284:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399575808 00000100:00100000:0.0:1789265304.916296:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399575808 00000100:00100000:0.0:1789265304.916375:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399575424 00000100:00100000:0.0:1789265304.916394:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399575424 00000100:00100000:0.0:1789265304.916408:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399575680 00000100:00100000:0.0:1789265304.916411:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399575680 00000100:00100000:0.0:1789265304.916439:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 194 00000100:00100000:0.0:1789265304.916448:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2395:x1876180399575808:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265304.916519:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2395:x1876180399575808:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 72us (5985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265304.916526:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 194 00000100:00100000:0.0:1789265304.916541:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 195 00000100:00100000:0.0:1789265304.916546:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399575424:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265304.916564:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399575424:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 19us (2560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265304.916570:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 195 00000100:00100000:0.0:1789265304.916580:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 196 00000100:00100000:0.0:1789265304.916586:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2395:x1876180399575680:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265304.916608:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2395:x1876180399575680:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 23us (1930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265304.916614:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 196 00000100:00080000:1.0:1789265304.916734:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265304.916739:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265304.917632:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265304.917938:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 197 00000100:00100000:3.0:1789265304.917956:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399575552:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265304.918006:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399575552:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 56us (7542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265304.918064:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 197 00000100:00100000:0.0:1789265305.089732:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417483520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265305.089851:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265305.089953:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417483520 00000100:00100000:1.0:1789265305.089970:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417483520 00000100:00100000:1.0:1789265305.090097:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789265305.090108:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417483520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789265305.090140:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265305.090234:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417483520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265305.090241:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:1.0:1789265305.090288:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83bbb480 x1876180417483520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265305.090309:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417483520:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789265305.090317:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265305.602357:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417483648:0@lo:400:kworker.0 00000100:00100000:0.0:1789265305.602435:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265305.602484:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417484160:0@lo:400:kworker.0 00000100:00100000:0.0:1789265305.602510:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265305.602542:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417484032:0@lo:400:kworker.0 00000100:00100000:0.0:1789265305.602543:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417484672:0@lo:400:kworker.0 00000100:00100000:0.0:1789265305.602568:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265305.602587:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265305.602593:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789265305.602598:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417483776:0@lo:400:kworker.0 00000100:00100000:0.0:1789265305.602631:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265305.602646:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417484288:0@lo:400:kworker.0 00000100:00100000:0.0:1789265305.602666:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265305.602673:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417484544:0@lo:400:kworker.0 00000100:00100000:0.0:1789265305.602679:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417484800:0@lo:400:kworker.0 00000100:00100000:0.0:1789265305.602695:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265305.602727:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417484160 00000100:00100000:0.0:1789265305.602734:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417484160 00000100:00100000:1.0:1789265305.602773:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265305.602776:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417483776 00000100:00100000:0.0:1789265305.602778:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417483776 00000100:00100000:0.0:1789265305.602790:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417484288 00000100:00100000:1.0:1789265305.602791:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417485056:0@lo:400:kworker.0 00000100:00100000:0.0:1789265305.602793:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417484288 00000100:00100000:0.0:1789265305.602811:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417484800 00000100:00100000:0.0:1789265305.602814:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417484800 00000100:00100000:1.0:1789265305.602826:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265305.602828:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789265305.602837:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417484160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265305.602844:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789265305.602849:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417483904:0@lo:400:kworker.0 00000100:00100000:1.0:1789265305.602869:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265305.602883:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417484416:0@lo:400:kworker.0 00000100:00100000:0.0:1789265305.602884:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417484160:12345-0@lo:400:kworker.0 Request processed in 48us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265305.602891:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789265305.602901:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265305.602907:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417484416 00000100:00100000:1.0:1789265305.602909:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417484928:0@lo:400:kworker.0 00000100:00100000:0.0:1789265305.602910:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417484416 00000100:00100000:0.0:1789265305.602925:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789265305.602926:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265305.602930:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417483776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265305.602946:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417484672 00000100:00100000:1.0:1789265305.602949:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417484672 00000100:00100000:0.0:1789265305.602957:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417483776:12345-0@lo:400:kworker.0 Request processed in 27us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265305.602972:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789265305.602973:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417484544 00000100:00100000:1.0:1789265305.602975:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417484544 00000100:00100000:0.0:1789265305.602981:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417484928 00000100:00100000:0.0:1789265305.602984:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417484928 00000100:00100000:1.0:1789265305.602985:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417485056 00000100:00100000:1.0:1789265305.602986:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417485056 00000100:00100000:1.0:1789265305.602997:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789265305.602997:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789265305.603002:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417484672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265305.603002:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417484288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265305.603054:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417484672:12345-0@lo:400:kworker.0 Request processed in 51us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265305.603060:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789265305.603072:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789265305.603078:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417484544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265305.603080:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417484288:12345-0@lo:400:kworker.0 Request processed in 78us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265305.603085:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789265305.603096:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789265305.603102:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417484800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265305.603106:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417484544:12345-0@lo:400:kworker.0 Request processed in 30us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265305.603117:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789265305.603125:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417484800:12345-0@lo:400:kworker.0 Request processed in 24us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265305.603128:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789265305.603131:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789265305.603133:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417485056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265305.603139:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789265305.603144:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417484416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265305.603161:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417485056:12345-0@lo:400:kworker.0 Request processed in 28us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265305.603162:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417484416:12345-0@lo:400:kworker.0 Request processed in 19us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265305.603180:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789265305.603180:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789265305.603192:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789265305.603198:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876180417484928:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789265305.603213:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83f40700 x1876180417484416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265305.603222:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876180417484928:12345-0@lo:400:kworker.0 Request processed in 26us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265305.603226:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417484416:0@lo:400:kworker.0 00000100:00100000:0.0:1789265305.603228:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00010000:00080000:1.0:1789265305.603237:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4f9f80 x1876180417484928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265305.603245:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417484928:0@lo:400:kworker.0 00010000:00080000:1.0:1789265305.603254:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83f43b80 x1876180417484544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265305.603262:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417484544:0@lo:400:kworker.0 00010000:00080000:1.0:1789265305.603271:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4f8000 x1876180417485056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265305.603279:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417483776:0@lo:400:kworker.0 00000100:00100000:0.0:1789265305.603301:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417484288:0@lo:400:kworker.0 00000100:00100000:0.0:1789265305.603309:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417484800:0@lo:400:kworker.0 00000100:00100000:0.0:1789265305.603317:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417484160:0@lo:400:kworker.0 00010000:00080000:0.0:1789265305.603325:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4fbb80 x1876180417484672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265305.603333:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417484672:0@lo:400:kworker.0 00000100:00100000:2.0:1789265305.603773:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417484032 00000100:00100000:2.0:1789265305.603778:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417484032 00000100:00100000:2.0:1789265305.603805:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417483904 00000100:00100000:2.0:1789265305.603808:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417483904 00000100:00100000:2.0:1789265305.603823:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789265305.603830:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417484032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265305.603869:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417484032:12345-0@lo:400:kworker.0 Request processed in 40us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265305.603875:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789265305.603888:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789265305.603892:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417483904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265305.603918:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417483904:12345-0@lo:400:kworker.0 Request processed in 26us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265305.603924:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789265305.604075:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417485056:0@lo:400:kworker.0 00000100:00100000:1.0:1789265305.604105:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417483904:0@lo:400:kworker.0 00000100:00100000:1.0:1789265305.604114:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417484032:0@lo:400:kworker.0 00000100:00100000:3.0:1789265305.604744:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417483648 00000100:00100000:3.0:1789265305.604752:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417483648 00000100:00100000:3.0:1789265305.604799:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1789265305.604808:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3643:x1876180417483648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265305.604859:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3643:x1876180417483648:12345-0@lo:400:kworker.0 Request processed in 52us (2424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265305.604865:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00080000:3.0:1789265305.604898:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265305.604904:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789265305.604907:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265305.604910:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265305.606729:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265305.606758:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417485184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265305.606827:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265305.606909:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417483648:0@lo:400:kworker.0 00000100:00100000:1.0:1789265305.607008:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417485184 00000100:00100000:1.0:1789265305.607048:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417485184 00000100:00100000:1.0:1789265305.607116:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789265305.607125:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd335180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417485184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265305.607148:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265305.607211:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd335180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417485184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265305.607218:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1789265305.607363:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83d47b80 x1876180417485184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265305.607381:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417485184:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789265305.921263:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265306.945490:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265307.970542:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265308.161281:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417485312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265308.161389:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265308.161558:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417485312 00000100:00100000:2.0:1789265308.161570:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417485312 00000100:00100000:2.0:1789265308.161669:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789265308.161681:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417485312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789265308.161724:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789265308.161800:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417485312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265308.161808:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789265308.161962:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417485312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265308.171545:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417485440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265308.171666:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265308.171897:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417485440 00000100:00100000:2.0:1789265308.171909:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417485440 00000100:00100000:2.0:1789265308.171989:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789265308.172001:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417485440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789265308.172065:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789265308.172135:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417485440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265308.172142:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789265308.172213:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417485440:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1789265308.327123:0:13535:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 22:08:27 (1789265307) === 00000100:00100000:3.0:1789265308.588957:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265308.589007:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265308.589112:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399575936 00000100:00100000:0.0:1789265308.589123:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399575936 00000100:00080000:3.0:1789265308.589211:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265308.589233:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 22 00000100:00100000:0.0:1789265308.589245:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+6:2396:x1876180399575936:12345-192.168.203.49@tcp:41:mkdir.0 00000004:00000024:0.0:1789265308.589277:0:8460:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789265308.589367:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+6:2396:x1876180399575936:12345-192.168.203.49@tcp:41:mkdir.0 Request processed in 125us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265308.589374:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 22 00000100:00100000:1.0:1789265308.589464:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399576064 00000100:00100000:1.0:1789265308.589469:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399576064 00000100:00100000:1.0:1789265308.589503:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 2 00000100:00100000:1.0:1789265308.589510:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:5b43750b-84cf-4d62-9028-e016267b6509+6:10495:x1876180399576064:12345-192.168.203.49@tcp:700:mkdir.0 00000100:00100000:1.0:1789265308.589549:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:5b43750b-84cf-4d62-9028-e016267b6509+6:10495:x1876180399576064:12345-192.168.203.49@tcp:700:mkdir.0 Request processed in 40us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265308.589557:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 2 00000100:00100000:3.0:1789265308.592828:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265308.593333:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399576320 00000100:00100000:2.0:1789265308.593344:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399576320 00000100:00100000:2.0:1789265308.593405:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23 00000100:00100000:2.0:1789265308.593415:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+6:10495:x1876180399576320:12345-192.168.203.49@tcp:36:mkdir.0 00010000:00010000:2.0:1789265308.593468:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265308.593535:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a96626 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc9a expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.593556:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fccacd51400) 00010000:00010000:2.0:1789265308.593566:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265308.593656:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96784 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.593671:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96784 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.593696:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96784 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.593726:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9678b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.593734:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9678b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.593740:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9678b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.594622:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96792 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.594636:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96792 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.594643:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96792 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265308.594657:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000141cbcbb reply state 000000005134f727 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96792 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.594667:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96792 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.594673:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fcb83b85400) 00010000:00010000:2.0:1789265308.594676:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789265308.594678:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789265308.594683:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789265308.594689:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96784 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.594700:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96784 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.594706:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96784 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.594710:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520b800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265308.594714:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96784 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.594721:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96784 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.594730:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcb83b85b00) 00010000:00010000:2.0:1789265308.594733:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265308.594735:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96784 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.594741:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96784 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265308.594757:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000141cbcbb reply state 000000005134f727 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9678b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.594765:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9678b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.594770:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fcb83b85800) 00010000:00010000:2.0:1789265308.594772:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789265308.594774:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789265308.594865:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+7:10495:x1876180399576320:12345-192.168.203.49@tcp:36:mkdir.0 Request processed in 1449us (2043us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789265308.594879:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23 00000100:00100000:3.0:1789265308.620963:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265308.623429:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399576448 00000100:00100000:0.0:1789265308.623444:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399576448 00000100:00100000:0.0:1789265308.623527:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24 00000100:00100000:0.0:1789265308.623538:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+7:10496:x1876180399576448:12345-192.168.203.49@tcp:101:chmod.0 00010000:00010000:0.0:1789265308.623559:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265308.623657:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a96799 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbd2d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.623839:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a967a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.623853:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a967a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.623865:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a967a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265308.623912:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789265308.623916:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265308.623952:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a967a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.623977:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a96799 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd2d expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.623997:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a967a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd2d expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.624004:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fccbd2b4500) 00010000:00010000:0.0:1789265308.624007:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265308.624097:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da4800, rc 0) 00000100:00100000:2.0:1789265308.626824:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+8:10496:x1876180399576448:12345-192.168.203.49@tcp:101:chmod.0 Request processed in 3274us (5857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265308.626838:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24 00000100:00100000:1.0:1789265308.635844:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265308.636059:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399576704 00000100:00100000:2.0:1789265308.636069:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399576704 00000100:00100000:2.0:1789265308.636125:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 25 00000100:00100000:2.0:1789265308.636135:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+8:10496:x1876180399576704:12345-192.168.203.49@tcp:36:chmod.0 00010000:00010000:2.0:1789265308.636200:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265308.636227:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a967a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd2d expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.636247:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fccbd2b4500) 00010000:00010000:2.0:1789265308.636258:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265308.636285:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a967a7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.636298:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a967a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.636307:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a967a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265308.636499:0:8459:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd606b36 reply state 000000007a7cac75 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a967a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.636513:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a967a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.636531:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcb83b85b00) 00010000:00010000:2.0:1789265308.636534:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789265308.636536:0:8459:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789265308.636544:0:8459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789265308.636641:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+9:10496:x1876180399576704:12345-192.168.203.49@tcp:36:chmod.0 Request processed in 506us (804us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789265308.636649:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 25 00000100:00100000:2.0:1789265308.673295:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf40d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417485696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265308.673372:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265308.673454:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417485568:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265308.673479:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265308.676376:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265308.676528:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399576832 00000100:00100000:2.0:1789265308.676539:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399576832 00000100:00100000:2.0:1789265308.676624:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 26 00000100:00100000:2.0:1789265308.676636:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+9:10497:x1876180399576832:12345-192.168.203.49@tcp:101:chown.0 00010000:00010000:2.0:1789265308.676659:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265308.676680:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a967ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbd34 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.676750:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692200/0x9272d942b4a967b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.676767:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692200/0x9272d942b4a967b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.676778:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692200/0x9272d942b4a967b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265308.676843:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789265308.676848:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265308.676889:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692200/0x9272d942b4a967b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.676917:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a967ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd34 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.676936:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692200/0x9272d942b4a967b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd34 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.676946:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcb83b85b00) 00010000:00010000:2.0:1789265308.676948:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265308.676951:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81692200, rc 0) 00000100:00100000:2.0:1789265308.677014:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+10:10497:x1876180399576832:12345-192.168.203.49@tcp:101:chown.0 Request processed in 380us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265308.677091:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 26 00000100:00100000:0.0:1789265308.678916:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417485696 00000100:00100000:0.0:1789265308.678929:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417485696 00000100:00100000:0.0:1789265308.679096:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417485568 00000100:00100000:0.0:1789265308.679100:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417485568 00000100:00100000:2.0:1789265308.679195:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789265308.679209:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417485696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265308.679243:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265308.679335:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417485696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (5961us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265308.679343:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:2.0:1789265308.679395:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf40d880 x1876180417485696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265308.679416:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf40d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417485696:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789265308.681764:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265308.685884:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789265308.685901:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417485568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789265308.685956:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265308.686060:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417485568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 164us (12580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265308.686069:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:1.0:1789265308.686730:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4f9f80 x1876180417485568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265308.686751:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417485568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265308.690218:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265308.690818:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399576960 00000100:00100000:2.0:1789265308.690829:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399576960 00000100:00100000:2.0:1789265308.690882:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 27 00000100:00100000:2.0:1789265308.690891:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+10:10497:x1876180399576960:12345-192.168.203.49@tcp:101:chown.0 00010000:00010000:2.0:1789265308.690909:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265308.690929:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692000/0x9272d942b4a967bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbd3b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.690987:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a967c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.691003:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a967c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.691014:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a967c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.691051:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a967ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.691058:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a967ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.691064:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a967ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.691161:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a967d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.691170:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a967d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.691196:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a967d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265308.691236:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789265308.691241:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265308.691260:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a967d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.691273:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a967c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.691280:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a967c3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.691287:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a967c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.691293:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81692600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265308.691297:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a967c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.691304:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a967c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.691315:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcb83b85b00) 00010000:00010000:2.0:1789265308.691318:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265308.691322:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a967c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.691327:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a967c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.691349:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a967ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.691356:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a967ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.691362:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a967ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.691367:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81692e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265308.691370:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a967ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.691376:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a967ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.691384:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fcb83b85800) 00010000:00010000:2.0:1789265308.691387:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265308.691389:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a967ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.691395:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a967ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.691419:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692000/0x9272d942b4a967bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd3b expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.691432:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a967d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd3b expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.691449:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fcb83b85400) 00010000:00010000:2.0:1789265308.691452:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265308.691454:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81693600, rc 0) 00000100:00100000:2.0:1789265308.691521:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+11:10497:x1876180399576960:12345-192.168.203.49@tcp:101:chown.0 Request processed in 631us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265308.691529:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 27 00000100:00100000:1.0:1789265308.696412:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265308.698196:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399577088 00000100:00100000:3.0:1789265308.698210:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399577088 00000100:00100000:3.0:1789265308.698282:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 6 00000100:00100000:3.0:1789265308.698292:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5b43750b-84cf-4d62-9028-e016267b6509+11:10497:x1876180399577088:12345-192.168.203.49@tcp:900:chown.0 00000100:00100000:3.0:1789265308.698473:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5b43750b-84cf-4d62-9028-e016267b6509+11:10497:x1876180399577088:12345-192.168.203.49@tcp:900:chown.0 Request processed in 181us (2069us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265308.698481:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 6 00000100:00100000:3.0:1789265308.702441:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265308.712856:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399577344 00000100:00100000:0.0:1789265308.712873:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399577344 00000100:00100000:0.0:1789265308.712956:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 28 00000100:00100000:0.0:1789265308.712968:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+11:10497:x1876180399577344:12345-192.168.203.49@tcp:36:chown.0 00010000:00010000:0.0:1789265308.713039:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265308.713066:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a967d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd3b expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.713087:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fcb83b85400) 00010000:00010000:0.0:1789265308.713091:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265308.713112:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a967d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.713125:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a967d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.713135:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a967d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789265308.739197:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:2.0:1789265308.739346:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9678b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.739359:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9678b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.739368:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9678b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.739374:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520bc00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265308.739379:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9678b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.739386:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9678b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.739405:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fcb83b85800) 00010000:00010000:2.0:1789265308.739408:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265308.739413:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9678b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.739419:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9678b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.739459:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96792 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.739466:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96792 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.739471:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96792 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.739476:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520a600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265308.739479:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96792 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.739485:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96792 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.739493:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fcb83b85400) 00010000:00010000:2.0:1789265308.739496:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265308.739498:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96792 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.739504:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96792 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.739517:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a967a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.739524:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a967a7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.739529:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a967a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.739540:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520b800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265308.739543:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a967a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.739549:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a967a7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.739558:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcb83b85b00) 00010000:00010000:2.0:1789265308.739560:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789265308.739563:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a967a7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.739568:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a967a7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265308.739927:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9414b2c reply state 00000000aa86b9fd transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a967d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265308.739947:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a967d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265308.739962:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fcb83b85400) 00010000:00010000:1.0:1789265308.739964:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789265308.739967:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789265308.739980:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:1.0:1789265308.740124:0:6518:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789265308.740138:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+7:10497:x1876180399577344:12345-192.168.203.49@tcp:36:chown.0 Request processed in 27169us (37703us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789265308.740158:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 28 00010000:00010000:0.0:1789265308.740258:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a967d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.740267:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a967d8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.740273:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a967d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.740279:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4c00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265308.740282:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a967d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.740288:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a967d8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.740299:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fcb83b85400) 00010000:00010000:0.0:1789265308.740301:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789265308.740304:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a967d8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.740310:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a967d8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265308.777894:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265308.778175:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399577472 00000100:00100000:3.0:1789265308.778186:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399577472 00000100:00100000:3.0:1789265308.778248:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 29 00000100:00100000:3.0:1789265308.778259:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+6:10498:x1876180399577472:12345-192.168.203.49@tcp:101:touch.500 00010000:00010000:3.0:1789265308.778283:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265308.778317:0:8460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a967df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbd42 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789265308.782100:0:8460:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3733us 00010000:00010000:2.0:1789265308.818304:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a967e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.818329:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a967e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.818355:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a967e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.818373:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a967ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.818380:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a967ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.818419:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a967ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.818540:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692a00/0x9272d942b4a967f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.818549:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692a00/0x9272d942b4a967f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.818557:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692a00/0x9272d942b4a967f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265308.818585:0:8460:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789265308.818589:0:8460:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265308.818626:0:8460:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692a00/0x9272d942b4a967f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.818639:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a967e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.818645:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a967e6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.818651:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a967e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.818658:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81692e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265308.818662:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a967e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.818669:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a967e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.818689:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcb83b85b00) 00010000:00010000:2.0:1789265308.818692:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265308.818696:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a967e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.818702:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a967e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.818713:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a967ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.818719:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a967ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.818726:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a967ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.818731:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81692600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265308.818735:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a967ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.818741:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a967ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.818747:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fcb83b85800) 00010000:00010000:2.0:1789265308.818749:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265308.818752:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a967ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.818757:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a967ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.818804:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a967df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd42 expref: 8 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.818820:0:8460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692a00/0x9272d942b4a967f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd42 expref: 7 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265308.818827:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fcb83b85f00) 00010000:00010000:2.0:1789265308.818829:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789265308.818832:0:8460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81692a00, rc 0) 00000100:00100000:2.0:1789265308.818901:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+7:10498:x1876180399577472:12345-192.168.203.49@tcp:101:touch.500 Request processed in 40644us (41017us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265308.818909:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 29 00000100:00100000:3.0:1789265308.823747:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265308.823918:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399577728 00000100:00100000:0.0:1789265308.823928:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399577728 00000100:00100000:0.0:1789265308.823989:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 30 00000100:00100000:0.0:1789265308.823999:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+7:10498:x1876180399577728:12345-192.168.203.49@tcp:101:touch.500 00010000:00010000:0.0:1789265308.824018:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265308.824057:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a967fb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbd49 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.824187:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a96802 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.824202:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a96802 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.824212:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a96802 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.824226:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a96809 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.824233:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a96809 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.824239:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a96809 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789265308.825185:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1789265308.825508:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96810 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.825519:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96810 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.825529:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96810 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.825566:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a96802 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.827721:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a96802 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.827729:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a96802 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.827735:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265308.827740:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a96802 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.827748:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a96802 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.827764:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fcb83b85f00) 00010000:00010000:0.0:1789265308.827767:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265308.827772:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a96802 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.827777:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a96802 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789265308.827795:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021c68123 reply state 000000001d924e1c transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a96809 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.827809:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a96809 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.827816:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff9fccbd2b4500) 00010000:00010000:0.0:1789265308.827818:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789265308.827822:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789265308.828499:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a967fb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd49 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.828535:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96810 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd49 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.828544:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fccbd2b4400) 00010000:00010000:0.0:1789265308.828547:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265308.828549:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5600, rc 0) 00000100:00100000:0.0:1789265308.829012:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+10:10498:x1876180399577728:12345-192.168.203.49@tcp:101:touch.500 Request processed in 5011us (5271us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789265308.829093:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 30 00000100:00100000:2.0:1789265308.836457:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265308.836751:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399577984 00000100:00100000:1.0:1789265308.836761:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399577984 00000100:00100000:1.0:1789265308.836820:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 31 00000100:00100000:1.0:1789265308.836831:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+10:10498:x1876180399577984:12345-192.168.203.49@tcp:36:touch.500 00010000:00010000:1.0:1789265308.836888:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265308.836929:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96810 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd49 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265308.836949:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fccbd2b4400) 00010000:00010000:1.0:1789265308.836959:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265308.837016:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a9681e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265308.837214:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a9681e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265308.837224:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a9681e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265308.837325:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004dad2edf reply state 0000000009a25c63 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a9681e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265308.837351:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a9681e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265308.837357:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fcc9b3cb200) 00010000:00010000:1.0:1789265308.837360:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789265308.837362:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789265308.838278:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+11:10498:x1876180399577984:12345-192.168.203.49@tcp:36:touch.500 Request processed in 1444us (1825us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789265308.838288:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 31 00000100:00100000:1.0:1789265308.841362:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265308.848536:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399578112 00000100:00100000:2.0:1789265308.848552:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399578112 00000100:00100000:1.0:1789265308.848991:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 32 00000100:00100000:1.0:1789265308.849001:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+11:10498:x1876180399578112:12345-192.168.203.49@tcp:101:touch.500 00010000:00010000:1.0:1789265308.849064:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265308.849086:0:8460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96825 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbd50 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265308.849139:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96825 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd50 expref: 12 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265308.849173:0:8460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96825 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd50 expref: 12 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265308.849192:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fcc9b3cb200) 00010000:00010000:1.0:1789265308.849196:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265308.849200:0:8460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fea00, rc 0) 00000100:00100000:1.0:1789265308.849267:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+12:10498:x1876180399578112:12345-192.168.203.49@tcp:101:touch.500 Request processed in 265us (7916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265308.849290:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 32 00000100:00100000:3.0:1789265308.858510:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265308.861661:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399578240 00000100:00100000:1.0:1789265308.861683:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399578240 00000100:00100000:0.0:1789265308.861889:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24 00000100:00100000:0.0:1789265308.861902:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1876180399578240:12345-192.168.203.49@tcp:8:touch.500 00010000:00080000:0.0:1789265308.861939:0:8433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp t0 exp 0000000000000000 cur 360 last 0 00000020:00000080:0.0:1789265308.861978:0:8433:0:(genops.c:1385:class_connect()) connect: client 5b43750b-84cf-4d62-9028-e016267b6509, cookie 0x9272d942b4a9682c 00002000:00100000:0.0:1789265308.861990:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5b43750b-84cf-4d62-9028-e016267b6509/ffff9fccbf4eb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789265308.862000:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789265308.862121:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789265308.862166:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9fccbf4ee800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265308.862242:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+6:2392:x1876180399578240:12345-192.168.203.49@tcp:8:touch.500 Request processed in 339us (3746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265308.862250:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24 00000100:00100000:2.0:1789265308.870952:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265308.871793:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399578368 00000100:00100000:0.0:1789265308.871803:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399578368 00000100:00100000:0.0:1789265308.871882:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 25 00000100:00100000:0.0:1789265308.871892:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+6:0:x1876180399578368:12345-192.168.203.49@tcp:2:touch.500 00000100:00080000:3.0:1789265308.872185:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789265308.881902:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:0.0:1789265308.881916:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5b43750b-84cf-4d62-9028-e016267b6509 00000100:00100000:2.0:1789265308.883372:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:0:x1876180399578368:12345-192.168.203.49@tcp:2:touch.500 Request processed in 11468us (12415us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789265308.883395:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 25 00000100:00100000:2.0:1789265308.900399:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265308.901361:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399578624 00000100:00100000:1.0:1789265308.901374:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399578624 00000100:00100000:1.0:1789265308.901448:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 2 00000100:00100000:1.0:1789265308.901459:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+12:10498:x1876180399578624:12345-192.168.203.49@tcp:35:touch.500 00000100:00100000:1.0:1789265308.901746:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+13:10498:x1876180399578624:12345-192.168.203.49@tcp:35:touch.500 Request processed in 288us (1356us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789265308.901755:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 2 00000100:00100000:3.0:1789265308.937676:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265308.938097:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399578752 00000100:00100000:0.0:1789265308.938110:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399578752 00000100:00100000:0.0:1789265308.938216:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 33 00000100:00100000:0.0:1789265308.938228:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+13:10499:x1876180399578752:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:0.0:1789265308.938264:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265308.938293:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a96833 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbd57 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.938384:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a9683a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.938401:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a9683a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.938418:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a9683a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265308.939605:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789265308.939618:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265308.939681:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a9683a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.940344:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a96833 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd57 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.940376:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a9683a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd57 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265308.940502:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fcb83b85f00) 00010000:00010000:0.0:1789265308.940505:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265308.940509:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da4800, rc 0) 00000100:00100000:0.0:1789265308.940678:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+14:10499:x1876180399578752:12345-192.168.203.49@tcp:101:rm.0 Request processed in 2450us (3016us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265308.940699:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 33 00000100:00100000:2.0:1789265308.949109:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265308.949440:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399579008 00000100:00100000:1.0:1789265308.949453:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399579008 00000100:00100000:1.0:1789265308.949527:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 34 00000100:00100000:1.0:1789265308.949539:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+14:10499:x1876180399579008:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:1.0:1789265308.949568:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265308.949596:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe600/0x9272d942b4a96841 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbd5e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265308.949968:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789265308.950390:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe600/0x9272d942b4a96841 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd5e expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265308.950411:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcb83b85b00) 00010000:00010000:1.0:1789265308.950414:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789265308.950420:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe600/0x9272d942b4a96841 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd5e expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265308.950502:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fe600, rc 0) 00000100:00100000:1.0:1789265308.950636:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+15:10499:x1876180399579008:12345-192.168.203.49@tcp:101:rm.0 Request processed in 1098us (1538us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1789265308.950646:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 34 00000100:00100000:2.0:1789265308.965387:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265308.965514:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399579136 00000100:00100000:3.0:1789265308.965528:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399579136 00000100:00100000:3.0:1789265308.965683:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 3 00000100:00100000:3.0:1789265308.965695:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+15:10499:x1876180399579136:12345-192.168.203.49@tcp:37:rm.0 00000100:00100000:2.0:1789265308.978719:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+15:10499:x1876180399579136:12345-192.168.203.49@tcp:37:rm.0 Request processed in 13010us (13330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265308.978744:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 3 00010000:00010000:0.0:1789265308.993699:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265309.002360:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265309.004430:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399579392 00000100:00100000:1.0:1789265309.004453:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399579392 00000100:00100000:1.0:1789265309.004567:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 4 00000100:00100000:1.0:1789265309.004580:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdccc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+15:10499:x1876180399579392:12345-192.168.203.49@tcp:35:rm.0 00000100:00100000:1.0:1789265309.004905:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdccc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+16:10499:x1876180399579392:12345-192.168.203.49@tcp:35:rm.0 Request processed in 327us (2558us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789265309.004915:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 4 00000100:00100000:0.0:1789265309.010921:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265309.012386:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399579648 00000100:00100000:3.0:1789265309.012404:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399579648 00000100:00100000:2.0:1789265309.013286:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 35 00000100:00100000:2.0:1789265309.013306:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+16:10499:x1876180399579648:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:2.0:1789265309.013344:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265309.013376:0:8460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a9684f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbd65 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.013535:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692000/0x9272d942b4a96856 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.013553:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692000/0x9272d942b4a96856 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.013568:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692000/0x9272d942b4a96856 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265309.013581:0:8460:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789265309.013757:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a9684f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd65 expref: 19 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.013781:0:8460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692000/0x9272d942b4a96856 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd65 expref: 18 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.013790:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fcb83b85f00) 00010000:00010000:2.0:1789265309.013794:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789265309.013797:0:8460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81692000, rc 0) 00000100:00100000:2.0:1789265309.014252:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+18:10499:x1876180399579648:12345-192.168.203.49@tcp:101:rm.0 Request processed in 950us (3342us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789265309.014261:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 35 00000100:00100000:2.0:1789265309.022344:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265309.023251:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399579776 00000100:00100000:0.0:1789265309.023269:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399579776 00000100:00100000:0.0:1789265309.023355:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 36 00000100:00100000:0.0:1789265309.023368:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+18:10499:x1876180399579776:12345-192.168.203.49@tcp:41:rm.0 00000004:00000024:0.0:1789265309.023456:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1789265309.023561:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+18:10499:x1876180399579776:12345-192.168.203.49@tcp:41:rm.0 Request processed in 195us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265309.023570:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 36 00000100:00100000:3.0:1789265309.026642:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265309.027518:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399579904 00000100:00100000:1.0:1789265309.027535:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399579904 00000100:00100000:1.0:1789265309.027655:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 37 00000100:00100000:1.0:1789265309.027668:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+18:10499:x1876180399579904:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:1.0:1789265309.027703:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265309.027744:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe600/0x9272d942b4a96864 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbd6c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.027829:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff600/0x9272d942b4a9686b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.027847:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff600/0x9272d942b4a9686b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.027862:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff600/0x9272d942b4a9686b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.027896:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fee00/0x9272d942b4a96872 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.027905:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fee00/0x9272d942b4a96872 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.027911:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fee00/0x9272d942b4a96872 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.028077:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96879 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.028087:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96879 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.028094:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96879 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265309.028158:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789265309.028164:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789265309.028187:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96879 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.028202:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96879 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.028211:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff600/0x9272d942b4a9686b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.028218:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff600/0x9272d942b4a9686b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.028236:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff600/0x9272d942b4a9686b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.028243:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265309.028248:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff600/0x9272d942b4a9686b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.028256:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff600/0x9272d942b4a9686b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.028271:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fcb83b85f00) 00010000:00010000:1.0:1789265309.028275:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265309.028280:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff600/0x9272d942b4a9686b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.028286:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff600/0x9272d942b4a9686b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.028301:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fee00/0x9272d942b4a96872 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.028307:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fee00/0x9272d942b4a96872 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.028312:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fee00/0x9272d942b4a96872 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.028317:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fee00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265309.028320:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fee00/0x9272d942b4a96872 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.028340:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fee00/0x9272d942b4a96872 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.028350:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff9fccbd2b4500) 00010000:00010000:1.0:1789265309.028353:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265309.028357:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fee00/0x9272d942b4a96872 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.028364:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fee00/0x9272d942b4a96872 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.028401:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe600/0x9272d942b4a96864 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd6c expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.028416:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96879 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd6c expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265309.028424:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fcc9b3cb200) 00010000:00010000:1.0:1789265309.028426:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265309.028438:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fe000, rc 0) 00000100:00100000:1.0:1789265309.028538:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+19:10499:x1876180399579904:12345-192.168.203.49@tcp:101:rm.0 Request processed in 872us (1909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265309.028548:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 37 00000100:00100000:2.0:1789265309.033354:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265309.033653:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399580160 00000100:00100000:3.0:1789265309.033667:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399580160 00000100:00100000:0.0:1789265309.034051:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 38 00000100:00100000:0.0:1789265309.034066:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+19:10499:x1876180399580160:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:0.0:1789265309.034160:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789265309.034196:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96879 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd6c expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.034225:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96825 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd50 expref: 18 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.034260:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fcc9b3cb200) 00010000:00010000:0.0:1789265309.034274:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a9683a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd57 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.034284:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fcb83b85f00) 00010000:00010000:0.0:1789265309.034288:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265309.034314:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96880 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.034329:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96880 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.034339:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96880 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.034351:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4600/0x9272d942b4a96887 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.034358:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4600/0x9272d942b4a96887 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.034365:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4600/0x9272d942b4a96887 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.034533:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a9688e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.034541:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a9688e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.034557:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a9688e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789265309.035324:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1789265309.035340:0:6517:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360265316377ns, next at 361265313340ns, rc = 0 00010000:00010000:0.0:1789265309.035889:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96895 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.035910:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96895 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.035923:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96895 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.035933:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96895 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.035940:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96895 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.035947:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96895 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.035977:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265309.036012:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265309.036019:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96895 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.036052:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5200 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265309.036057:0:7473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96895 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.036086:0:7473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96895 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.036099:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fcc9b3cb200) 00010000:00010000:0.0:1789265309.036102:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789265309.036109:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96895 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.036115:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96895 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.036313:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265309.036315:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265309.036317:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265309.036335:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a9688e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.036342:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a9688e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.036348:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a9688e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.036352:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265309.036356:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a9688e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.036361:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a9688e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.036370:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fcc9b3cb200) 00010000:00010000:0.0:1789265309.036379:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789265309.036382:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a9688e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.036388:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a9688e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.036420:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96880 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.036427:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96880 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.036900:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96880 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.036907:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265309.036911:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96880 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.036917:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96880 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.036929:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fcb83b85f00) 00010000:00010000:0.0:1789265309.036931:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265309.036934:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96880 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.037212:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96880 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789265309.037229:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042aa2419 reply state 00000000c197bc92 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4600/0x9272d942b4a96887 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.037260:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4600/0x9272d942b4a96887 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265309.037267:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff9fccbd2b4500) 00010000:00010000:0.0:1789265309.037270:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789265309.037274:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789265309.037532:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+18:10499:x1876180399580160:12345-192.168.203.49@tcp:36:rm.0 Request processed in 3463us (4184us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789265309.037543:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 38 00000100:00100000:2.0:1789265309.046927:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265309.047286:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399580416 00000100:00100000:3.0:1789265309.047301:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399580416 00000100:00100000:3.0:1789265309.047449:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5 00000100:00100000:3.0:1789265309.047463:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+18:10499:x1876180399580416:12345-192.168.203.49@tcp:35:rm.0 00000100:00100000:3.0:1789265309.048249:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+19:10499:x1876180399580416:12345-192.168.203.49@tcp:35:rm.0 Request processed in 782us (1829us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789265309.048278:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5 00000100:00100000:3.0:1789265309.057243:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265309.057879:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399580672 00000100:00100000:2.0:1789265309.057895:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399580672 00000100:00100000:2.0:1789265309.057970:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 39 00000100:00100000:2.0:1789265309.057981:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+19:10499:x1876180399580672:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:2.0:1789265309.058093:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789265309.058130:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692000/0x9272d942b4a96856 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd65 expref: 19 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.058168:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692a00/0x9272d942b4a967f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd42 expref: 18 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.058180:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fcb83b85f00) 00010000:00010000:2.0:1789265309.058200:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692200/0x9272d942b4a967b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd34 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.058208:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcb83b85b00) 00010000:00010000:2.0:1789265309.058214:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265309.058245:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a9689c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.058260:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a9689c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.058271:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a9689c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.058285:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a968a3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.058311:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a968a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.058319:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a968a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.058425:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a968aa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.058434:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a968aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.058441:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a968aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265309.058723:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789265309.061351:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a968aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.061376:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a968aa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.061386:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a968aa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.061392:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81693800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265309.061397:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a968aa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.061406:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a968aa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.061516:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fcb83b85100) 00010000:00010000:2.0:1789265309.061520:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789265309.061527:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a968aa lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.061831:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a968aa lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.061882:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a9689c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.061888:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a9689c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.061895:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a9689c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.061900:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81693e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265309.061903:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a9689c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.061910:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a9689c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.061919:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcb83b85800) 00010000:00010000:2.0:1789265309.061922:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265309.061925:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a9689c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.061932:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a9689c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265309.062365:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8d2f89b reply state 00000000a45a4cbf transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a968a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.062382:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a968a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265309.062391:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fcb83b85400) 00010000:00010000:2.0:1789265309.062394:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789265309.062398:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265309.062627:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+18:10499:x1876180399580672:12345-192.168.203.49@tcp:36:rm.0 Request processed in 4642us (5393us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789265309.062638:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 39 00010000:00010000:2.0:1789265310.018220:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265310.030879:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265310.030980:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265310.031015:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265310.031064:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265310.031088:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265310.031114:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265310.031158:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399581056 00000100:00100000:0.0:1789265310.031170:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399581056 00000100:00100000:0.0:1789265310.031241:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399581312 00000100:00100000:0.0:1789265310.031245:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399581312 00000100:00100000:0.0:1789265310.031262:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399580928 00000100:00100000:0.0:1789265310.031264:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399580928 00000100:00100000:0.0:1789265310.031276:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399581440 00000100:00100000:0.0:1789265310.031278:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399581440 00000100:00100000:0.0:1789265310.031297:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 204 00000100:00100000:0.0:1789265310.031310:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2393:x1876180399581056:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265310.031496:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2393:x1876180399581056:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 187us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265310.031505:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 204 00000100:00100000:0.0:1789265310.031543:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 205 00000100:00100000:0.0:1789265310.031550:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399581312:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265310.031578:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399581312:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 29us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265310.031585:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 205 00000100:00100000:0.0:1789265310.031597:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 206 00000100:00100000:0.0:1789265310.031603:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+18:2393:x1876180399580928:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265310.031654:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+18:2393:x1876180399580928:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 51us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265310.031660:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 206 00000100:00100000:0.0:1789265310.031671:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 207 00000100:00100000:0.0:1789265310.031677:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399581440:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265310.031702:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399581440:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 26us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265310.031709:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 207 00000100:00080000:0.0:1789265310.031730:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265310.031736:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265310.032086:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399581184 00000100:00100000:1.0:1789265310.032095:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399581184 00000100:00100000:1.0:1789265310.032164:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 75 00000100:00100000:1.0:1789265310.032174:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2393:x1876180399581184:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265310.032232:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2393:x1876180399581184:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 60us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265310.032239:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 75 00000100:00080000:0.0:1789265310.032506:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265310.036964:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399580800 00000100:00100000:3.0:1789265310.036983:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399580800 00000100:00100000:3.0:1789265310.037215:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 336 00000100:00100000:3.0:1789265310.037226:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2393:x1876180399580800:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265310.037399:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2393:x1876180399580800:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 110us (6471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265310.037409:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 336 00000100:00100000:2.0:1789265310.212318:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265310.212366:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417485824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265310.212466:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265310.212722:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417485824 00000100:00100000:3.0:1789265310.212735:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417485824 00000100:00100000:3.0:1789265310.212820:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789265310.212831:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417485824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789265310.212873:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265310.212930:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417485824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265310.212938:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1789265310.213070:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789265310.213887:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb82ef4700 x1876180417485824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265310.213915:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417485824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265310.723355:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417486080:0@lo:400:kworker.0 00000100:00100000:3.0:1789265310.723430:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265310.723498:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417486592:0@lo:400:kworker.0 00000100:00100000:3.0:1789265310.723527:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265310.723573:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876180417487104:0@lo:400:kworker.0 00000100:00100000:3.0:1789265310.723597:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265310.723645:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789265310.723655:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417486208:0@lo:400:kworker.0 00000100:00100000:0.0:1789265310.726118:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417485952:0@lo:400:kworker.0 00000100:00100000:0.0:1789265310.726207:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265310.726230:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265310.726264:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417486464:0@lo:400:kworker.0 00000100:00100000:3.0:1789265310.726268:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417486720:0@lo:400:kworker.0 00000100:00100000:0.0:1789265310.726306:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265310.726317:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417486208 00000100:00100000:3.0:1789265310.726325:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417486208 00000100:00100000:0.0:1789265310.726338:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417486976:0@lo:400:kworker.0 00000100:00100000:0.0:1789265310.726368:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265310.726383:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789265310.726393:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417486208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265310.726412:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789265310.726421:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417486336:0@lo:400:kworker.0 00000100:00100000:0.0:1789265310.726461:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265310.726462:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417486208:12345-0@lo:400:kworker.0 Request processed in 67us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265310.726472:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789265310.726486:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417486848:0@lo:400:kworker.0 00000100:00100000:3.0:1789265310.726492:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417486336 00000100:00100000:3.0:1789265310.726497:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417486336 00000100:00100000:0.0:1789265310.726515:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265310.726519:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789265310.726529:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417486336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265310.726538:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417487360:0@lo:400:kworker.0 00000100:00100000:3.0:1789265310.726575:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417486336:12345-0@lo:400:kworker.0 Request processed in 46us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265310.726575:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265310.726584:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789265310.726630:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417486336:0@lo:400:kworker.0 00000100:00100000:0.0:1789265310.726664:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417486080 00000100:00100000:0.0:1789265310.726668:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417486080 00000100:00100000:0.0:1789265310.726702:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417486592 00000100:00100000:0.0:1789265310.726706:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417486592 00000100:00100000:0.0:1789265310.726728:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417487104 00000100:00100000:0.0:1789265310.726731:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417487104 00000100:00100000:0.0:1789265310.726743:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417486464 00000100:00100000:0.0:1789265310.726745:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417486464 00000100:00100000:0.0:1789265310.726757:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789265310.726762:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417486080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265310.726795:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417486080:12345-0@lo:400:kworker.0 Request processed in 32us (3368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265310.726801:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789265310.726815:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789265310.726821:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417486592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265310.726847:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417486592:12345-0@lo:400:kworker.0 Request processed in 27us (3322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265310.726852:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789265310.726863:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789265310.726875:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876180417487104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265310.726905:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876180417487104:12345-0@lo:400:kworker.0 Request processed in 30us (3307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265310.726911:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789265310.726922:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789265310.726929:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417486464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265310.726960:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417486464:12345-0@lo:400:kworker.0 Request processed in 32us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265310.726966:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789265310.726984:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417485952 00000100:00100000:0.0:1789265310.726987:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417485952 00000100:00100000:0.0:1789265310.727045:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1789265310.727051:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3644:x1876180417485952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265310.727076:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3644:x1876180417485952:12345-0@lo:400:kworker.0 Request processed in 26us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265310.727082:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1789265310.727109:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417486976 00000100:00100000:0.0:1789265310.727112:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417486976 00000100:00100000:0.0:1789265310.727144:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417486848 00000100:00100000:0.0:1789265310.727147:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417486848 00000100:00100000:0.0:1789265310.727157:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417487360 00000100:00100000:0.0:1789265310.727159:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417487360 00000100:00100000:0.0:1789265310.727171:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789265310.727176:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417486976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265310.727200:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417486976:12345-0@lo:400:kworker.0 Request processed in 24us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265310.727206:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789265310.727230:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789265310.727236:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417486848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265310.727272:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417486848:12345-0@lo:400:kworker.0 Request processed in 36us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265310.727277:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789265310.727287:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789265310.727292:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417487360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265310.727311:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417487360:12345-0@lo:400:kworker.0 Request processed in 19us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265310.727316:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1789265310.727338:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265310.727342:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265310.727344:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265310.727359:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265310.727377:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417487232:0@lo:400:kworker.0 00000100:00100000:0.0:1789265310.727397:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265310.727417:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417486080:0@lo:400:kworker.0 00000100:00100000:0.0:1789265310.727427:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417486592:0@lo:400:kworker.0 00000100:00100000:0.0:1789265310.727435:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876180417487104:0@lo:400:kworker.0 00000100:00100000:0.0:1789265310.727453:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417486208:0@lo:400:kworker.0 00000100:00100000:0.0:1789265310.727468:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417486720 00000100:00100000:0.0:1789265310.727470:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417486720 00000100:00100000:0.0:1789265310.727489:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417487232 00000100:00100000:0.0:1789265310.727491:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417487232 00000100:00100000:0.0:1789265310.727501:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789265310.727506:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417486720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265310.727541:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417486720:12345-0@lo:400:kworker.0 Request processed in 34us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265310.727547:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789265310.727558:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789265310.727563:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417487232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265310.727582:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417487232:12345-0@lo:400:kworker.0 Request processed in 20us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265310.727588:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00080000:0.0:1789265310.727598:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789265310.727615:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccb0a66300 x1876180417486848/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265310.727627:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417486848:0@lo:400:kworker.0 00010000:00080000:0.0:1789265310.727636:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccb0a65180 x1876180417487360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265310.727644:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417487360:0@lo:400:kworker.0 00000100:00100000:0.0:1789265310.727651:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417485952:0@lo:400:kworker.0 00000100:00100000:0.0:1789265310.727660:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417486464:0@lo:400:kworker.0 00010000:00080000:0.0:1789265310.727668:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccb0a66680 x1876180417486976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265310.727676:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417486976:0@lo:400:kworker.0 00010000:00080000:0.0:1789265310.727700:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccb0a65c00 x1876180417486720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265310.727708:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417486720:0@lo:400:kworker.0 00010000:00080000:0.0:1789265310.727722:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccb0a67480 x1876180417487232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265310.727729:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417487232:0@lo:400:kworker.0 00000100:00100000:3.0:1789265310.731127:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265310.731156:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417487488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265310.731221:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265310.731276:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417487488 00000100:00100000:3.0:1789265310.731283:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417487488 00000100:00100000:3.0:1789265310.731338:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789265310.731349:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417487488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265310.731371:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265310.731435:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417487488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265310.731452:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1789265310.731713:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83b91180 x1876180417487488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265310.731733:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417487488:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789265311.041487:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265312.065172:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265313.094640:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265313.282520:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417487744:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265313.282630:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265313.282736:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265313.282744:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417487616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265313.282772:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265313.282814:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417487744 00000100:00100000:3.0:1789265313.282827:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417487744 00000100:00100000:3.0:1789265313.282996:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417487616 00000100:00100000:3.0:1789265313.283002:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417487616 00000100:00100000:1.0:1789265313.288941:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789265313.288977:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417487744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789265313.289189:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789265313.289992:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417487744:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265313.292673:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417487744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3700us (10027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265313.292692:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789265313.292756:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789265313.295001:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417487616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265313.295748:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789265313.297233:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417487616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2261us (14447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265313.297250:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789265313.297661:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417487616:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1789265313.542943:0:13682:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:3.0:1789265313.796192:0:8913:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 365026165289ns, next at 366026161217ns, rc = 0 00000100:00100000:3.0:1789265313.796226:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265313.796251:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417487872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265313.796341:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265313.797155:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417487872 00000100:00100000:2.0:1789265313.797169:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417487872 00000100:00100000:2.0:1789265313.797239:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789265313.797250:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417487872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265313.797287:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265313.797573:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417487872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 324us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265313.797710:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:2.0:1789265313.797772:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83b93480 x1876180417487872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265313.797797:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417487872:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789265313.803095:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265313.809071:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265313.809102:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf40f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417488000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265313.819820:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265313.819964:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417488000 00000100:00100000:2.0:1789265313.819977:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417488000 00000100:00100000:2.0:1789265313.820105:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789265313.820127:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417488000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789265313.820159:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265313.820215:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417488000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265313.820223:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:1.0:1789265313.820326:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf40f800 x1876180417488000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265313.820361:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf40f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417488000:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789265313.820437:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789265314.115789:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789265314.824424:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1789265314.824483:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1789265314.824498:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:3.0:1789265314.824547:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a96809 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824560:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a96809 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824569:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a96809 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824575:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4a00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265314.824581:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a96809 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824589:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a96809 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824629:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff9fccbd2b4500) 00010000:00010000:3.0:1789265314.824633:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265314.824639:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a96809 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824656:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a96809 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824681:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a9681e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824688:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a9681e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824694:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a9681e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824699:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ffa00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265314.824702:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a9681e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824708:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a9681e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824717:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fcc9b3cb200) 00010000:00010000:3.0:1789265314.824719:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265314.824722:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a9681e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824728:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a9681e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824761:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4600/0x9272d942b4a96887 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824767:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4600/0x9272d942b4a96887 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824773:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4600/0x9272d942b4a96887 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824778:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265314.824781:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4600/0x9272d942b4a96887 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824786:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4600/0x9272d942b4a96887 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824794:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff9fccbd2b4500) 00010000:00010000:3.0:1789265314.824796:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265314.824798:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4600/0x9272d942b4a96887 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824803:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4600/0x9272d942b4a96887 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824816:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a968a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824822:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a968a3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824826:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a968a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824837:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81693600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265314.824841:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a968a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824847:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a968a3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824856:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fcb83b85400) 00010000:00010000:3.0:1789265314.824858:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265314.824861:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a968a3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.824867:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a968a3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265314.826214:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265314.826238:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf40f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417488128:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789265314.826328:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265314.826414:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417488128 00000100:00100000:1.0:1789265314.826422:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417488128 00000100:00100000:1.0:1789265314.826485:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789265314.826495:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417488128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789265314.826531:0:8914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1789265314.826577:0:8914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aa6059d, atime: 0x6aa6059d, ctime: 0x6aa6059d, blocks: 0x0 00010000:00010000:1.0:1789265314.826586:0:8914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb31d0cf/0x9272d942b4a968b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.826605:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=366s v=(0 0) 00010000:00010000:1.0:1789265314.826611:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265314.826618:0:8914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb31d0cf/0x9272d942b4a968b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.826639:0:8914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb31d0cf/0x9272d942b4a968b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.826661:0:8914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb31d0cf/0x9272d942b4a968b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.826670:0:8914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb31d0cf/0x9272d942b4a968b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.826702:0:8914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789265314.826891:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180417488128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 397us (562us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789265314.826900:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1789265314.826930:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265314.826937:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb31d0cf/0x9272d942b4a968b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.826946:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff600 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265314.826951:0:7473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb31d0cf/0x9272d942b4a968b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.826960:0:7473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb31d0cf/0x9272d942b4a968b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.826980:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb31d0cf/0x9272d942b4a968b1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.826988:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb31d0cf/0x9272d942b4a968b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.827010:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265314.827012:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265314.827014:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789265314.827083:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fccbf40f800/2, rc 0, transno 4294967301 00000100:00100000:1.0:1789265314.827089:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf40f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417488128:0@lo:6:osp-syn-0-0.0 00000020:00000080:1.0:1789265314.960507:0:13731:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff38dab0f0 20000000:00000080:1.0:1789265314.960533:0:13731:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fcb83d79400 uarg=0000000000000000 20000000:01000000:1.0:1789265314.960590:0:13731:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789265314.960598:0:13731:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789265314.960604:0:13731:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1789265314.962333:0:13732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1789265314.962522:0:13731:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789265314.976178:0:13731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789265314.976220:0:13731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789265314.976233:0:13731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789265314.976253:0:13731:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789265314.976277:0:13731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fcb83da5e00/0x9272d942b4a968b8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.976299:0:13731:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a96745 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9673e expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.976309:0:13731:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fccb520ac00/0x9272d942b4a96753 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9674c expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.976316:0:13731:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fccbd2ff200/0x9272d942b4a96761 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9675a expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.976346:0:13731:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fccbd2fec00/0x9272d942b4a9676f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a96768 expref: 23 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.976358:0:13731:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fccbd2ff800/0x9272d942b4a96776 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd1f expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.976367:0:13731:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcb83da5c00/0x9272d942b4a9677d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd26 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.976376:0:13731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fcb83da5e00/0x9272d942b4a968b8 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.976424:0:13731:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcb83da5c00/0x9272d942b4a9677d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd26 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.976439:0:13731:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcb83da5c00/0x9272d942b4a9677d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd26 expref: 12 pid: 6508 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265314.976457:0:13731:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1876180417488256:192.168.203.49@tcp:104: 00010000:00010000:0.0:1789265314.976581:0:13731:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fccbd2ff800/0x9272d942b4a96776 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd1f expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.976589:0:13731:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fccbd2ff800/0x9272d942b4a96776 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd1f expref: 12 pid: 6510 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265314.976597:0:13731:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1876180417488384:192.168.203.49@tcp:104: 00010000:00010000:0.0:1789265314.976622:0:13731:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fccbd2fec00/0x9272d942b4a9676f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a96768 expref: 23 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.976640:0:13731:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fccbd2fec00/0x9272d942b4a9676f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a96768 expref: 23 pid: 7458 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265314.976668:0:13731:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1876180417488512:0@lo:104: 00000100:00100000:0.0:1789265314.976716:0:13731:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789265314.976754:0:13731:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fccbd2ff200/0x9272d942b4a96761 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a9675a expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.976762:0:13731:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fccbd2ff200/0x9272d942b4a96761 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a9675a expref: 23 pid: 6508 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265314.976770:0:13731:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1876180417488640:0@lo:104: 00010000:00010000:0.0:1789265314.976788:0:13731:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fccb520ac00/0x9272d942b4a96753 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a9674c expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.976795:0:13731:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fccb520ac00/0x9272d942b4a96753 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a9674c expref: 23 pid: 6510 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265314.976802:0:13731:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1876180417488768:0@lo:104: 00010000:00010000:0.0:1789265314.976821:0:13731:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a96745 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a9673e expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.976827:0:13731:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a96745 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a9673e expref: 23 pid: 6511 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265314.976834:0:13731:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a67480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1876180417488896:0@lo:104: 00000100:00100000:0.0:1789265314.976848:0:13731:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83b870c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265314.977200:0:10338:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789265314.977225:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265314.977242:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265314.977259:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265314.977268:0:10338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417488512 00000100:00100000:1.0:1789265314.977275:0:10338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417488512 00000100:00100000:1.0:1789265314.977318:0:10338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417488640 00000100:00100000:1.0:1789265314.977321:0:10338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417488640 00000100:00100000:1.0:1789265314.977329:0:10338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417488768 00000100:00100000:1.0:1789265314.977331:0:10338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417488768 00000100:00100000:1.0:1789265314.977338:0:10338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417488896 00000100:00100000:1.0:1789265314.977340:0:10338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417488896 00000100:00100000:1.0:1789265314.977351:0:10338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789265314.977360:0:10338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bfec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+6:13731:x1876180417488512:12345-0@lo:104: 00010000:00010000:1.0:1789265314.977374:0:10338:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffc00/0x9272d942b4a96768 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9676f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.977428:0:10338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789265314.977433:0:10338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bfec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+6:13731:x1876180417488512:12345-0@lo:104: Request processed in 75us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265314.977440:0:10338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789265314.977479:0:10338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789265314.977484:0:10338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+5:13731:x1876180417488640:12345-0@lo:104: 00010000:00010000:1.0:1789265314.977503:0:10338:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a9675a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96761 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.977532:0:10338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789265314.977537:0:10338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+5:13731:x1876180417488640:12345-0@lo:104: Request processed in 53us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265314.977543:0:10338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789265314.977554:0:10338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789265314.977559:0:10338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+4:13731:x1876180417488768:12345-0@lo:104: 00010000:00010000:1.0:1789265314.977566:0:10338:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fccb520b600/0x9272d942b4a9674c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96753 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.977590:0:10338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789265314.977594:0:10338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+4:13731:x1876180417488768:12345-0@lo:104: Request processed in 36us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265314.977600:0:10338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789265314.977608:0:10338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789265314.977613:0:10338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+3:13731:x1876180417488896:12345-0@lo:104: 00010000:00010000:1.0:1789265314.977619:0:10338:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a9673e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96745 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.977638:0:10338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789265314.977655:0:10338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+3:13731:x1876180417488896:12345-0@lo:104: Request processed in 42us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265314.977666:0:10338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1789265314.977688:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789265314.977694:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffc00/0x9272d942b4a96768 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9676f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.977708:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ffc00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:1.0:1789265314.977713:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffc00/0x9272d942b4a96768 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a9676f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.977723:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffc00/0x9272d942b4a96768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a9676f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265314.977730:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffc00/0x9272d942b4a96768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a9676f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265314.977736:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789265314.977771:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffc00/0x9272d942b4a96768 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9676f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.977776:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265314.977796:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffc00/0x9272d942b4a96768 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9676f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.977803:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffc00/0x9272d942b4a96768 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9676f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.977818:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789265314.977821:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a9675a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96761 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.977826:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6a00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:1.0:1789265314.977829:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a9675a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a96761 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.977845:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a9675a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a96761 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265314.977852:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a9675a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a96761 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265314.977857:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789265314.977867:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a9675a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96761 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.977872:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265314.977886:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a9675a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96761 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.977891:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6a00/0x9272d942b4a9675a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96761 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.977900:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265314.977903:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fccb520b600/0x9272d942b4a9674c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96753 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.977909:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520b600 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:1.0:1789265314.977912:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fccb520b600/0x9272d942b4a9674c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a96753 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.977918:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fccb520b600/0x9272d942b4a9674c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a96753 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265314.977924:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fccb520b600/0x9272d942b4a9674c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a96753 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265314.977935:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789265314.977945:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fccb520b600/0x9272d942b4a9674c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96753 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.977950:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265314.977956:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fccb520b600/0x9272d942b4a9674c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96753 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.977962:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fccb520b600/0x9272d942b4a9674c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96753 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.977970:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265314.977973:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a9673e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a96745 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.977978:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520aa00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:1.0:1789265314.977981:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a9673e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a96745 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.977988:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a9673e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a96745 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265314.977994:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a9673e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a96745 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265314.977999:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789265314.978008:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a9673e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96745 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.978012:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265314.978052:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a9673e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96745 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.978069:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fccb520aa00/0x9272d942b4a9673e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a96745 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.978085:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265314.978087:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265314.978089:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265314.978096:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265314.978110:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265314.978133:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf40d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417489024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265314.978170:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265314.978205:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265314.978210:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417489408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265314.978226:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265314.978251:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417489152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265314.978268:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265314.978282:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265314.978286:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417489280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265314.978318:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265314.978347:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417489024 00000100:00100000:1.0:1789265314.978352:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417489024 00010000:00010000:1.0:1789265314.978377:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fccbd2fec00/0x9272d942b4a9676f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96768 expref: 24 pid: 7458 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265314.978394:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417489408 00000100:00100000:1.0:1789265314.978396:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417489408 00010000:00010000:1.0:1789265314.978403:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a96745 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9673e expref: 25 pid: 6511 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265314.978418:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417489152 00000100:00100000:1.0:1789265314.978421:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417489152 00010000:00010000:1.0:1789265314.978429:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fccbd2ff200/0x9272d942b4a96761 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9675a expref: 26 pid: 6508 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265314.978437:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417489280 00000100:00100000:1.0:1789265314.978439:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417489280 00010000:00010000:1.0:1789265314.978446:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fccb520ac00/0x9272d942b4a96753 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9674c expref: 27 pid: 6510 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265314.978456:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789265314.978462:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+27:3642:x1876180417489024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265314.978474:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265314.978479:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fccbd2fec00/0x9272d942b4a9676f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a96768 expref: 27 pid: 7458 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.978490:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fccbd2fec00/0x9272d942b4a9676f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a96768 expref: 27 pid: 7458 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.978509:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265314.978535:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+27:3642:x1876180417489024:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265314.978542:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789265314.978554:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789265314.978559:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+26:3642:x1876180417489408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265314.978566:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265314.978569:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a96745 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9673e expref: 26 pid: 6511 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.978588:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a96745 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a9673e expref: 26 pid: 6511 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.978598:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265314.978615:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+26:3642:x1876180417489408:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265314.978622:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789265314.978632:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789265314.978637:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+25:3643:x1876180417489152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265314.978643:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265314.978647:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fccbd2ff200/0x9272d942b4a96761 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9675a expref: 25 pid: 6508 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.978655:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fccbd2ff200/0x9272d942b4a96761 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a9675a expref: 25 pid: 6508 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.978663:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265314.978681:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+25:3643:x1876180417489152:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265314.978686:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789265314.978695:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789265314.978700:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3643:x1876180417489280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265314.978706:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265314.978709:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fccb520ac00/0x9272d942b4a96753 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9674c expref: 24 pid: 6510 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.978718:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fccb520ac00/0x9272d942b4a96753 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a9674c expref: 24 pid: 6510 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.978732:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265314.978750:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3643:x1876180417489280:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265314.978756:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789265314.978798:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417489280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265314.978806:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417489152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265314.978828:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417489408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265314.978834:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf40d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417489024:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265314.979993:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccbd2fec00/0x9272d942b4a9676f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a96768 expref: 23 pid: 7458 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265314.980055:0:13731:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1876180417488512:0@lo:104: 00010000:00010000:0.0:1789265314.980084:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccbd2ff200/0x9272d942b4a96761 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a9675a expref: 22 pid: 6508 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265314.980094:0:13731:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1876180417488640:0@lo:104: 00010000:00010000:0.0:1789265314.980114:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccb520ac00/0x9272d942b4a96753 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a9674c expref: 21 pid: 6510 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265314.980123:0:13731:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1876180417488768:0@lo:104: 00010000:00010000:0.0:1789265314.980135:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a96745 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a9673e expref: 20 pid: 6511 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265314.980143:0:13731:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a67480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1876180417488896:0@lo:104: 00000100:00100000:2.0:1789265314.985388:0:13731:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1876180417488256:192.168.203.49@tcp:104: 00000100:00100000:2.0:1789265314.985408:0:13731:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1876180417488384:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265314.985475:0:13731:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fcb83da5e00/0x9272d942b4a968b8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265314.991372:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265314.991483:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265314.991583:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399581696 00000100:00100000:1.0:1789265314.991595:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399581696 00010000:00010000:1.0:1789265314.991650:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fccbd2ff800/0x9272d942b4a96776 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd1f expref: 13 pid: 6510 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265314.991707:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399581568 00000100:00100000:1.0:1789265314.991711:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399581568 00010000:00010000:1.0:1789265314.991724:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcb83da5c00/0x9272d942b4a9677d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd26 expref: 14 pid: 6508 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265314.991754:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 50 00000100:00100000:1.0:1789265314.991765:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f6ab780-f65a-4da8-8aa9-108982c08b32+14:2395:x1876180399581696:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265314.991784:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265314.991792:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fccbd2ff800/0x9272d942b4a96776 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd1f expref: 14 pid: 6510 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.991805:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fccbd2ff800/0x9272d942b4a96776 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd1f expref: 14 pid: 6510 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.991857:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccbd2ff800/0x9272d942b4a96776 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd1f expref: 14 pid: 6510 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.991880:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265314.991953:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2395:x1876180399581696:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 188us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265314.991961:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 50 00000100:00100000:1.0:1789265314.991989:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 51 00000100:00100000:1.0:1789265314.991997:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f6ab780-f65a-4da8-8aa9-108982c08b32+12:2395:x1876180399581568:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265314.992005:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265314.992010:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcb83da5c00/0x9272d942b4a9677d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd26 expref: 12 pid: 6508 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.992054:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcb83da5c00/0x9272d942b4a9677d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd26 expref: 12 pid: 6508 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.992909:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb83da5c00/0x9272d942b4a9677d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd26 expref: 12 pid: 6508 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.992928:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fcb83da5e00/0x9272d942b4a968b8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.992937:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83da5e00/0x9272d942b4a968b8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.992961:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fcb83da5e00/0x9272d942b4a968b8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.992987:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fcb83da5e00/0x9272d942b4a968b8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.992995:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fcb83da5e00/0x9272d942b4a968b8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.993002:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fcb83da5e00/0x9272d942b4a968b8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.993009:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5e00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265314.993014:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fcb83da5e00/0x9272d942b4a968b8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.995449:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fcb83da5e00/0x9272d942b4a968b8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.995497:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fcb83da5e00/0x9272d942b4a968b8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.995516:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265314.995618:0:13731:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fcb83da5e00/0x9272d942b4a968b8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.995628:0:13731:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fcb83da5e00/0x9272d942b4a968b8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.995635:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb83da5e00/0x9272d942b4a968b8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265314.996918:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f6ab780-f65a-4da8-8aa9-108982c08b32+11:2395:x1876180399581568:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 4906us (5419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265314.996935:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 51 00010000:00010000:3.0:1789265315.138277:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265315.141790:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265315.141894:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265315.145510:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265315.145674:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399581952 00000100:00100000:3.0:1789265315.145688:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399581952 00000100:00100000:3.0:1789265315.145780:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399582208 00000100:00100000:3.0:1789265315.145784:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399582208 00000100:00100000:3.0:1789265315.145811:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 214 00000100:00100000:3.0:1789265315.145824:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399581952:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265315.145921:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399581952:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 100us (4147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265315.145931:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 214 00000100:00100000:3.0:1789265315.145953:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 215 00000100:00100000:3.0:1789265315.145974:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2394:x1876180399582208:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265315.146017:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2394:x1876180399582208:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 44us (4125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265315.146040:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 215 00000100:00100000:2.0:1789265315.146560:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265315.146595:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265315.146618:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399582080 00000100:00100000:2.0:1789265315.146623:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399582080 00000100:00100000:2.0:1789265315.146669:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 79 00000100:00100000:2.0:1789265315.146687:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399582080:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265315.146740:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399582080:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 56us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265315.146748:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 79 00000100:00100000:3.0:1789265315.146920:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399581824 00000100:00100000:3.0:1789265315.146925:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399581824 00000100:00100000:3.0:1789265315.147014:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399582336 00000100:00100000:3.0:1789265315.147018:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399582336 00000100:00100000:3.0:1789265315.147074:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 216 00000100:00100000:3.0:1789265315.147082:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399581824:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265315.147136:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399581824:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 56us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265315.147143:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 216 00000100:00100000:3.0:1789265315.147162:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 217 00000100:00100000:3.0:1789265315.147169:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2394:x1876180399582336:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265315.147195:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2394:x1876180399582336:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 26us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265315.147201:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 217 00000100:00080000:0.0:1789265315.150577:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265315.150591:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265315.150595:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265315.340176:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417489536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265315.340278:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265315.343120:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417489536 00000100:00100000:3.0:1789265315.343142:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417489536 00000100:00100000:3.0:1789265315.343233:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789265315.343246:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417489536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789265315.343286:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265315.344816:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417489536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1561us (4526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265315.344840:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1789265315.345079:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789265315.345147:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83efea00 x1876180417489536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265315.345177:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417489536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265315.843741:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417489792:0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.843838:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265315.843879:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180417490304:0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.843902:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265315.843921:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180417490816:0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.843957:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265315.843984:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1789265315.843990:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417489664:0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.844046:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265315.844089:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417490176:0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.844120:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265315.844136:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417490688:0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.844159:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265315.844177:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417491200:0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.844200:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265315.844230:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417489920:0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.844260:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265315.844279:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417490432:0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.844302:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265315.844316:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417490944:0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.844354:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265315.844370:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789265315.844376:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417490048:0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.844398:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265315.844412:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417490560:0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.844431:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265315.844443:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417491072:0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.844465:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265315.844501:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417489792 00000100:00100000:1.0:1789265315.844515:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417489792 00000100:00100000:1.0:1789265315.844561:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417490304 00000100:00100000:1.0:1789265315.844564:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417490304 00000100:00100000:1.0:1789265315.844591:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417490816 00000100:00100000:1.0:1789265315.844594:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417490816 00000100:00100000:1.0:1789265315.844608:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417490176 00000100:00100000:1.0:1789265315.844611:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417490176 00000100:00100000:1.0:1789265315.844626:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417490432 00000100:00100000:1.0:1789265315.844628:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417490432 00000100:00100000:1.0:1789265315.844642:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417490944 00000100:00100000:1.0:1789265315.844645:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417490944 00000100:00100000:1.0:1789265315.844661:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789265315.844670:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417489792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.844731:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417489792:12345-0@lo:400:kworker.0 Request processed in 62us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265315.844740:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789265315.844758:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789265315.844764:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180417490304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.844791:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180417490304:12345-0@lo:400:kworker.0 Request processed in 28us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265315.844797:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789265315.844807:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789265315.845713:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180417490816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.846299:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180417490816:12345-0@lo:400:kworker.0 Request processed in 1480us (2335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265315.846313:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789265315.846357:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789265315.846369:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417490176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.846420:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417490176:12345-0@lo:400:kworker.0 Request processed in 56us (2299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265315.846427:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789265315.846442:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789265315.846451:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417490432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.846498:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417490432:12345-0@lo:400:kworker.0 Request processed in 49us (2195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265315.846504:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789265315.846519:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789265315.846525:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417490944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.846556:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417490944:12345-0@lo:400:kworker.0 Request processed in 31us (2202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265315.846561:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789265315.846599:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417489664 00000100:00100000:1.0:1789265315.846606:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417489664 00000100:00100000:1.0:1789265315.846648:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789265315.846656:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+20:3644:x1876180417489664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.846688:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+20:3644:x1876180417489664:12345-0@lo:400:kworker.0 Request processed in 33us (2666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265315.846695:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789265315.846734:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417490688 00000100:00100000:1.0:1789265315.846738:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417490688 00000100:00100000:1.0:1789265315.846763:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417491200 00000100:00100000:1.0:1789265315.846767:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417491200 00000100:00100000:1.0:1789265315.846782:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417490560 00000100:00100000:1.0:1789265315.846785:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417490560 00000100:00100000:1.0:1789265315.846797:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417491072 00000100:00100000:1.0:1789265315.846806:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417491072 00000100:00100000:1.0:1789265315.846823:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789265315.846829:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1876180417490688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.846862:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1876180417490688:12345-0@lo:400:kworker.0 Request processed in 34us (2702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265315.846868:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789265315.846878:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789265315.846884:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417491200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265315.847080:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417489920 00000100:00100000:2.0:1789265315.847086:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417489920 00000100:00100000:2.0:1789265315.847129:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417490048 00000100:00100000:2.0:1789265315.847133:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417490048 00000100:00100000:2.0:1789265315.847148:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789265315.847155:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417489920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265315.847215:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417489920:12345-0@lo:400:kworker.0 Request processed in 60us (2954us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265315.847222:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789265315.847238:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789265315.847244:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417490048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265315.847270:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417490048:12345-0@lo:400:kworker.0 Request processed in 27us (2871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265315.847275:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789265315.847298:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789265315.847306:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417490560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265315.847333:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417490560:12345-0@lo:400:kworker.0 Request processed in 29us (2902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265315.847339:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789265315.847352:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789265315.847357:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417491072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265315.847395:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417491072:12345-0@lo:400:kworker.0 Request processed in 38us (2929us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265315.847401:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789265315.847876:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417491200:12345-0@lo:400:kworker.0 Request processed in 989us (3672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265315.847886:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1789265315.847920:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265315.847926:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265315.847929:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265315.847932:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265315.847984:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417490048:0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.848001:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417490560:0@lo:400:kworker.0 00010000:00080000:1.0:1789265315.848018:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83f18e00 x1876180417491072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265315.848045:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417491072:0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.848072:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417489920:0@lo:400:kworker.0 00010000:00080000:1.0:1789265315.848088:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83f19c00 x1876180417490432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265315.848105:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417490432:0@lo:400:kworker.0 00010000:00080000:1.0:1789265315.848120:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83f1a680 x1876180417490944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265315.848141:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417490944:0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.848206:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417491328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265315.848252:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265315.848302:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417489664:0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.848316:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417490176:0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.848329:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417490688:0@lo:400:kworker.0 00010000:00080000:1.0:1789265315.848338:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83f18380 x1876180417491200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265315.848345:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417491200:0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.848358:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417489792:0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.848370:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180417490304:0@lo:400:kworker.0 00000100:00100000:1.0:1789265315.848382:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180417490816:0@lo:400:kworker.0 00000100:00100000:2.0:1789265315.849183:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417491328 00000100:00100000:2.0:1789265315.849197:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417491328 00000100:00100000:2.0:1789265315.849268:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789265315.849279:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417491328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265315.849304:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265315.849380:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417491328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265315.849388:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:1.0:1789265315.849641:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83efd500 x1876180417491328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265315.849665:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417491328:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1789265316.106900:0:13780:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc7f1ca6b0 20000000:00000080:3.0:1789265316.106924:0:13780:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fcb83d02000 uarg=0000000000000000 20000000:01000000:3.0:1789265316.106982:0:13780:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1789265316.106991:0:13780:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1789265316.106997:0:13780:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:0.0:1789265316.107805:0:13781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1789265316.108215:0:13780:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1789265316.108319:0:13780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1789265316.108375:0:13780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1789265316.108395:0:13780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1789265316.108413:0:13780:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789265316.108439:0:13780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fcc882b7e00/0x9272d942b4a968bf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.108458:0:13780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc882b7e00/0x9272d942b4a968bf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.108471:0:13780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fcc882b7e00/0x9272d942b4a968bf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.108479:0:13780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fcc882b7e00/0x9272d942b4a968bf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.108487:0:13780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fcc882b7e00/0x9272d942b4a968bf lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.108506:0:13780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fcc882b7e00/0x9272d942b4a968bf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.108514:0:13780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7e00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265316.108519:0:13780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fcc882b7e00/0x9272d942b4a968bf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.108528:0:13780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fcc882b7e00/0x9272d942b4a968bf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.108543:0:13780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fcc882b7e00/0x9272d942b4a968bf lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.108552:0:13780:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fcc882b7e00/0x9272d942b4a968bf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.108560:0:13780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b7e00/0x9272d942b4a968bf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.170268:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265316.300551:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265316.300842:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399582464 00000100:00100000:2.0:1789265316.300855:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399582464 00000100:00100000:2.0:1789265316.300952:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 339 00000100:00100000:2.0:1789265316.300964:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+11:6163:x1876180399582464:12345-192.168.203.49@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265316.300987:0:7458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265316.301012:0:7458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc81692a00/0x9272d942b4a968c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbd73 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265316.301109:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81692a00/0x9272d942b4a968c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd73 expref: 12 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265316.301123:0:7458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc81692a00/0x9272d942b4a968c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd73 expref: 12 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265316.301134:0:7458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81692a00, rc 0) 00000100:00100000:2.0:1789265316.301204:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+12:6163:x1876180399582464:12345-192.168.203.49@tcp:101:ll_cfg_requeue.0 Request processed in 243us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265316.301229:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 339 00000100:00100000:1.0:1789265316.329801:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265316.329848:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399582592 00000100:00100000:1.0:1789265316.329864:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399582592 00000100:00100000:1.0:1789265316.329931:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 340 00000100:00100000:1.0:1789265316.329943:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+12:6163:x1876180399582592:12345-192.168.203.49@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265316.330204:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+12:6163:x1876180399582592:12345-192.168.203.49@tcp:501:ll_cfg_requeue.0 Request processed in 262us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265316.330213:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 340 00000100:00100000:1.0:1789265316.340552:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265316.343525:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399582720 00000100:00100000:3.0:1789265316.343547:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399582720 00000100:00100000:3.0:1789265316.343635:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 341 00000100:00100000:3.0:1789265316.343647:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+12:6163:x1876180399582720:12345-192.168.203.49@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265316.343837:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+12:6163:x1876180399582720:12345-192.168.203.49@tcp:503:ll_cfg_requeue.0 Request processed in 191us (3297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265316.343846:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 341 00000100:00100000:3.0:1789265316.349732:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265316.349949:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399582848 00000100:00100000:1.0:1789265316.349963:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399582848 00000100:00100000:1.0:1789265316.350049:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 342 00000100:00100000:1.0:1789265316.350061:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+12:10784:x1876180399582848:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789265316.350268:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+12:10784:x1876180399582848:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 209us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265316.350277:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 342 00000100:00100000:1.0:1789265316.355514:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265316.356956:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399582976 00000100:00100000:0.0:1789265316.356974:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399582976 00000100:00100000:0.0:1789265316.357076:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 343 00000100:00100000:0.0:1789265316.357089:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+12:10784:x1876180399582976:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789265316.357311:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+12:10784:x1876180399582976:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 224us (1807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265316.357320:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 343 00000100:00100000:1.0:1789265316.366803:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265316.366889:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399583104 00000100:00100000:2.0:1789265316.366903:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399583104 00000100:00100000:2.0:1789265316.366973:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 344 00000100:00100000:2.0:1789265316.366986:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+12:6163:x1876180399583104:12345-192.168.203.49@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265316.367011:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265316.367078:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc81692200/0x9272d942b4a968cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbd7a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265316.367129:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81692200/0x9272d942b4a968cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd7a expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265316.367146:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc81692200/0x9272d942b4a968cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd7a expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265316.367157:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81692200, rc 0) 00000100:00100000:2.0:1789265316.368018:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:6163:x1876180399583104:12345-192.168.203.49@tcp:101:ll_cfg_requeue.0 Request processed in 1025us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265316.368052:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 344 00000100:00100000:1.0:1789265316.374511:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265316.374957:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399583232 00000100:00100000:0.0:1789265316.374971:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399583232 00000100:00100000:0.0:1789265316.375204:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 345 00000100:00100000:0.0:1789265316.375218:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:6163:x1876180399583232:12345-192.168.203.49@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265316.375428:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:6163:x1876180399583232:12345-192.168.203.49@tcp:501:ll_cfg_requeue.0 Request processed in 211us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265316.375437:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 345 00000100:00100000:1.0:1789265316.379897:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265316.379985:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399583360 00000100:00100000:2.0:1789265316.379997:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399583360 00000100:00100000:0.0:1789265316.380088:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 346 00000100:00100000:0.0:1789265316.380275:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:6163:x1876180399583360:12345-192.168.203.49@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265316.380484:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:6163:x1876180399583360:12345-192.168.203.49@tcp:503:ll_cfg_requeue.0 Request processed in 328us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265316.381896:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 346 00000100:00100000:1.0:1789265316.383673:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265316.384003:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399583488 00000100:00100000:3.0:1789265316.384161:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399583488 00000100:00100000:3.0:1789265316.384236:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 347 00000100:00100000:3.0:1789265316.384248:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:10788:x1876180399583488:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789265316.384812:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:10788:x1876180399583488:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 563us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265316.384825:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 347 00000100:00100000:1.0:1789265316.393135:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265316.393333:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399583616 00000100:00100000:2.0:1789265316.393347:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399583616 00000100:00100000:2.0:1789265316.393527:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 348 00000100:00100000:2.0:1789265316.393539:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:10788:x1876180399583616:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265316.393760:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:10788:x1876180399583616:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 222us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265316.393781:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 348 10000000:01000000:0.0:1789265316.998410:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789265316.998421:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fccbf44d000 from 7 10000000:01000000:0.0:1789265316.998429:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789265316.998513:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4800/0x9272d942b4a968d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265316.998528:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4800/0x9272d942b4a968d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265316.998542:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4800/0x9272d942b4a968d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265316.998591:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a66d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417491456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265316.998692:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265316.998748:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83b879c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265316.998884:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417491456 00000100:00100000:1.0:1789265316.998893:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417491456 00000100:00100000:1.0:1789265316.998963:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1789265316.998975:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+20:6513:x1876180417491456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265316.998991:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265316.999009:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccbd2fe600/0x9272d942b4a968db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a968d4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.999081:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2fe600/0x9272d942b4a968db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a968d4 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.999117:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccbd2fe600/0x9272d942b4a968db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a968d4 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.999129:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fe600, rc 0) 00000100:00100000:1.0:1789265316.999192:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417491456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 220us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265316.999200:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1789265316.999242:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a66d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417491456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265316.999283:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4800/0x9272d942b4a968d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a968db expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.999293:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4800/0x9272d942b4a968d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a968db expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265316.999395:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417491584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265316.999436:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265316.999467:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83e81480 going to sleep for 11 seconds 00000100:00100000:0.0:1789265317.001184:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417491584 00000100:00100000:0.0:1789265317.001205:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417491584 00000100:00100000:0.0:1789265317.001313:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789265317.001327:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417491584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265317.001550:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417491584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (2112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265317.001757:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1789265317.002224:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417491584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265317.002473:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417491712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265317.002559:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265317.002617:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83e81480 going to sleep for 11 seconds 00000100:00100000:1.0:1789265317.002683:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417491712 00000100:00100000:1.0:1789265317.002691:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417491712 00000100:00100000:1.0:1789265317.002749:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1789265317.002759:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417491712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265317.002895:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417491712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265317.002904:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1789265317.002922:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417491712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265317.004517:0:13793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e98000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:13793:1876180417491840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265317.004632:0:13793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265317.004686:0:13793:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838faf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265317.004823:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417491840 00000100:00100000:0.0:1789265317.004832:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417491840 00000100:00100000:0.0:1789265317.004894:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1789265317.004906:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+21:13793:x1876180417491840:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265317.005199:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+21:13793:x1876180417491840:12345-0@lo:502:llog_process_th.0 Request processed in 295us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265317.005209:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1789265317.005438:0:13793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e98000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:13793:1876180417491840:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789265317.005483:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265317.005497:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265317.005499:0:13793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789265317.005509:0:13793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fccbf44d000 00000020:00000080:1.0:1789265317.005512:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789265317.005670:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265317.005675:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265317.005677:0:13793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789265317.005689:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265317.005693:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265317.005694:0:13793:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789265317.005699:0:13793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fccbf44d000 00000020:00000080:1.0:1789265317.005701:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789265317.005749:0:13793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e98000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:13793:1876180417491968:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265317.005803:0:13793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265317.005855:0:13793:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838faf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265317.006193:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417491968 00000100:00100000:2.0:1789265317.006202:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417491968 00000100:00100000:2.0:1789265317.006256:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1789265317.006378:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+21:13793:x1876180417491968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265317.006515:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+21:13793:x1876180417491968:12345-0@lo:502:llog_process_th.0 Request processed in 250us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265317.006524:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1789265317.007919:0:13793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e98000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:13793:1876180417491968:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789265317.007982:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265317.007997:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265317.008000:0:13793:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789265317.008007:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789265317.011218:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789265317.011283:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265317.011301:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4800/0x9272d942b4a968d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a968db expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.011319:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4800/0x9272d942b4a968d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a968db expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265317.011334:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265317.011338:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fccbd2a9800 from 7 10000000:01000000:2.0:1789265317.011342:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265317.011399:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a968e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.011408:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a968e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.011422:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a968e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265317.011456:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417492096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265317.012175:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265317.012244:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cf9180 going to sleep for 11 seconds 00000100:00100000:1.0:1789265317.015241:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417492096 00000100:00100000:1.0:1789265317.015279:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417492096 00000100:00100000:1.0:1789265317.015370:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1789265317.015384:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+21:6513:x1876180417492096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265317.015406:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265317.015433:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccbd2fee00/0x9272d942b4a968e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a968e2 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.015475:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2fee00/0x9272d942b4a968e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a968e2 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.015490:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccbd2fee00/0x9272d942b4a968e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a968e2 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.015500:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fee00, rc 0) 00000100:00100000:1.0:1789265317.015609:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417492096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 229us (3438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265317.015627:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1789265317.021855:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417492096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265317.021894:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a968e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a968e9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.021911:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a968e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a968e9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265317.022083:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417492224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265317.022175:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265317.022225:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cf9180 going to sleep for 11 seconds 00000100:00100000:3.0:1789265317.024098:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417492224 00000100:00100000:3.0:1789265317.024116:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417492224 00000100:00100000:3.0:1789265317.024205:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1789265317.024218:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417492224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265317.024454:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417492224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (2279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265317.024477:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789265317.025785:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417492224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265317.025879:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417492352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265317.025973:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265317.026051:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cf9180 going to sleep for 11 seconds 00000100:00100000:2.0:1789265317.026073:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417492352 00000100:00100000:2.0:1789265317.026080:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417492352 00000100:00100000:2.0:1789265317.026142:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1789265317.026153:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417492352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265317.027948:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417492352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1782us (1960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265317.027967:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1789265317.028138:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417492352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265317.028824:0:13795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:13795:1876180417492480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265317.028919:0:13795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265317.028974:0:13795:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cf9600 going to sleep for 11 seconds 00000100:00100000:3.0:1789265317.029149:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417492480 00000100:00100000:3.0:1789265317.029158:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417492480 00000100:00100000:3.0:1789265317.029217:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789265317.029229:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+22:13795:x1876180417492480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265317.029399:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+22:13795:x1876180417492480:12345-0@lo:502:llog_process_th.0 Request processed in 171us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265317.029407:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1789265317.035480:0:13795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:13795:1876180417492480:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789265317.035545:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265317.035562:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265317.035565:0:13795:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789265317.035576:0:13795:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fccbd2a9800 00000020:00000080:2.0:1789265317.035580:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789265317.035654:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265317.035659:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265317.035660:0:13795:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789265317.035663:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265317.035666:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265317.035667:0:13795:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789265317.035671:0:13795:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fccbd2a9800 00000020:00000080:2.0:1789265317.035673:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789265317.035734:0:13795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:13795:1876180417492608:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265317.035846:0:13795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265317.035913:0:13795:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cf9600 going to sleep for 11 seconds 00000100:00100000:1.0:1789265317.035999:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417492608 00000100:00100000:1.0:1789265317.036008:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417492608 00000100:00100000:1.0:1789265317.036123:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789265317.036135:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+22:13795:x1876180417492608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265317.036293:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+22:13795:x1876180417492608:12345-0@lo:502:llog_process_th.0 Request processed in 160us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265317.036301:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1789265317.036543:0:13795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:13795:1876180417492608:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789265317.036572:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265317.036579:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265317.036581:0:13795:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789265317.036587:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789265317.038290:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789265317.038338:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789265317.038354:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a968e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a968e9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.038368:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a968e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a968e9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265317.038381:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789265317.038385:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fccad90a000 from 7 10000000:01000000:1.0:1789265317.038389:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789265317.038439:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff600/0x9272d942b4a968f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.038449:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff600/0x9272d942b4a968f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.038464:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff600/0x9272d942b4a968f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265317.038493:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e98000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417492736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789265317.038592:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265317.038654:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838fab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265317.038854:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417492736 00000100:00100000:2.0:1789265317.038863:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417492736 00000100:00100000:2.0:1789265317.038917:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1789265317.038928:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+22:6513:x1876180417492736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265317.038952:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265317.038968:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a968f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a968f0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.038998:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a968f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a968f0 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.039009:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a968f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a968f0 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.039019:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81693e00, rc 0) 00000100:00100000:2.0:1789265317.039111:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417492736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265317.039118:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1789265317.039415:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e98000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417492736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265317.039435:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff600/0x9272d942b4a968f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a968f7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265317.039453:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff600/0x9272d942b4a968f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a968f7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265317.039542:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417492864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265317.039581:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265317.039615:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83b87c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265317.039740:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417492864 00000100:00100000:2.0:1789265317.039745:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417492864 00000100:00100000:2.0:1789265317.039785:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1789265317.039793:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417492864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265317.039957:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417492864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265317.039965:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1789265317.040007:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417492864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265317.040109:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417492992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265317.040158:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265317.040176:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cf9480 going to sleep for 11 seconds 00000100:00100000:2.0:1789265317.040190:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417492992 00000100:00100000:2.0:1789265317.040193:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417492992 00000100:00100000:2.0:1789265317.040229:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1789265317.040235:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417492992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265317.040340:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417492992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265317.040347:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1789265317.040389:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417492992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265317.040615:0:13797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:13797:1876180417493120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265317.040654:0:13797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265317.040675:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417493120 00000100:00100000:2.0:1789265317.040679:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417493120 00000100:00100000:2.0:1789265317.040714:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1789265317.040721:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+23:13797:x1876180417493120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265317.040792:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+23:13797:x1876180417493120:12345-0@lo:502:llog_process_th.0 Request processed in 71us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265317.040799:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1789265317.040828:0:13797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cf96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265317.040841:0:13797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:13797:1876180417493120:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789265317.040866:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265317.040879:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265317.040881:0:13797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789265317.040894:0:13797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fccad90a000 00000020:00000080:2.0:1789265317.040898:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789265317.040972:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265317.040977:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265317.040979:0:13797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789265317.040983:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265317.040992:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265317.040993:0:13797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789265317.040998:0:13797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fccad90a000 00000020:00000080:2.0:1789265317.041000:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789265317.041062:0:13797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:13797:1876180417493248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265317.041110:0:13797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265317.041132:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417493248 00000100:00100000:2.0:1789265317.041136:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417493248 00000100:00100000:2.0:1789265317.041161:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1789265317.041168:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+23:13797:x1876180417493248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265317.041231:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+23:13797:x1876180417493248:12345-0@lo:502:llog_process_th.0 Request processed in 63us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265317.041238:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1789265317.041268:0:13797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cf96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265317.041281:0:13797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:13797:1876180417493248:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789265317.041298:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265317.041303:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265317.041304:0:13797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789265317.041309:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789265317.041371:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789265317.041392:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265317.041404:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff600/0x9272d942b4a968f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a968f7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.041415:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff600/0x9272d942b4a968f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a968f7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265317.041426:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265317.041435:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fcc8a583000 from 7 10000000:01000000:2.0:1789265317.041439:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265317.041468:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a968fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.041476:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a968fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.041486:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a968fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265317.041500:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417493376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265317.041530:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265317.041545:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cf96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265317.041559:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417493376 00000100:00100000:2.0:1789265317.041562:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417493376 00000100:00100000:2.0:1789265317.041588:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1789265317.041595:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+23:6513:x1876180417493376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265317.041603:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265317.041617:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc81692000/0x9272d942b4a96905 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a968fe expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.041640:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81692000/0x9272d942b4a96905 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a968fe expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.041651:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc81692000/0x9272d942b4a96905 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a968fe expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.041660:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81692000, rc 0) 00000100:00100000:2.0:1789265317.041689:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+24:6513:x1876180417493376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265317.041701:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1789265317.041736:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417493376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265317.041749:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a968fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96905 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.041758:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a968fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96905 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265317.041803:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417493504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265317.041830:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265317.041843:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cf96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265317.041853:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417493504 00000100:00100000:2.0:1789265317.041857:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417493504 00000100:00100000:2.0:1789265317.041878:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1789265317.041884:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:6513:x1876180417493504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265317.041982:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:6513:x1876180417493504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265317.041996:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1789265317.042053:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417493504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265317.042082:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417493632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265317.042133:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265317.042147:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cf96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265317.042161:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417493632 00000100:00100000:2.0:1789265317.042165:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417493632 00000100:00100000:2.0:1789265317.042187:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1789265317.042202:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+24:6513:x1876180417493632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265317.042279:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+24:6513:x1876180417493632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265317.042285:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1789265317.042328:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c287aa82-1100-4c72-b927-3b8d47a88a15:6513:1876180417493632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265317.046948:0:13798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a66300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:13798:1876180417493760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265317.047405:0:13798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265317.047508:0:13798:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83b87600 going to sleep for 11 seconds 00000100:00100000:2.0:1789265317.047576:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417493760 00000100:00100000:2.0:1789265317.047586:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417493760 00000100:00100000:2.0:1789265317.047691:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1789265317.047718:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+24:13798:x1876180417493760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265317.047891:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+24:13798:x1876180417493760:12345-0@lo:502:llog_process_th.0 Request processed in 176us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265317.047901:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1789265317.048017:0:13798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a66300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:13798:1876180417493760:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789265317.048103:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265317.048116:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265317.048119:0:13798:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789265317.048130:0:13798:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fcc8a583000 00000020:00000080:1.0:1789265317.048133:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789265317.048206:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265317.048210:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265317.048212:0:13798:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789265317.048215:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265317.048217:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265317.048219:0:13798:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789265317.048223:0:13798:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fcc8a583000 00000020:00000080:1.0:1789265317.048226:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789265317.048272:0:13798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e98a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:13798:1876180417493888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265317.048318:0:13798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265317.051312:0:13798:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838fa000 going to sleep for 11 seconds 00000100:00100000:0.0:1789265317.052288:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417493888 00000100:00100000:0.0:1789265317.052304:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417493888 00000100:00100000:0.0:1789265317.052396:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1789265317.052409:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+24:13798:x1876180417493888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265317.052629:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c287aa82-1100-4c72-b927-3b8d47a88a15+24:13798:x1876180417493888:12345-0@lo:502:llog_process_th.0 Request processed in 222us (4309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265317.052638:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1789265317.052837:0:13798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e98a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c287aa82-1100-4c72-b927-3b8d47a88a15:13798:1876180417493888:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789265317.052878:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265317.052887:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265317.052890:0:13798:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789265317.052896:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789265317.056279:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789265317.056327:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265317.056343:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a968fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96905 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.056359:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a968fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96905 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265317.059949:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789265317.084307:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789265317.188381:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789265318.084969:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789265318.147426:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789265318.209835:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265318.401462:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417494016:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265318.401565:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265318.401719:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417494016 00000100:00100000:3.0:1789265318.401730:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417494016 00000100:00100000:3.0:1789265318.401802:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789265318.401813:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417494016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789265318.401856:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789265318.401919:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417494016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265318.401927:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789265318.401983:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417494016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265318.402557:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417494144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265318.402612:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265318.402701:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417494144 00000100:00100000:1.0:1789265318.402707:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417494144 00000100:00100000:1.0:1789265318.402754:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789265318.402763:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417494144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265318.402792:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789265318.402847:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417494144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265318.402855:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789265318.403237:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417494144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265318.913903:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417494272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265318.914000:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265318.914252:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417494272 00000100:00100000:2.0:1789265318.914263:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417494272 00000100:00100000:2.0:1789265318.914345:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789265318.914358:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1876180417494272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265318.914397:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265318.914459:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1876180417494272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265318.914485:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789265318.914570:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417494272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265318.914602:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265318.914610:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417494400:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265318.914642:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265318.914752:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417494400 00000100:00100000:3.0:1789265318.914757:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417494400 00000100:00100000:3.0:1789265318.914796:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789265318.914804:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417494400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789265318.914817:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265318.914855:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417494400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265318.914874:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1789265318.915378:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265318.915479:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417494400:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789265319.235557:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265320.257488:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265320.271711:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265320.271774:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265320.271811:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265320.271850:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265320.271874:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265320.271900:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265320.271942:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399584000 00000100:00100000:1.0:1789265320.271955:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399584000 00000100:00100000:3.0:1789265320.272011:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399584256 00000100:00100000:3.0:1789265320.272073:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399584256 00000100:00100000:1.0:1789265320.272089:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399583872 00000100:00100000:1.0:1789265320.272096:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399583872 00000100:00100000:1.0:1789265320.272126:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399584384 00000100:00100000:1.0:1789265320.272130:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399584384 00000100:00100000:3.0:1789265320.272138:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 224 00000100:00100000:3.0:1789265320.272156:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399584000:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265320.272164:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 225 00000100:00100000:1.0:1789265320.272179:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2394:x1876180399584256:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265320.272256:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399584000:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 105us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265320.272264:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 224 00000100:00100000:3.0:1789265320.272291:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 226 00000100:00100000:3.0:1789265320.272301:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399583872:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265320.272318:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 227 00000100:00100000:2.0:1789265320.272331:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2394:x1876180399584384:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265320.272427:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399583744 00000100:00100000:0.0:1789265320.272433:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399583744 00000100:00100000:0.0:1789265320.272471:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 369 00000100:00100000:0.0:1789265320.272479:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2394:x1876180399583744:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265320.276139:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399583872:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 3827us (4274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265320.276154:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 226 00000100:00100000:3.0:1789265320.276250:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399584128 00000100:00100000:3.0:1789265320.276260:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399584128 00000100:00100000:3.0:1789265320.276321:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 84 00000100:00100000:3.0:1789265320.276330:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399584128:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265320.276396:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399584128:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 68us (4522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265320.276403:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 84 00000100:00080000:3.0:1789265320.276446:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789265320.276451:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265320.276454:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265320.278395:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2394:x1876180399584256:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 3312us (3674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265320.278415:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 225 00000100:00100000:2.0:1789265320.279606:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2394:x1876180399584384:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 7267us (7693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265320.279620:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 227 00000100:00100000:0.0:1789265320.280284:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2394:x1876180399583744:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 7797us (8581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265320.280297:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 369 00000100:00100000:0.0:1789265320.452402:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265320.452438:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417494528:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265320.452531:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265320.452701:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417494528 00000100:00100000:2.0:1789265320.452712:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417494528 00000100:00100000:2.0:1789265320.452910:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789265320.452922:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417494528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789265320.452962:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265320.453015:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417494528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265320.453059:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1789265320.453693:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789265320.453747:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83efed80 x1876180417494528/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265320.453772:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417494528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265320.961957:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417494912:0@lo:400:kworker.0 00000100:00100000:1.0:1789265320.962093:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265320.962182:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417494656:0@lo:400:kworker.0 00000100:00100000:1.0:1789265320.962189:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417495424:0@lo:400:kworker.0 00000100:00100000:1.0:1789265320.962225:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265320.962354:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417494784:0@lo:400:kworker.0 00000100:00100000:0.0:1789265320.962710:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417494912 00000100:00100000:0.0:1789265320.962721:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417494912 00000100:00100000:0.0:1789265320.962789:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789265320.962801:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417494912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265320.963490:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180417495936:0@lo:400:kworker.0 00000100:00100000:1.0:1789265320.963539:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265320.963623:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417495040:0@lo:400:kworker.0 00000100:00100000:1.0:1789265320.963652:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265320.963672:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417495552:0@lo:400:kworker.0 00000100:00100000:1.0:1789265320.963695:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265320.963712:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417496064:0@lo:400:kworker.0 00000100:00100000:1.0:1789265320.963733:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265320.963765:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417495552 00000100:00100000:1.0:1789265320.963770:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417495552 00000100:00100000:1.0:1789265320.963820:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417496064 00000100:00100000:1.0:1789265320.963823:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417496064 00000100:00100000:1.0:1789265320.963844:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789265320.963852:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417495552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265320.963897:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417495552:12345-0@lo:400:kworker.0 Request processed in 45us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265320.963905:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789265320.963923:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789265320.963929:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417496064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265320.963956:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417496064:12345-0@lo:400:kworker.0 Request processed in 27us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265320.963962:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789265320.964005:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417495552:0@lo:400:kworker.0 00010000:00080000:1.0:1789265320.964076:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83f18a80 x1876180417496064/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265320.964088:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417496064:0@lo:400:kworker.0 00000100:00100000:1.0:1789265320.964123:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417495424 00000100:00100000:1.0:1789265320.964128:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417495424 00000100:00100000:1.0:1789265320.964164:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417495936 00000100:00100000:1.0:1789265320.964168:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417495936 00000100:00100000:1.0:1789265320.964186:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789265320.964193:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417495424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265320.964231:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417495424:12345-0@lo:400:kworker.0 Request processed in 38us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265320.964238:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789265320.964248:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789265320.964254:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180417495936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265320.964281:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180417495936:12345-0@lo:400:kworker.0 Request processed in 27us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265320.964287:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00010000:00080000:1.0:1789265320.964320:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83e98000 x1876180417495424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265320.964331:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417495424:0@lo:400:kworker.0 00010000:00080000:1.0:1789265320.964342:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83f18380 x1876180417495936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265320.964350:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180417495936:0@lo:400:kworker.0 00000100:00080000:1.0:1789265320.964757:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265320.964776:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265320.965764:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417495040 00000100:00100000:1.0:1789265320.965780:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417495040 00000100:00100000:1.0:1789265320.965828:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789265320.965838:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417495040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265320.965967:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417495040:12345-0@lo:400:kworker.0 Request processed in 130us (2313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265320.965991:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789265320.966123:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417495040:0@lo:400:kworker.0 00000100:00100000:3.0:1789265320.970183:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265320.970183:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265320.970230:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417494656 00000100:00100000:1.0:1789265320.970240:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417494656 00000100:00100000:3.0:1789265320.970245:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417495168:0@lo:400:kworker.0 00000100:00100000:2.0:1789265320.970281:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417495296:0@lo:400:kworker.0 00000100:00100000:1.0:1789265320.970307:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1789265320.970319:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417494656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265320.970349:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265320.970380:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417494656:12345-0@lo:400:kworker.0 Request processed in 64us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265320.970389:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1789265320.970395:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417494784 00000100:00100000:2.0:1789265320.970401:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417494784 00000100:00100000:2.0:1789265320.970434:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417495296 00000100:00100000:2.0:1789265320.970438:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417495296 00000100:00100000:3.0:1789265320.970989:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265320.972139:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417495168 00000100:00100000:3.0:1789265320.972149:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417495168 00000100:00100000:3.0:1789265320.972197:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789265320.972208:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417494784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265320.972274:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417494784:12345-0@lo:400:kworker.0 Request processed in 67us (2099us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265320.972283:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789265320.972304:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789265320.972316:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417495296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265320.972357:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789265320.972361:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417494912:12345-0@lo:400:kworker.0 Request processed in 9549us (10255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265320.972375:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417495168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265320.972386:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789265320.972433:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417495168:12345-0@lo:400:kworker.0 Request processed in 65us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265320.972441:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789265320.972541:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417494912:0@lo:400:kworker.0 00000100:00080000:1.0:1789265320.972598:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265320.972631:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417495808:0@lo:400:kworker.0 00000001:00080000:0.0:1789265320.974763:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1789265320.976543:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265320.976555:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417495296:12345-0@lo:400:kworker.0 Request processed in 4240us (6203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265320.976568:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789265320.976597:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417496320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265320.976606:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417495808 00000100:00100000:3.0:1789265320.976614:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417495808 00000100:00100000:1.0:1789265320.976664:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265320.976682:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789265320.976693:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417495808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265320.976728:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417494784:0@lo:400:kworker.0 00000100:00100000:3.0:1789265320.976752:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417495808:12345-0@lo:400:kworker.0 Request processed in 58us (214us total) trans 0 rc 0/0 00000100:00080000:0.0:1789265320.976755:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265320.976763:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789265320.976814:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417496320 00000100:00100000:1.0:1789265320.976824:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417495296:0@lo:400:kworker.0 00000100:00100000:0.0:1789265320.976830:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417496320 00000100:00100000:1.0:1789265320.976845:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417495808:0@lo:400:kworker.0 00000100:00100000:0.0:1789265320.976936:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789265320.976947:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417496320:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265320.977204:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417495168:0@lo:400:kworker.0 00000100:00100000:2.0:1789265320.977219:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417495680:0@lo:400:kworker.0 00000100:00100000:2.0:1789265320.977267:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265320.977296:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417496192:0@lo:400:kworker.0 00000100:00100000:2.0:1789265320.977334:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265320.977359:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417495680 00000100:00100000:2.0:1789265320.977363:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417495680 00000100:00100000:2.0:1789265320.977395:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417496192 00000100:00100000:2.0:1789265320.977399:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417496192 00000100:00100000:2.0:1789265320.977418:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789265320.977425:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417495680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265320.977462:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417495680:12345-0@lo:400:kworker.0 Request processed in 37us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265320.977469:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789265320.977484:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789265320.977492:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180417496192:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789265320.977498:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789265320.977504:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789265320.977546:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83f1b800 x1876180417496192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265320.977573:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417496192:0@lo:400:kworker.0 00002000:00000024:0.0:1789265320.977719:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265320.978102:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180417496192:12345-0@lo:400:kworker.0 Request processed in 607us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265320.978111:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789265320.978242:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417494656:0@lo:400:kworker.0 00000100:00100000:3.0:1789265320.978260:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1789265320.978265:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fccbf40f800, transno 4294967301 00000100:00100000:3.0:1789265320.978273:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417495680:0@lo:400:kworker.0 00000100:00100000:0.0:1789265320.978797:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417496320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1845us (2127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265320.978811:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:1.0:1789265320.979011:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83efdc00 x1876180417496320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265320.979074:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417496320:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789265321.281289:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265322.307708:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265323.329328:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265323.521611:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417496448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265323.521689:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265323.521815:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417496448 00000100:00100000:2.0:1789265323.521823:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417496448 00000100:00100000:2.0:1789265323.521878:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789265323.521889:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417496448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789265323.521952:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789265323.522008:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417496448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265323.522015:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789265323.522113:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417496448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265323.523805:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417496576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265323.523876:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265323.524299:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417496576 00000100:00100000:0.0:1789265323.524308:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417496576 00000100:00100000:0.0:1789265323.524490:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789265323.524499:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417496576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789265323.524533:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789265323.524592:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417496576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265323.524599:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789265323.524740:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417496576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265324.033324:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417496704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265324.033407:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265324.033645:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417496704 00000100:00100000:1.0:1789265324.033654:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417496704 00000100:00100000:1.0:1789265324.033720:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789265324.033730:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417496704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265324.033759:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789265324.033827:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265324.034279:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265324.034291:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417496832:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265324.034325:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265324.034380:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417496832 00000100:00100000:3.0:1789265324.034384:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417496832 00000100:00100000:3.0:1789265324.034417:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789265324.034423:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417496832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789265324.034434:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265324.034467:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417496832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265324.034473:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1789265324.034509:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265324.034542:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417496832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265324.036827:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417496704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3088us (3410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265324.036843:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789265324.042408:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417496704:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789265324.354645:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265325.377395:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265325.382692:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265325.382737:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265325.382765:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265325.382824:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265325.382848:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265325.382915:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265325.382998:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399584640 00000100:00100000:2.0:1789265325.383008:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399584640 00000100:00100000:2.0:1789265325.383118:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399585152 00000100:00100000:2.0:1789265325.383122:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399585152 00000100:00100000:2.0:1789265325.383137:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399584768 00000100:00100000:2.0:1789265325.383139:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399584768 00000100:00100000:2.0:1789265325.383152:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399585024 00000100:00100000:2.0:1789265325.383154:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399585024 00000100:00100000:2.0:1789265325.383172:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 234 00000100:00100000:2.0:1789265325.383182:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399584640:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265325.383255:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399584640:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 74us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265325.383263:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 234 00000100:00100000:2.0:1789265325.383281:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 235 00000100:00100000:2.0:1789265325.383288:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2395:x1876180399585152:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265325.383314:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2395:x1876180399585152:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 26us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265325.383320:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 235 00000100:00100000:2.0:1789265325.383332:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 236 00000100:00100000:2.0:1789265325.383337:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399584768:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265325.383373:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399584768:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 35us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265325.383380:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 236 00000100:00100000:2.0:1789265325.383395:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 237 00000100:00100000:2.0:1789265325.383401:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2395:x1876180399585024:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265325.383423:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2395:x1876180399585024:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 23us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265325.383429:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 237 00000100:00100000:3.0:1789265325.383496:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399584896 00000100:00100000:3.0:1789265325.383501:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399584896 00000100:00100000:3.0:1789265325.383545:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 89 00000100:00100000:3.0:1789265325.383559:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399584896:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265325.383588:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399584896:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 31us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265325.383593:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 89 00000100:00100000:3.0:1789265325.383613:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399584512 00000100:00100000:3.0:1789265325.383616:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399584512 00000100:00100000:3.0:1789265325.383640:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 371 00000100:00100000:3.0:1789265325.383645:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2395:x1876180399584512:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265325.383722:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2395:x1876180399584512:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 22us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265325.383729:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 371 00000100:00080000:1.0:1789265325.384064:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265325.384069:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265325.384072:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265325.569932:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417496960:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265325.570006:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265325.570430:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417496960 00000100:00100000:0.0:1789265325.570439:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417496960 00000100:00100000:0.0:1789265325.570507:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789265325.570517:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417496960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789265325.570546:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265325.570608:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417496960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265325.570615:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:0.0:1789265325.570661:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83efe300 x1876180417496960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265325.570711:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417496960:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789265325.572838:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265326.081347:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265326.081369:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417497088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265326.081434:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265326.081537:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417497088 00000100:00100000:1.0:1789265326.081545:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417497088 00000100:00100000:1.0:1789265326.081600:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789265326.081609:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417497088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265326.081627:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265326.081666:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417497088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265326.081673:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:0.0:1789265326.081724:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789265326.081752:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83e98700 x1876180417497088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265326.081769:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417497088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265326.082590:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417497344:0@lo:400:kworker.0 00000100:00100000:2.0:1789265326.082640:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265326.082663:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417497856:0@lo:400:kworker.0 00000100:00100000:2.0:1789265326.082682:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265326.082706:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417498368:0@lo:400:kworker.0 00000100:00100000:2.0:1789265326.082727:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265326.082751:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789265326.082757:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417497472:0@lo:400:kworker.0 00000100:00100000:2.0:1789265326.082779:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265326.082800:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417497984:0@lo:400:kworker.0 00000100:00100000:2.0:1789265326.082816:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265326.082829:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417498496:0@lo:400:kworker.0 00000100:00100000:2.0:1789265326.082846:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265326.082871:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417497344 00000100:00100000:2.0:1789265326.082875:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417497344 00000100:00100000:2.0:1789265326.082900:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417497856 00000100:00100000:2.0:1789265326.082914:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417497856 00000100:00100000:2.0:1789265326.082934:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417498368 00000100:00100000:2.0:1789265326.082936:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417498368 00000100:00100000:2.0:1789265326.082946:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417497984 00000100:00100000:2.0:1789265326.082948:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417497984 00000100:00100000:2.0:1789265326.082958:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417498496 00000100:00100000:2.0:1789265326.082961:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417498496 00000100:00100000:2.0:1789265326.082974:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789265326.082981:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417497344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265326.083227:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417497216:0@lo:400:kworker.0 00000100:00100000:0.0:1789265326.083261:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265326.083286:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417497728:0@lo:400:kworker.0 00000100:00100000:0.0:1789265326.083309:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265326.083320:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417498240:0@lo:400:kworker.0 00000100:00100000:0.0:1789265326.083339:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265326.083356:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789265326.083361:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417497600:0@lo:400:kworker.0 00000100:00100000:0.0:1789265326.083382:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265326.083399:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417498112:0@lo:400:kworker.0 00000100:00100000:0.0:1789265326.083417:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265326.083433:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417498624:0@lo:400:kworker.0 00000100:00100000:0.0:1789265326.083454:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265326.083478:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417497472 00000100:00100000:0.0:1789265326.083482:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417497472 00000100:00100000:0.0:1789265326.083512:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417497600 00000100:00100000:0.0:1789265326.083514:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417497600 00000100:00100000:0.0:1789265326.083526:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789265326.083531:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417497472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265326.083566:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417497472:12345-0@lo:400:kworker.0 Request processed in 34us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265326.083572:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789265326.083585:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789265326.083590:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417497600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265326.083614:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417497600:12345-0@lo:400:kworker.0 Request processed in 23us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265326.083619:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789265326.083648:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417498240 00000100:00100000:0.0:1789265326.083651:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417498240 00000100:00100000:0.0:1789265326.083671:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417498112 00000100:00100000:0.0:1789265326.083674:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417498112 00000100:00100000:0.0:1789265326.083683:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417498624 00000100:00100000:0.0:1789265326.083685:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417498624 00000100:00100000:0.0:1789265326.083696:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789265326.083702:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417498240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265326.083729:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417498240:12345-0@lo:400:kworker.0 Request processed in 27us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265326.083735:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789265326.083745:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789265326.083750:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417498112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265326.083772:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417498112:12345-0@lo:400:kworker.0 Request processed in 22us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265326.083786:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789265326.083795:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789265326.083800:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417498624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265326.083821:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417498624:12345-0@lo:400:kworker.0 Request processed in 22us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265326.083826:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789265326.083859:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417497472:0@lo:400:kworker.0 00000100:00100000:0.0:1789265326.083884:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417497600:0@lo:400:kworker.0 00000100:00100000:0.0:1789265326.083892:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417498112:0@lo:400:kworker.0 00010000:00080000:0.0:1789265326.083901:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc837e0700 x1876180417498624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265326.083911:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417498624:0@lo:400:kworker.0 00000100:00100000:0.0:1789265326.083919:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417498240:0@lo:400:kworker.0 00000100:00100000:0.0:1789265326.083959:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417497728 00000100:00100000:0.0:1789265326.083962:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417497728 00000100:00100000:0.0:1789265326.083979:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789265326.083984:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417497856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265326.084056:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417497856:12345-0@lo:400:kworker.0 Request processed in 71us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265326.084062:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789265326.084075:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789265326.084081:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417498368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265326.084108:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417498368:12345-0@lo:400:kworker.0 Request processed in 28us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265326.084119:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789265326.084132:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789265326.084138:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417497984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265326.084167:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417497984:12345-0@lo:400:kworker.0 Request processed in 29us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265326.084173:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789265326.084184:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789265326.084190:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417498496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265326.084216:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417498496:12345-0@lo:400:kworker.0 Request processed in 26us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265326.084221:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789265326.084233:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789265326.084239:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417497728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265326.084271:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417497728:12345-0@lo:400:kworker.0 Request processed in 32us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265326.084277:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00010000:00080000:0.0:1789265326.084307:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83efd500 x1876180417497984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265326.084316:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417497984:0@lo:400:kworker.0 00010000:00080000:0.0:1789265326.084326:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc837e1f80 x1876180417498496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265326.084334:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417498496:0@lo:400:kworker.0 00000100:00100000:0.0:1789265326.084344:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417497856:0@lo:400:kworker.0 00000100:00100000:0.0:1789265326.084363:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417498368:0@lo:400:kworker.0 00000100:00100000:0.0:1789265326.084391:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417497728:0@lo:400:kworker.0 00000100:00080000:0.0:1789265326.084432:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265326.084437:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789265326.084440:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265326.084456:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417497216 00000100:00100000:0.0:1789265326.084460:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417497216 00000100:00100000:0.0:1789265326.084488:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1789265326.084494:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8ad99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417497216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265326.084528:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8ad99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417497216:12345-0@lo:400:kworker.0 Request processed in 34us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265326.084533:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1789265326.084564:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417497216:0@lo:400:kworker.0 00000100:00100000:2.0:1789265326.086152:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417497344:12345-0@lo:400:kworker.0 Request processed in 3163us (3503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265326.086165:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789265326.097224:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417497344:0@lo:400:kworker.0 00010000:00010000:2.0:1789265326.401453:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265327.427540:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789265328.321767:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789265328.385739:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789265328.449232:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265328.641512:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789265328.641539:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417498752:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265328.641607:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265328.641828:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417498752 00000100:00100000:0.0:1789265328.641837:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417498752 00000100:00100000:0.0:1789265328.641893:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789265328.641904:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417498752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789265328.641942:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789265328.642001:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417498752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265328.642017:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789265328.642302:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265328.642314:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417498880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265328.642348:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265328.642485:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417498880 00000100:00100000:0.0:1789265328.642490:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417498880 00000100:00100000:0.0:1789265328.642526:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789265328.642533:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417498880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789265328.642568:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789265328.642618:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417498880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265328.642624:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789265328.642828:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417498880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265328.643503:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417498752:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265329.153325:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417499008:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265329.153409:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265329.154567:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417499008 00000100:00100000:0.0:1789265329.154577:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417499008 00000100:00100000:0.0:1789265329.154645:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789265329.154656:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417499008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789265329.154685:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1789265329.154706:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265329.154758:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417499008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (1349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265329.154766:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789265329.155173:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417499008:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265329.163334:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417499136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265329.163423:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265329.163569:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417499136 00000100:00100000:3.0:1789265329.163578:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417499136 00000100:00100000:3.0:1789265329.163647:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789265329.163657:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417499136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265329.163690:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265329.163795:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417499136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265329.163804:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789265329.163853:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417499136:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789265329.163857:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789265329.473250:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265330.497232:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265330.507365:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265330.507495:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265330.509244:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399585408 00000100:00100000:2.0:1789265330.509258:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399585408 00000100:00100000:2.0:1789265330.509687:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 244 00000100:00100000:2.0:1789265330.509701:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399585408:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265330.509787:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399585408:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 91us (2292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265330.509808:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 244 00000100:00100000:0.0:1789265330.510214:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399585280 00000100:00100000:0.0:1789265330.510221:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399585280 00000100:00100000:0.0:1789265330.510263:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 373 00000100:00100000:0.0:1789265330.510617:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8ad98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2394:x1876180399585280:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265330.510663:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8ad98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2394:x1876180399585280:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 393us (3309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265330.510670:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 373 00000100:00080000:1.0:1789265330.511683:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265330.514686:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265330.514849:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399585536 00000100:00100000:0.0:1789265330.514859:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399585536 00000100:00100000:0.0:1789265330.514939:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 245 00000100:00100000:0.0:1789265330.514952:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399585536:12345-192.168.203.49@tcp:400:kworker.0 00000100:00080000:1.0:1789265330.515071:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265330.515249:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399585536:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 300us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265330.515257:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 245 00000100:00100000:0.0:1789265330.535254:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265330.535315:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265330.535408:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399585664 00000100:00100000:2.0:1789265330.535417:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399585664 00000100:00100000:2.0:1789265330.535491:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 27 00000100:00100000:2.0:1789265330.535501:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2392:x1876180399585664:12345-192.168.203.49@tcp:9:kworker.0 00000020:00000080:2.0:1789265330.535531:0:8435:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a9682c 00000100:00080000:2.0:1789265330.535549:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9fccbf4ee800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789265330.535597:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1789265330.535745:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+2:2392:x1876180399585664:12345-192.168.203.49@tcp:9:kworker.0 Request processed in 245us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265330.535754:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 27 00010000:00010000:2.0:1789265330.535779:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265330.538363:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00080000:1.0:1789265330.538425:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265330.540518:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399585792 00000100:00100000:3.0:1789265330.540532:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399585792 00000100:00080000:1.0:1789265330.540660:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265330.540748:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399585920 00000100:00100000:3.0:1789265330.540752:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399585920 00000100:00080000:1.0:1789265330.540810:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789265330.540855:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 246 00000100:00100000:2.0:1789265330.540867:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399585792:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265330.540979:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399585792:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 114us (5662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265330.540987:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 246 00000100:00100000:2.0:1789265330.541015:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 247 00000100:00100000:2.0:1789265330.541044:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399585920:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265330.541071:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399585920:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 50us (2717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265330.541078:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 247 00000100:00100000:1.0:1789265330.691844:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265330.691868:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417499264:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265330.691933:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265330.692140:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417499264 00000100:00100000:0.0:1789265330.692148:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417499264 00000100:00100000:0.0:1789265330.692207:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789265330.692216:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417499264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789265330.692244:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265330.692286:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417499264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265330.692292:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:1.0:1789265330.692367:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83e2f100 x1876180417499264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265330.692407:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417499264:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789265330.692430:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265331.201490:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417499520:0@lo:400:kworker.0 00000100:00100000:3.0:1789265331.201631:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417499392:0@lo:400:kworker.0 00000100:00100000:3.0:1789265331.201692:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265331.201758:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417499904:0@lo:400:kworker.0 00000100:00100000:3.0:1789265331.201784:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265331.201800:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417500416:0@lo:400:kworker.0 00000100:00100000:3.0:1789265331.201822:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265331.201838:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417500928:0@lo:400:kworker.0 00000100:00100000:3.0:1789265331.201858:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265331.201897:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417500416 00000100:00100000:3.0:1789265331.201905:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417500416 00000100:00100000:3.0:1789265331.201953:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417500928 00000100:00100000:3.0:1789265331.201956:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417500928 00000100:00100000:3.0:1789265331.201977:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789265331.201985:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417500416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265331.202074:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417500416:12345-0@lo:400:kworker.0 Request processed in 89us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265331.202097:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789265331.202125:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789265331.202132:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417500928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265331.202161:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417500928:12345-0@lo:400:kworker.0 Request processed in 30us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265331.202168:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789265331.202190:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417499776:0@lo:400:kworker.0 00000100:00100000:3.0:1789265331.202216:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265331.202235:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417500288:0@lo:400:kworker.0 00000100:00100000:3.0:1789265331.202253:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265331.202267:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417500800:0@lo:400:kworker.0 00000100:00100000:3.0:1789265331.202288:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265331.202304:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789265331.202310:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417499648:0@lo:400:kworker.0 00000100:00100000:3.0:1789265331.202330:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265331.202348:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417500160:0@lo:400:kworker.0 00000100:00100000:3.0:1789265331.202370:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265331.202387:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417500672:0@lo:400:kworker.0 00000100:00100000:3.0:1789265331.202407:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265331.202435:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417499776 00000100:00100000:3.0:1789265331.202438:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417499776 00000100:00100000:3.0:1789265331.202461:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417499648 00000100:00100000:3.0:1789265331.202464:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417499648 00000100:00100000:3.0:1789265331.202477:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789265331.202482:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417499776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265331.202803:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417499776:12345-0@lo:400:kworker.0 Request processed in 44us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265331.202811:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789265331.202826:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789265331.202833:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417499648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265331.202867:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417499648:12345-0@lo:400:kworker.0 Request processed in 35us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265331.202873:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789265331.202891:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417500288 00000100:00100000:3.0:1789265331.202895:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417500288 00000100:00100000:3.0:1789265331.202911:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417500800 00000100:00100000:3.0:1789265331.202914:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417500800 00000100:00100000:3.0:1789265331.202926:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789265331.202932:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417500288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265331.202961:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417500288:12345-0@lo:400:kworker.0 Request processed in 29us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265331.202966:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789265331.202976:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789265331.202982:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417500800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265331.203019:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417500800:12345-0@lo:400:kworker.0 Request processed in 38us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265331.203047:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789265331.203086:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417500416:0@lo:400:kworker.0 00010000:00080000:3.0:1789265331.203100:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4f3100 x1876180417500928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265331.203270:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417499392 00000100:00100000:1.0:1789265331.203275:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417499392 00000100:00100000:1.0:1789265331.203305:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1789265331.203312:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8ad99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3643:x1876180417499392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265331.203346:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8ad99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3643:x1876180417499392:12345-0@lo:400:kworker.0 Request processed in 35us (1655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265331.203353:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1789265331.203404:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417499904 00000100:00100000:1.0:1789265331.203408:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417499904 00000100:00100000:1.0:1789265331.203431:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417500160 00000100:00100000:1.0:1789265331.203434:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417500160 00000100:00100000:1.0:1789265331.203450:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417500672 00000100:00100000:1.0:1789265331.203452:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417500672 00000100:00100000:1.0:1789265331.203466:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789265331.203472:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417499904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265331.203502:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417499904:12345-0@lo:400:kworker.0 Request processed in 29us (1716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265331.203508:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789265331.203519:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789265331.203539:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417500160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265331.203565:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417500160:12345-0@lo:400:kworker.0 Request processed in 40us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265331.203571:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789265331.203583:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789265331.203599:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876180417500672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265331.203626:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876180417500672:12345-0@lo:400:kworker.0 Request processed in 28us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265331.203632:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00080000:1.0:1789265331.203668:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265331.203673:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265331.203675:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265331.203973:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417499648:0@lo:400:kworker.0 00010000:00080000:2.0:1789265331.203988:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83efea00 x1876180417500160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265331.204017:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417500160:0@lo:400:kworker.0 00010000:00080000:2.0:1789265331.204064:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4f0700 x1876180417500672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265331.204074:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417500672:0@lo:400:kworker.0 00000100:00100000:2.0:1789265331.204087:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417499776:0@lo:400:kworker.0 00000100:00100000:2.0:1789265331.204097:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417500288:0@lo:400:kworker.0 00010000:00080000:2.0:1789265331.204108:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf4f1880 x1876180417500800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265331.204127:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417500800:0@lo:400:kworker.0 00000100:00100000:3.0:1789265331.204270:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417500928:0@lo:400:kworker.0 00000100:00100000:3.0:1789265331.204290:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265331.204302:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417501056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265331.204338:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265331.204381:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417499392:0@lo:400:kworker.0 00000100:00100000:3.0:1789265331.204391:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417499904:0@lo:400:kworker.0 00000100:00100000:0.0:1789265331.204779:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265331.204801:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180417500032:0@lo:400:kworker.0 00000100:00100000:0.0:1789265331.204826:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265331.204852:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180417500544:0@lo:400:kworker.0 00000100:00100000:0.0:1789265331.204874:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265331.204910:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417499520 00000100:00100000:0.0:1789265331.204915:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417499520 00000100:00100000:0.0:1789265331.204947:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417500032 00000100:00100000:0.0:1789265331.204950:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417500032 00000100:00100000:0.0:1789265331.204971:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417500544 00000100:00100000:0.0:1789265331.204974:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417500544 00000100:00100000:0.0:1789265331.205000:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789265331.205008:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417499520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265331.205066:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417499520:12345-0@lo:400:kworker.0 Request processed in 58us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265331.205084:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789265331.205101:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789265331.205107:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180417500032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265331.205150:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180417500032:12345-0@lo:400:kworker.0 Request processed in 43us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265331.205156:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789265331.205167:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789265331.205172:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180417500544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265331.205197:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180417500544:12345-0@lo:400:kworker.0 Request processed in 25us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265331.205203:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00080000:0.0:1789265331.205218:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265331.205241:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417499520:0@lo:400:kworker.0 00000100:00100000:0.0:1789265331.205249:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180417500032:0@lo:400:kworker.0 00000100:00100000:0.0:1789265331.205257:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180417500544:0@lo:400:kworker.0 00000100:00100000:2.0:1789265331.205437:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417501056 00000100:00100000:2.0:1789265331.205441:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417501056 00000100:00100000:2.0:1789265331.205479:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789265331.205486:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417501056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265331.205503:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265331.205556:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417501056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265331.205563:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:3.0:1789265331.205801:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83e9ad80 x1876180417501056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265331.205819:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417501056:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789265331.522741:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265332.545375:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265333.569666:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265333.763004:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417501184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265333.763104:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265333.763419:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417501184 00000100:00100000:2.0:1789265333.763427:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417501184 00000100:00100000:2.0:1789265333.763479:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789265333.763489:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417501184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789265333.763522:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789265333.763598:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417501184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265333.763622:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789265333.763716:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417501184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265333.764508:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417501312:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265333.764552:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265333.765300:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417501312 00000100:00100000:1.0:1789265333.765308:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417501312 00000100:00100000:1.0:1789265333.765364:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789265333.765374:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417501312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789265333.765403:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789265333.767998:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417501312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2566us (3386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265333.768012:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789265333.771921:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417501312:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265334.273321:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265334.275634:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf54dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417501568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265334.275713:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265334.275858:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf54c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417501440:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265334.275894:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265334.292498:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417501568 00000100:00100000:2.0:1789265334.292516:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417501568 00000100:00080000:0.0:1789265334.292602:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265334.292604:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417501440 00000100:00100000:2.0:1789265334.292609:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417501440 00000100:00080000:0.0:1789265334.292627:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265334.292643:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789265334.292653:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417501568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265334.292696:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265334.292719:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789265334.292731:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417501440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789265334.292745:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265334.292852:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417501440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (16956us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265334.292861:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789265334.292884:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417501568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 230us (17167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265334.292892:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789265334.292999:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf54dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417501568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265334.293017:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf54c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417501440:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789265334.593528:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265335.617301:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265335.623798:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265335.623849:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265335.623882:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265335.623910:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265335.623937:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265335.623976:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399586304 00000100:00100000:2.0:1789265335.623985:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399586304 00000100:00100000:3.0:1789265335.624111:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399586560 00000100:00100000:3.0:1789265335.624115:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399586560 00000100:00100000:3.0:1789265335.624147:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399586176 00000100:00100000:3.0:1789265335.624150:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399586176 00000100:00100000:3.0:1789265335.624160:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399586432 00000100:00100000:3.0:1789265335.624163:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399586432 00000100:00100000:3.0:1789265335.624178:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 254 00000100:00100000:3.0:1789265335.624186:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2396:x1876180399586560:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265335.624254:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2396:x1876180399586560:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 68us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265335.624280:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 254 00000100:00100000:3.0:1789265335.624296:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 255 00000100:00100000:3.0:1789265335.624302:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399586176:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265335.624327:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399586176:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 24us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265335.624332:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 255 00000100:00100000:3.0:1789265335.624342:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 256 00000100:00100000:3.0:1789265335.624347:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2396:x1876180399586432:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265335.624365:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2396:x1876180399586432:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 18us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265335.624371:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 256 00000100:00080000:3.0:1789265335.624492:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265335.624497:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789265335.624635:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 257 00000100:00100000:2.0:1789265335.624646:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399586304:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265335.624686:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399586304:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 43us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265335.624692:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 257 00000100:00100000:0.0:1789265335.624934:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399586048 00000100:00100000:0.0:1789265335.624939:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399586048 00000100:00100000:0.0:1789265335.624989:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 375 00000100:00100000:0.0:1789265335.624997:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc82437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2396:x1876180399586048:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265335.625065:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc82437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2396:x1876180399586048:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 68us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265335.625073:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 375 00000100:00100000:3.0:1789265335.809515:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417501696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265335.809592:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265335.809692:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417501696 00000100:00100000:1.0:1789265335.809701:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417501696 00000100:00100000:1.0:1789265335.809769:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789265335.809780:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417501696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789265335.809818:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265335.809871:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417501696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265335.809879:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:1.0:1789265335.809924:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83efe680 x1876180417501696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265335.809945:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417501696:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789265335.810779:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265336.321683:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417502208:0@lo:400:kworker.0 00000100:00100000:1.0:1789265336.321757:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265336.321810:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417502720:0@lo:400:kworker.0 00000100:00100000:0.0:1789265336.321829:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417501952:0@lo:400:kworker.0 00000100:00100000:1.0:1789265336.321839:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265336.321866:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417503232:0@lo:400:kworker.0 00000100:00100000:0.0:1789265336.321872:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265336.321891:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265336.321916:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417502464:0@lo:400:kworker.0 00000100:00100000:1.0:1789265336.321928:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789265336.321935:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417501824:0@lo:400:kworker.0 00000100:00100000:0.0:1789265336.321964:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265336.321983:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265336.321992:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417502976:0@lo:400:kworker.0 00000100:00100000:1.0:1789265336.322011:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417502336:0@lo:400:kworker.0 00000100:00100000:0.0:1789265336.322043:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265336.322072:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789265336.322076:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265336.322082:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417502080:0@lo:400:kworker.0 00000100:00100000:1.0:1789265336.322104:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417502848:0@lo:400:kworker.0 00000100:00100000:0.0:1789265336.322115:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265336.322135:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265336.322139:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417502592:0@lo:400:kworker.0 00000100:00100000:0.0:1789265336.322168:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265336.322175:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417502208 00000100:00100000:1.0:1789265336.322183:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417502208 00000100:00100000:0.0:1789265336.322189:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417503104:0@lo:400:kworker.0 00000100:00100000:0.0:1789265336.322223:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265336.322237:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417502080 00000100:00100000:1.0:1789265336.322241:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417502080 00000100:00100000:0.0:1789265336.322255:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417501952 00000100:00100000:0.0:1789265336.322261:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417501952 00000100:00100000:1.0:1789265336.322263:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789265336.322275:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417502208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265336.322290:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417502464 00000100:00100000:0.0:1789265336.322295:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417502464 00000100:00100000:0.0:1789265336.322319:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417502976 00000100:00100000:0.0:1789265336.322323:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417502976 00000100:00100000:0.0:1789265336.322340:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417502336 00000100:00100000:1.0:1789265336.322341:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417502208:12345-0@lo:400:kworker.0 Request processed in 67us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265336.322343:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417502336 00000100:00100000:1.0:1789265336.322353:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789265336.322359:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417502592 00000100:00100000:0.0:1789265336.322363:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417502592 00000100:00100000:1.0:1789265336.322373:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789265336.322382:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417502080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265336.322394:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417503104 00000100:00100000:0.0:1789265336.322398:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417503104 00000100:00100000:1.0:1789265336.322419:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417502080:12345-0@lo:400:kworker.0 Request processed in 38us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265336.322424:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789265336.322432:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789265336.322437:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417501952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265336.322453:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417502720 00000100:00100000:1.0:1789265336.322457:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417502720 00000100:00100000:0.0:1789265336.322482:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417501952:12345-0@lo:400:kworker.0 Request processed in 48us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265336.322485:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417503232 00000100:00100000:1.0:1789265336.322490:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417503232 00000100:00100000:0.0:1789265336.322493:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789265336.322509:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417502848 00000100:00100000:1.0:1789265336.322512:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417502848 00000100:00100000:0.0:1789265336.322516:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789265336.322526:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417502464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265336.322531:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789265336.322540:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417502720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265336.322561:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417502464:12345-0@lo:400:kworker.0 Request processed in 37us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265336.322570:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789265336.322582:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417502720:12345-0@lo:400:kworker.0 Request processed in 42us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265336.322588:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789265336.322597:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417502976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265336.322601:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789265336.322618:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789265336.322625:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417503232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265336.322804:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789265336.322817:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417502848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265336.327143:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417503232:12345-0@lo:400:kworker.0 Request processed in 4509us (5241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265336.327159:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789265336.327214:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417501824 00000100:00100000:1.0:1789265336.327222:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417501824 00000100:00100000:1.0:1789265336.327262:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1789265336.327270:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc82d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3641:x1876180417501824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265336.327324:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc82d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3641:x1876180417501824:12345-0@lo:400:kworker.0 Request processed in 56us (5342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265336.327331:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1789265336.327370:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789265336.327380:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417502336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265336.327413:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417502336:12345-0@lo:400:kworker.0 Request processed in 36us (5339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265336.327419:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789265336.327436:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789265336.327444:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417502592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265336.327477:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417502592:12345-0@lo:400:kworker.0 Request processed in 35us (5309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265336.327483:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789265336.327495:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789265336.327501:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417503104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265336.327542:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417503104:12345-0@lo:400:kworker.0 Request processed in 41us (5318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265336.327549:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789265336.327613:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417501824:0@lo:400:kworker.0 00000100:00100000:1.0:1789265336.327629:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417502336:0@lo:400:kworker.0 00000100:00100000:1.0:1789265336.327641:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417502208:0@lo:400:kworker.0 00000100:00100000:1.0:1789265336.327725:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417502720:0@lo:400:kworker.0 00010000:00080000:1.0:1789265336.327738:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc91420380 x1876180417503232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265336.327748:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417503232:0@lo:400:kworker.0 00000100:00100000:1.0:1789265336.327836:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417502080:0@lo:400:kworker.0 00010000:00080000:1.0:1789265336.327849:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc91420000 x1876180417502592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265336.327857:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417502592:0@lo:400:kworker.0 00010000:00080000:1.0:1789265336.327866:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc91420e00 x1876180417503104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265336.327872:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417503104:0@lo:400:kworker.0 00000100:00100000:1.0:1789265336.327888:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417501952:0@lo:400:kworker.0 00000100:00100000:1.0:1789265336.327899:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417502464:0@lo:400:kworker.0 00000100:00100000:1.0:1789265336.327912:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417502976:0@lo:400:kworker.0 00000100:00080000:1.0:1789265336.328085:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265336.328090:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265336.328094:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265336.328097:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265336.328170:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417503360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265336.328176:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417502848:12345-0@lo:400:kworker.0 Request processed in 5358us (6037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265336.328188:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789265336.328216:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265336.328418:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417503360 00000100:00100000:3.0:1789265336.328424:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417503360 00000100:00100000:0.0:1789265336.329240:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417502976:12345-0@lo:400:kworker.0 Request processed in 6640us (7211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265336.329250:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789265336.333243:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417502848:0@lo:400:kworker.0 00000100:00100000:3.0:1789265336.347518:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789265336.347541:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417503360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265336.347580:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265336.347684:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417503360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (19468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265336.347691:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:1.0:1789265336.347765:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc91422680 x1876180417503360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265336.347788:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417503360:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789265336.645000:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789265336.838867:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5b43750b-84cf-4d62-9028-e016267b6509 00000020:00000080:0.0:1789265336.838881:0:8428:0:(genops.c:885:class_export_put()) final put ffff9fccbf4eb800/5b43750b-84cf-4d62-9028-e016267b6509 00000020:00000080:0.0:1789265336.838916:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbf4eb800/5b43750b-84cf-4d62-9028-e016267b6509 for lustre-OST0000 00000020:00000080:0.0:1789265336.838991:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccbf4ee800 for lustre-OST0000 00010000:00010000:1.0:1789265337.665307:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789265338.562786:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789265338.627117:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789265338.693884:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265338.881887:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265338.881908:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417503488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265338.881992:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265338.882073:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417503488 00000100:00100000:3.0:1789265338.882080:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417503488 00000100:00100000:3.0:1789265338.882126:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789265338.882134:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417503488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265338.882166:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789265338.882213:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417503488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265338.882221:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789265338.882265:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417503488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265338.884407:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417503616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265338.884474:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265338.884606:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417503616 00000100:00100000:1.0:1789265338.884614:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417503616 00000100:00100000:1.0:1789265338.884661:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789265338.884669:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417503616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789265338.884702:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789265338.886411:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417503616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1733us (1927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265338.886426:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789265338.891832:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417503616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265339.397411:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417503744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265339.397489:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265339.397580:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417503744 00000100:00100000:1.0:1789265339.397588:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417503744 00000100:00100000:1.0:1789265339.397642:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789265339.397650:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417503744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789265339.397683:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265339.397735:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417503744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265339.397742:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1789265339.397763:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265339.397808:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417503744:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265339.399931:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf54f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417503872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265339.400003:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265339.400091:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417503872 00000100:00100000:3.0:1789265339.400098:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417503872 00000100:00100000:3.0:1789265339.400148:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789265339.400167:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417503872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265339.400189:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265339.401783:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417503872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1610us (1772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265339.401804:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1789265339.401834:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265339.401880:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf54f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417503872:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789265339.714214:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265340.738199:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265340.744986:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265340.745056:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265340.745091:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265340.745112:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265340.745137:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265340.745169:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399586944 00000100:00100000:1.0:1789265340.745181:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399586944 00000100:00100000:1.0:1789265340.745257:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399587200 00000100:00100000:1.0:1789265340.745261:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399587200 00000100:00100000:1.0:1789265340.745277:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399586816 00000100:00100000:1.0:1789265340.745280:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399586816 00000100:00100000:1.0:1789265340.745292:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399587072 00000100:00100000:1.0:1789265340.745295:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399587072 00000100:00100000:1.0:1789265340.745313:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 264 00000100:00100000:1.0:1789265340.745323:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2393:x1876180399586944:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265340.745417:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2393:x1876180399586944:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 95us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265340.745426:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 264 00000100:00100000:0.0:1789265340.745730:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399586688 00000100:00100000:0.0:1789265340.745736:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399586688 00000100:00100000:0.0:1789265340.745775:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 377 00000100:00100000:0.0:1789265340.745783:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc82d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2393:x1876180399586688:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265340.745833:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc82d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2393:x1876180399586688:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 51us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265340.745841:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 377 00000100:00100000:0.0:1789265340.745883:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 265 00000100:00100000:0.0:1789265340.745891:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399587200:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265340.745935:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399587200:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 46us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265340.745942:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 265 00000100:00100000:0.0:1789265340.745957:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 266 00000100:00100000:0.0:1789265340.745964:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2393:x1876180399586816:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265340.745991:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2393:x1876180399586816:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 28us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265340.745998:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 266 00000100:00100000:0.0:1789265340.746010:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 267 00000100:00100000:0.0:1789265340.746016:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399587072:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265340.746069:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399587072:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 54us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265340.746076:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 267 00000100:00080000:1.0:1789265340.746168:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265340.746175:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265340.929328:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417504000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265340.929412:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265340.933352:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417504000 00000100:00100000:0.0:1789265340.933375:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417504000 00000100:00100000:2.0:1789265340.934055:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789265340.934071:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417504000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789265340.934139:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265340.934278:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417504000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 212us (4864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265340.934287:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:0.0:1789265340.935080:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83effb80 x1876180417504000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265340.935110:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417504000:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789265340.936367:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265341.444544:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417504512:0@lo:400:kworker.0 00000100:00100000:2.0:1789265341.444632:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265341.444692:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417505024:0@lo:400:kworker.0 00000100:00100000:2.0:1789265341.444717:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265341.444743:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417505536:0@lo:400:kworker.0 00000100:00100000:2.0:1789265341.444765:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265341.444795:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789265341.444801:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417504128:0@lo:400:kworker.0 00000100:00100000:2.0:1789265341.444829:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265341.444848:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417504640:0@lo:400:kworker.0 00000100:00100000:2.0:1789265341.444870:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265341.444885:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417505152:0@lo:400:kworker.0 00000100:00100000:2.0:1789265341.444903:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265341.444944:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417505024 00000100:00100000:2.0:1789265341.444952:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417505024 00000100:00100000:2.0:1789265341.445007:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417505536 00000100:00100000:2.0:1789265341.445010:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417505536 00000100:00100000:2.0:1789265341.445044:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417505152 00000100:00100000:2.0:1789265341.445047:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417505152 00000100:00100000:2.0:1789265341.445062:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789265341.445071:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417505024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265341.445128:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417505024:12345-0@lo:400:kworker.0 Request processed in 57us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265341.445150:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789265341.445170:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789265341.445175:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417505536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265341.445436:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417505536:12345-0@lo:400:kworker.0 Request processed in 260us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265341.445443:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789265341.445454:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789265341.445756:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417505152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265341.445792:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417505152:12345-0@lo:400:kworker.0 Request processed in 333us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265341.445799:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789265341.445828:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417504128 00000100:00100000:2.0:1789265341.445833:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417504128 00000100:00100000:2.0:1789265341.445870:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1789265341.445877:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc82d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3643:x1876180417504128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265341.445907:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc82d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3643:x1876180417504128:12345-0@lo:400:kworker.0 Request processed in 31us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265341.445913:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1789265341.445956:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417504640 00000100:00100000:2.0:1789265341.445959:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417504640 00000100:00100000:2.0:1789265341.445987:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789265341.445993:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417504640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265341.446019:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417504640:12345-0@lo:400:kworker.0 Request processed in 27us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265341.446049:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:2.0:1789265341.446079:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265341.446083:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265341.446362:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417504128:0@lo:400:kworker.0 00000100:00100000:2.0:1789265341.446387:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417504640:0@lo:400:kworker.0 00000100:00100000:2.0:1789265341.446397:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417505152:0@lo:400:kworker.0 00000100:00100000:2.0:1789265341.446408:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417505024:0@lo:400:kworker.0 00010000:00080000:2.0:1789265341.446420:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83c98a80 x1876180417505536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265341.446433:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417505536:0@lo:400:kworker.0 00000100:00100000:1.0:1789265341.448340:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265341.448375:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417505664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265341.448454:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265341.451119:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417504256:0@lo:400:kworker.0 00000100:00100000:3.0:1789265341.451444:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265341.451585:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417504768:0@lo:400:kworker.0 00000100:00100000:3.0:1789265341.451615:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265341.455557:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417504512 00000100:00100000:2.0:1789265341.455575:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417504512 00000100:00100000:2.0:1789265341.455648:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789265341.455671:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417504512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265341.455803:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417504512:12345-0@lo:400:kworker.0 Request processed in 145us (11169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265341.455812:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789265341.455851:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417504384:0@lo:400:kworker.0 00000100:00100000:2.0:1789265341.455895:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265341.455930:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417504896:0@lo:400:kworker.0 00000100:00100000:2.0:1789265341.455961:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417504384 00000100:00100000:2.0:1789265341.455964:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417504384 00000100:00100000:2.0:1789265341.455987:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789265341.455992:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417504384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265341.456053:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417504384:12345-0@lo:400:kworker.0 Request processed in 60us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265341.456068:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789265341.456113:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417504512:0@lo:400:kworker.0 00000100:00100000:2.0:1789265341.456176:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417505664 00000100:00100000:2.0:1789265341.456180:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417505664 00000100:00100000:2.0:1789265341.456204:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789265341.456210:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417505664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265341.456227:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265341.456261:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417505664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (7808us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265341.456267:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:2.0:1789265341.456296:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc91422a00 x1876180417505664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265341.456313:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417505664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265341.458717:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876180417505280:0@lo:400:kworker.0 00000100:00100000:3.0:1789265341.458792:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265341.459137:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417504256 00000100:00100000:1.0:1789265341.459148:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417504256 00000100:00100000:1.0:1789265341.459223:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417504768 00000100:00100000:1.0:1789265341.459226:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417504768 00000100:00100000:1.0:1789265341.459258:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789265341.459267:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417504256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265341.459332:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417504256:12345-0@lo:400:kworker.0 Request processed in 66us (7889us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265341.459340:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789265341.459356:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789265341.459362:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417504768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265341.459609:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417504768:12345-0@lo:400:kworker.0 Request processed in 246us (7993us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265341.459616:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:1.0:1789265341.459636:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265341.459964:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417504256:0@lo:400:kworker.0 00000100:00100000:3.0:1789265341.459977:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417504768:0@lo:400:kworker.0 00000100:00100000:3.0:1789265341.460018:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417505280 00000100:00100000:3.0:1789265341.460046:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417505280 00000100:00100000:3.0:1789265341.460082:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789265341.460088:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876180417505280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265341.460125:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876180417505280:12345-0@lo:400:kworker.0 Request processed in 37us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265341.460131:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:3.0:1789265341.460144:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265341.460160:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876180417505280:0@lo:400:kworker.0 00000100:00100000:3.0:1789265341.460362:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265341.460402:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417505408:0@lo:400:kworker.0 00000100:00100000:3.0:1789265341.460432:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265341.460461:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417504384:0@lo:400:kworker.0 00000100:00100000:1.0:1789265341.460552:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417504896 00000100:00100000:1.0:1789265341.460556:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417504896 00000100:00100000:1.0:1789265341.460582:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417505408 00000100:00100000:1.0:1789265341.460585:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417505408 00000100:00100000:1.0:1789265341.460604:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789265341.460610:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417504896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265341.460648:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417504896:12345-0@lo:400:kworker.0 Request processed in 38us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265341.460655:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789265341.460675:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789265341.460680:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876180417505408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265341.460705:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876180417505408:12345-0@lo:400:kworker.0 Request processed in 25us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265341.460711:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00010000:00080000:3.0:1789265341.460826:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83efd500 x1876180417504896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265341.460837:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417504896:0@lo:400:kworker.0 00010000:00080000:3.0:1789265341.460847:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83c98000 x1876180417505408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265341.460856:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417505408:0@lo:400:kworker.0 00000100:00080000:3.0:1789265341.460890:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789265341.762190:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789265342.178091:0:14060:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 22:09:01 (1789265341) 00010000:00010000:2.0:1789265342.785252:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265343.809753:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265343.862364:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265343.862554:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399587328 00000100:00100000:1.0:1789265343.862567:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399587328 00000100:00080000:3.0:1789265343.862639:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265343.862678:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 40 00000100:00100000:1.0:1789265343.862694:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:11076:x1876180399587328:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265343.862732:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265343.862763:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a9690c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbd81 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265343.862852:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96913 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265343.862869:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96913 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265343.862886:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96913 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265343.862960:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789265343.862964:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789265343.863012:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96913 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265343.863094:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a9690c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd81 expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265343.863138:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96913 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd81 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265343.863148:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcc9b3cbe00) 00010000:00010000:1.0:1789265343.863151:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265343.863155:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fe400, rc 0) 00000100:00100000:1.0:1789265343.863487:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+6:11076:x1876180399587328:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 798us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265343.863626:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 40 00000100:00100000:1.0:1789265343.874396:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265343.874507:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399587456 00000100:00100000:3.0:1789265343.874520:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399587456 00000100:00100000:3.0:1789265343.874598:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 41 00000100:00100000:3.0:1789265343.874609:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+6:11077:x1876180399587456:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265343.874635:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265343.874661:0:8460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a9691a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbd88 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.874758:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a96921 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.874776:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a96921 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.874808:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a96921 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.874825:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a96928 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.874833:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a96928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.874840:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a96928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.874930:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7a00/0x9272d942b4a9692f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.874939:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7a00/0x9272d942b4a9692f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.874946:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7a00/0x9272d942b4a9692f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265343.874997:0:8460:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789265343.875001:0:8460:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265343.875061:0:8460:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7a00/0x9272d942b4a9692f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.875074:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a96921 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.875081:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a96921 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.875099:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a96921 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.875107:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6c00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265343.875112:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a96921 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.875121:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a96921 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.875136:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcc9b3cbe00) 00010000:00010000:3.0:1789265343.875139:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265343.875144:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a96921 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.875151:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a96921 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.875168:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a96928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.875174:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a96928 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.875179:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a96928 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.875185:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265343.875188:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a96928 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.875399:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a96928 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.875410:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9fcc9b3f5f00) 00010000:00010000:3.0:1789265343.875412:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265343.875415:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a96928 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.875421:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a96928 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.875461:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a9691a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd88 expref: 8 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.875476:0:8460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7a00/0x9272d942b4a9692f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd88 expref: 7 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265343.875485:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fcc9b3f5000) 00010000:00010000:3.0:1789265343.875487:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265343.875499:0:8460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b7a00, rc 0) 00000100:00100000:3.0:1789265343.875589:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+7:11077:x1876180399587456:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 981us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265343.875599:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 41 00000100:00100000:2.0:1789265343.880168:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265343.880762:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399587584 00000100:00100000:1.0:1789265343.880776:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399587584 00000100:00100000:1.0:1789265343.880856:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:1.0:1789265343.880869:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5b43750b-84cf-4d62-9028-e016267b6509+7:11077:x1876180399587584:12345-192.168.203.49@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789265343.880995:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5b43750b-84cf-4d62-9028-e016267b6509+7:11077:x1876180399587584:12345-192.168.203.49@tcp:900:lhsmtool_posix.0 Request processed in 129us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265343.881003:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:2.0:1789265343.886269:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265343.886520:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399587840 00000100:00100000:0.0:1789265343.886534:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399587840 00000100:00100000:0.0:1789265343.886612:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 42 00000100:00100000:0.0:1789265343.886625:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+7:11077:x1876180399587840:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265343.886652:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265343.886682:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a96936 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbd8f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.886776:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a9693d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.886793:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a9693d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.886807:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a9693d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.891787:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96944 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.891812:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96944 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.891827:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96944 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.892106:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4600/0x9272d942b4a9694b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.892137:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4600/0x9272d942b4a9694b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.892145:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4600/0x9272d942b4a9694b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265343.892158:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789265343.892253:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a9693d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.892261:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a9693d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.892269:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a9693d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.892275:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265343.892280:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a9693d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.892288:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a9693d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.892301:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fcc9b3f5000) 00010000:00010000:0.0:1789265343.892304:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265343.892308:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a9693d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.892315:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a9693d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.892328:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96944 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.892341:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96944 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.892347:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96944 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.892352:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5a00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265343.892356:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96944 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.892362:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96944 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.892370:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fccbd2b4800) 00010000:00010000:0.0:1789265343.892373:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265343.892376:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96944 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.892382:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96944 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.892793:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a96936 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd8f expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.892810:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4600/0x9272d942b4a9694b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd8f expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265343.892819:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fccbd2b4c00) 00010000:00010000:0.0:1789265343.892821:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265343.892830:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da4600, rc 0) 00000100:00100000:0.0:1789265343.893134:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+9:11077:x1876180399587840:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 6510us (6878us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789265343.893145:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 42 00000100:00100000:2.0:1789265343.899453:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265343.899755:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399587968 00000100:00100000:1.0:1789265343.899765:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399587968 00000100:00100000:1.0:1789265343.899882:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 43 00000100:00100000:1.0:1789265343.899893:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+9:11077:x1876180399587968:12345-192.168.203.49@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789265343.900014:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+9:11077:x1876180399587968:12345-192.168.203.49@tcp:59:lhsmtool_posix.0 Request processed in 124us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265343.900051:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 43 00000100:00100000:2.0:1789265343.904884:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265343.904980:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399588096 00000100:00100000:3.0:1789265343.904991:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399588096 00000100:00100000:3.0:1789265343.905104:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 44 00000100:00100000:3.0:1789265343.905115:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+5:11077:x1876180399588096:12345-192.168.203.49@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1789265343.905302:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1789265343.906260:0:8460:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1075us 00000100:00100000:0.0:1789265343.934786:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+5:11077:x1876180399588096:12345-192.168.203.49@tcp:59:lhsmtool_posix.0 Request processed in 29659us (29899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265343.934802:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 44 00000100:00100000:0.0:1789265344.004724:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265344.004926:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417505792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265344.005080:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265344.005133:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417505792 00000100:00100000:2.0:1789265344.005144:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417505792 00000100:00100000:0.0:1789265344.005163:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417505920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265344.005194:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265344.011532:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417505920 00000100:00100000:0.0:1789265344.011552:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417505920 00000100:00100000:0.0:1789265344.011611:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789265344.011625:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417505792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789265344.011679:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789265344.011874:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417505792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 251us (6796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265344.011884:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789265344.011916:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789265344.011924:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417505920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789265344.011956:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789265344.011995:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417505920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (6800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265344.012010:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789265344.012852:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417505920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265344.012881:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417505792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265344.513794:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417506048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265344.513923:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265344.514358:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417506048 00000100:00100000:3.0:1789265344.514370:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417506048 00000100:00100000:3.0:1789265344.514461:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789265344.514474:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417506048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265344.514512:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265344.514575:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417506048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265344.514583:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1789265344.515579:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265344.515656:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417506048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265344.516227:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265344.516244:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417506176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265344.516329:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265344.516433:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417506176 00000100:00100000:2.0:1789265344.516448:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417506176 00000100:00100000:2.0:1789265344.516524:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789265344.516535:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417506176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789265344.516559:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265344.516652:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417506176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265344.516660:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789265344.516709:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417506176:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789265344.517069:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1789265344.708930:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789265344.769932:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789265344.833401:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265345.860501:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265345.862061:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265345.862115:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265345.862164:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399588352 00000100:00100000:0.0:1789265345.862169:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265345.862176:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399588352 00000100:00100000:0.0:1789265345.862224:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265345.862248:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399588608 00000100:00100000:3.0:1789265345.862253:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399588608 00000100:00100000:0.0:1789265345.862276:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265345.862279:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399588480 00000100:00100000:3.0:1789265345.862283:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399588480 00000100:00100000:0.0:1789265345.862300:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399588224 00000100:00100000:0.0:1789265345.862306:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399588224 00000100:00100000:3.0:1789265345.862315:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399588736 00000100:00100000:3.0:1789265345.862319:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399588736 00000100:00100000:3.0:1789265345.862347:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 274 00000100:00100000:0.0:1789265345.862350:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 379 00000100:00100000:3.0:1789265345.862361:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+9:2393:x1876180399588352:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265345.862364:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2394:x1876180399588224:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265345.862442:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2394:x1876180399588224:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 83us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265345.862450:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 379 00000100:00100000:3.0:1789265345.862540:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+9:2393:x1876180399588352:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 182us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265345.862549:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 274 00000100:00100000:3.0:1789265345.862569:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 275 00000100:00100000:3.0:1789265345.862578:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399588608:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265345.862636:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399588608:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 60us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265345.862645:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 275 00000100:00100000:1.0:1789265345.862668:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 276 00000100:00100000:1.0:1789265345.862681:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399588480:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265345.862713:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399588480:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 36us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265345.864712:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 277 00000100:00100000:1.0:1789265345.864725:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 276 00000100:00100000:3.0:1789265345.864734:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2394:x1876180399588736:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265345.864817:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2394:x1876180399588736:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 93us (2543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265345.864824:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 277 00000100:00080000:3.0:1789265345.864847:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265345.864852:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265346.040660:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265346.040750:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399588864 00000100:00100000:1.0:1789265346.040760:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399588864 00000100:00100000:1.0:1789265346.040827:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 45 00000100:00100000:1.0:1789265346.040839:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+9:11119:x1876180399588864:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1789265346.040863:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265346.040897:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a96959 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbd96 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.040973:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96960 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.040989:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96960 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.041002:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96960 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.041017:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96967 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.041051:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96967 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.041058:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96967 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.041116:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96960 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.041135:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96960 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.041142:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96960 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.041148:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ffc00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265346.041152:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96960 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.041160:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96960 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.041172:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcc9b3cbe00) 00010000:00010000:1.0:1789265346.041175:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265346.041180:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96960 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.041186:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96960 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.041197:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96967 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.041202:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96967 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.041207:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96967 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.041218:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fea00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265346.041221:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96967 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.041227:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96967 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.041235:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fccacd4e000) 00010000:00010000:1.0:1789265346.041237:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265346.041239:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96967 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.041245:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96967 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.041278:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a96959 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd96 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.041288:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcc9b3cbe00) 00010000:00010000:1.0:1789265346.041291:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265346.041294:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a96959 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd96 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.041305:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2ff800, rc 0) 00000100:00100000:1.0:1789265346.041366:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+9:11119:x1876180399588864:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 529us (715us total) trans 0 rc 301/301 00000100:00100000:1.0:1789265346.041373:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 45 00000100:00100000:0.0:1789265346.051161:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265346.051185:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417506304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265346.051251:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265346.051317:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417506304 00000100:00100000:0.0:1789265346.051324:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417506304 00000100:00100000:0.0:1789265346.051377:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789265346.051385:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417506304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789265346.051410:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265346.051556:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417506304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 171us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265346.051564:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1789265346.051583:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789265346.051614:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83f32680 x1876180417506304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265346.051630:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417506304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265346.054615:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265346.055219:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399589120 00000100:00100000:3.0:1789265346.055230:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399589120 00000100:00100000:3.0:1789265346.055283:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 46 00000100:00100000:3.0:1789265346.055293:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+9:11119:x1876180399589120:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:3.0:1789265346.055347:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265346.055374:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96913 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd81 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.055390:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcc9b3cbe00) 00010000:00010000:3.0:1789265346.055400:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265346.055463:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a9696e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.055476:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a9696e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.055487:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a9696e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.055499:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a96975 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.055521:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a96975 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.055529:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a96975 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.056577:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a9697c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.056591:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a9697c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.056600:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a9697c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265346.056618:0:8459:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a286cdd2 reply state 00000000db7903b2 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a9697c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.056630:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a9697c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.056637:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:3.0:1789265346.056640:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789265346.056643:0:8459:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789265346.056649:0:8459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789265346.056656:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a9696e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.056663:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a9696e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.056670:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a9696e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.056687:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265346.056693:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a9696e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.056700:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a9696e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.056710:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcca967b300) 00010000:00010000:3.0:1789265346.056713:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265346.056717:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a9696e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.056723:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a9696e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265346.056740:0:8459:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a286cdd2 reply state 00000000db7903b2 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a96975 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.056749:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a96975 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.056755:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fcca967bf00) 00010000:00010000:3.0:1789265346.056757:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789265346.056760:0:8459:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789265346.056881:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+10:11119:x1876180399589120:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 1587us (2271us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789265346.056898:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 46 00000100:00100000:1.0:1789265346.148006:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265346.148162:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399589248 00000100:00100000:3.0:1789265346.148180:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399589248 00000100:00100000:3.0:1789265346.148261:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 47 00000100:00100000:3.0:1789265346.148287:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+10:11127:x1876180399589248:12345-192.168.203.49@tcp:101:lctl.0 00010000:00010000:3.0:1789265346.148319:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265346.148355:0:8460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a96983 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbd9d expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.148502:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a9698a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.148519:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a9698a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.148534:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a9698a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265346.148595:0:8460:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789265346.148600:0:8460:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265346.148674:0:8460:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a9698a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.148707:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a96983 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd9d expref: 12 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.148728:0:8460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a9698a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd9d expref: 11 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.148736:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcca967b300) 00010000:00010000:3.0:1789265346.148739:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265346.148744:0:8460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b7800, rc 0) 00000100:00100000:3.0:1789265346.148831:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+11:11127:x1876180399589248:12345-192.168.203.49@tcp:101:lctl.0 Request processed in 548us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265346.148850:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 47 00000100:00100000:1.0:1789265346.204273:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265346.204448:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399589376 00000100:00100000:0.0:1789265346.204462:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399589376 00000100:00100000:0.0:1789265346.204538:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 48 00000100:00100000:0.0:1789265346.204551:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+11:11133:x1876180399589376:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1789265346.204578:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265346.204603:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96991 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbda4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.204806:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a96998 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.204844:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a96998 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.204857:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a96998 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.204871:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9699f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.204879:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9699f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.204885:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9699f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.204999:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a969a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.205008:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a969a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.205575:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a969a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265346.205789:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789265346.205795:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789265346.205853:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a969a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.205870:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a96998 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.205878:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a96998 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.205886:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a96998 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.205903:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265346.205908:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a96998 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.205918:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a96998 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.205935:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcca967b300) 00010000:00010000:1.0:1789265346.205939:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265346.205944:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a96998 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.205950:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a96998 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.205968:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9699f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.205989:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9699f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.205995:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9699f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.205999:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265346.206002:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9699f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.206009:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9699f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.206018:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fcca967bf00) 00010000:00010000:1.0:1789265346.206068:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265346.206072:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9699f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.206077:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9699f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.206117:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96991 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbda4 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.206133:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a969a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbda4 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.206141:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:1.0:1789265346.206144:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789265346.206300:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da4e00, rc 0) 00000100:00100000:1.0:1789265346.206439:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+12:11133:x1876180399589376:12345-192.168.203.49@tcp:101:bash.0 Request processed in 1881us (2171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265346.206448:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 48 00000100:00100000:0.0:1789265346.210190:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265346.210336:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399589632 00000100:00100000:3.0:1789265346.210350:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399589632 00000100:00100000:3.0:1789265346.210427:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 49 00000100:00100000:3.0:1789265346.210439:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+12:11133:x1876180399589632:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1789265346.210469:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265346.210498:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a969ad lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbdab expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.210634:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a969b4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.210651:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a969b4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.210664:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a969b4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.213008:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a969bb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.213048:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a969bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.213062:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a969bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789265346.213693:0:8459:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1789265346.213843:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a969c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.213860:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a969c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.213869:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a969c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.213916:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a969b4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.213923:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a969b4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.213929:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a969b4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.213934:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6a00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265346.213939:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a969b4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.213945:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a969b4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.213958:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:3.0:1789265346.213961:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265346.213966:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a969b4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.213972:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a969b4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265346.213986:0:8459:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033abd113 reply state 000000001b609c0d transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a969bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.214004:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a969bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.214011:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fcca967bd00) 00010000:00010000:3.0:1789265346.214013:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789265346.214016:0:8459:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789265346.214084:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a969ad lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdab expref: 15 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.214099:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a969c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdab expref: 14 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.214106:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcca967b500) 00010000:00010000:3.0:1789265346.214107:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265346.214110:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b7000, rc 0) 00000100:00100000:3.0:1789265346.214489:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+15:11133:x1876180399589632:12345-192.168.203.49@tcp:101:bash.0 Request processed in 4050us (4310us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789265346.214498:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 49 00000100:00100000:1.0:1789265346.220592:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265346.220883:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399589760 00000100:00100000:2.0:1789265346.220905:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399589760 00000100:00100000:2.0:1789265346.220962:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 28 00000100:00100000:2.0:1789265346.220972:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1876180399589760:12345-192.168.203.49@tcp:8:bash.0 00010000:00080000:2.0:1789265346.221015:0:8433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp t0 exp 0000000000000000 cur 397 last 0 00000020:00000080:2.0:1789265346.221076:0:8433:0:(genops.c:1385:class_connect()) connect: client 5b43750b-84cf-4d62-9028-e016267b6509, cookie 0x9272d942b4a969d0 00002000:00100000:2.0:1789265346.221336:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5b43750b-84cf-4d62-9028-e016267b6509/ffff9fcc82d4e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789265346.221350:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789265346.221455:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789265346.221493:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9fcc82d49000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265346.221605:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+6:2392:x1876180399589760:12345-192.168.203.49@tcp:8:bash.0 Request processed in 632us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265346.221614:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 28 00000100:00100000:1.0:1789265346.233969:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265346.239665:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399589888 00000100:00100000:2.0:1789265346.240246:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399589888 00000100:00100000:2.0:1789265346.240428:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 29 00000100:00100000:2.0:1789265346.240449:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+6:0:x1876180399589888:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1789265346.240472:0:8914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265346.240503:0:8914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000731fc844/0x9272d942b4a969d7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbdb2 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265346.240537:0:8914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265346.240579:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1789265346.240584:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265346.240596:0:8914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000731fc844/0x9272d942b4a969d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdb2 expref: 7 pid: 8914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.240621:0:8914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000731fc844/0x9272d942b4a969d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdb2 expref: 7 pid: 8914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.240648:0:8914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81692c00, rc 0) 00000100:00100000:2.0:1789265346.240742:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+7:0:x1876180399589888:12345-192.168.203.49@tcp:101:bash.0 Request processed in 296us (6788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265346.240749:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 29 00000100:00080000:0.0:1789265346.241571:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265346.249606:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265346.249874:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399590016 00000100:00100000:2.0:1789265346.249898:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399590016 00000100:00100000:2.0:1789265346.249972:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 30 00000100:00100000:2.0:1789265346.249984:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+7:11133:x1876180399590016:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1789265346.250005:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265346.250067:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b88e39d/0x9272d942b4a969de lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbdb9 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.250110:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000731fc844/0x9272d942b4a969d7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdb2 expref: 8 pid: 8914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.250121:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265346.250127:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265346.250133:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b88e39d/0x9272d942b4a969de lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdb9 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.250261:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000731fc844/0x9272d942b4a969d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdb2 expref: 8 pid: 8914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.250278:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000731fc844/0x9272d942b4a969d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdb2 expref: 8 pid: 8914 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265346.250367:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8435:1876180417506432:192.168.203.49@tcp:104: 00000100:00100000:2.0:1789265346.250487:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265346.255993:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8435:1876180417506432:192.168.203.49@tcp:104: 00010000:00010000:1.0:1789265346.256081:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009b88e39d/0x9272d942b4a969de lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdb9 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265346.256336:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00010000:00010000:1.0:1789265346.256577:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81692e00, rc 0) 00000100:00100000:0.0:1789265346.256769:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+8:11133:x1876180399590016:12345-192.168.203.49@tcp:101:bash.0 Request processed in 6784us (7173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265346.256780:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 30 00000100:00100000:3.0:1789265346.259712:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399590144 00000100:00100000:3.0:1789265346.259733:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399590144 00010000:00010000:2.0:1789265346.260746:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000731fc844/0x9272d942b4a969d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdb2 expref: 8 pid: 8914 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265346.262267:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 52 00000100:00100000:2.0:1789265346.262308:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb09a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+8:2395:x1876180399590144:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265346.262335:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265346.262371:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000731fc844/0x9272d942b4a969d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdb2 expref: 8 pid: 8914 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.262393:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000731fc844/0x9272d942b4a969d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdb2 expref: 8 pid: 8914 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.262422:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000731fc844/0x9272d942b4a969d7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdb2 expref: 8 pid: 8914 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.262914:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265346.262919:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265346.262930:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009b88e39d/0x9272d942b4a969de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdb9 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.262941:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b88e39d/0x9272d942b4a969de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdb9 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.262990:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009b88e39d/0x9272d942b4a969de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdb9 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265346.263005:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6501:1876180417506560:192.168.203.49@tcp:105: 00000100:00100000:2.0:1789265346.263185:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265346.268132:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265346.268214:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399590400 00000100:00100000:3.0:1789265346.268236:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399590400 00000100:00100000:0.0:1789265346.268264:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6501:1876180417506560:192.168.203.49@tcp:105: 00000100:00100000:3.0:1789265346.268306:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 6 00010000:00010000:0.0:1789265346.268316:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265346.268319:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+15:11133:x1876180399590400:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:0.0:1789265346.268384:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb09a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+7:2395:x1876180399590144:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 6097us (12047us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265346.268394:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 52 00000100:00100000:3.0:1789265346.269175:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+16:11133:x1876180399590400:12345-192.168.203.49@tcp:35:bash.0 Request processed in 853us (1052us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789265346.269185:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 6 00000100:00100000:3.0:1789265346.354115:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265346.354290:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399590656 00000100:00100000:0.0:1789265346.354304:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399590656 00000100:00100000:0.0:1789265346.354383:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 50 00000100:00100000:0.0:1789265346.354396:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+16:11143:x1876180399590656:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:0.0:1789265346.354427:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265346.354464:0:8460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a969e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbdc0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265346.354729:0:8460:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789265346.354861:0:8460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a969e5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdc0 expref: 18 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.354877:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcca967b300) 00010000:00010000:0.0:1789265346.354880:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265346.354886:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a969e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdc0 expref: 18 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.354914:0:8460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5800, rc 0) 00000100:00100000:0.0:1789265346.354997:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+17:11143:x1876180399590656:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 604us (903us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1789265346.355006:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 50 00000100:00100000:1.0:1789265346.360737:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265346.361301:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399590912 00000100:00100000:3.0:1789265346.361318:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399590912 00000100:00100000:3.0:1789265346.361396:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:3.0:1789265346.361408:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+17:11143:x1876180399590912:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:3.0:1789265346.362884:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+18:11143:x1876180399590912:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 1465us (2150us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789265346.362911:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:2.0:1789265346.447981:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265346.456041:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399591040 00000100:00100000:1.0:1789265346.456063:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399591040 00000100:00100000:1.0:1789265346.456164:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 51 00000100:00100000:1.0:1789265346.456176:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+18:11149:x1876180399591040:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1789265346.456209:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265346.456237:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a969f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbdc7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.456323:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a969fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.456340:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a969fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.456353:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a969fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265346.456426:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789265346.456431:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789265346.456459:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a969fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.456491:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a969f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdc7 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.456512:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a969fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdc7 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.456521:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:1.0:1789265346.456525:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265346.456529:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fec00, rc 0) 00000100:00100000:1.0:1789265346.456617:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+19:11149:x1876180399591040:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 443us (8655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265346.456625:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 51 00000100:00100000:1.0:1789265346.471168:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265346.471310:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399591296 00000100:00100000:3.0:1789265346.471323:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399591296 00000100:00100000:3.0:1789265346.471397:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 52 00000100:00100000:3.0:1789265346.471408:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+19:11149:x1876180399591296:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1789265346.471434:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265346.471460:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a96a01 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbdce expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.471597:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96a08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.471614:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96a08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.471628:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96a08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265346.471640:0:8459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789265346.471782:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a96a01 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdce expref: 22 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.471827:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96a08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdce expref: 21 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.471838:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcca967b500) 00010000:00010000:3.0:1789265346.471842:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265346.471845:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6a00, rc 0) 00000100:00100000:3.0:1789265346.471936:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+21:11149:x1876180399591296:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 529us (781us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789265346.471944:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 52 00000100:00100000:0.0:1789265346.481995:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265346.482101:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265346.482266:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399591680 00000100:00100000:3.0:1789265346.482280:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399591680 00000100:00100000:3.0:1789265346.482361:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 53 00000100:00100000:3.0:1789265346.482373:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+21:11149:x1876180399591680:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1789265346.482406:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265346.482443:0:8460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a96a16 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbdd5 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.482582:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a96a1d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.482601:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a96a1d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.482616:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a96a1d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265346.482629:0:8460:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789265346.482778:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a96a16 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdd5 expref: 24 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.482801:0:8460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a96a1d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdd5 expref: 23 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.482810:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcca967b500) 00010000:00010000:3.0:1789265346.482813:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789265346.482817:0:8460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6800, rc 0) 00000100:00100000:3.0:1789265346.482907:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+23:11149:x1876180399591680:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 537us (805us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789265346.482916:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 53 00000100:00100000:1.0:1789265346.483517:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399591424 00000100:00100000:1.0:1789265346.483527:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399591424 00000100:00100000:1.0:1789265346.483581:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 3 00000100:00100000:1.0:1789265346.483591:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+23:2395:x1876180399591424:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265346.483604:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265346.483625:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96a08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdce expref: 23 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.483639:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcca967b500) 00010000:00010000:1.0:1789265346.483654:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265346.483699:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+22:2395:x1876180399591424:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 108us (1719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265346.483705:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 3 00000100:00100000:0.0:1789265346.489479:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265346.489593:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399591808 00000100:00100000:2.0:1789265346.489606:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399591808 00000100:00100000:2.0:1789265346.489681:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 31 00000100:00100000:2.0:1789265346.489692:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+7:2396:x1876180399591808:12345-192.168.203.49@tcp:1:lfs.0 00010000:00010000:2.0:1789265346.489750:0:8914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000731fc844/0x9272d942b4a96a2b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.489778:0:8914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009b88e39d/0x9272d942b4a969de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdb9 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.489810:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265346.489816:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265346.489822:0:8914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000731fc844/0x9272d942b4a96a2b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.489869:0:8914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009b88e39d/0x9272d942b4a969de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdb9 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.490136:0:8914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009b88e39d/0x9272d942b4a969de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdb9 expref: 7 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265346.490278:0:8914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83effb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8914:1876180417506688:192.168.203.49@tcp:104: 00000100:00100000:2.0:1789265346.490383:0:8914:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d8540 going to sleep for 11 seconds 00000100:00100000:2.0:1789265346.494099:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265346.494222:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399591936 00000100:00100000:3.0:1789265346.494234:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399591936 00002000:00100000:3.0:1789265346.494295:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9fcb83efdc00 x1876180399591936/t0(0) o4->5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp:672/0 lens 504/0 e 0 to 0 dl 1789265357 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265346.494307:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fcb83efdc00 with x1876180399591936 ext(0->12) 00010000:00010000:3.0:1789265346.494317:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009b88e39d/0x9272d942b4a969de lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdb9 expref: 8 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.494335:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009b88e39d/0x9272d942b4a969de lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdb9 expref: 8 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265346.494343:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fcb83efdc00 00000100:00100000:3.0:1789265346.494382:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 0 00000100:00100000:3.0:1789265346.494393:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5b43750b-84cf-4d62-9028-e016267b6509+8:2396:x1876180399591936:12345-192.168.203.49@tcp:4:lfs.0 00000100:00100000:1.0:1789265346.495395:0:8914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83effb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8914:1876180417506688:192.168.203.49@tcp:104: 00010000:00010000:1.0:1789265346.495441:0:8914:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000731fc844/0x9272d942b4a96a2b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1789265346.496897:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5b43750b-84cf-4d62-9028-e016267b6509 00000100:00100000:2.0:1789265346.498253:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5b43750b-84cf-4d62-9028-e016267b6509+9:2396:x1876180399591936:12345-192.168.203.49@tcp:4:lfs.0 Request processed in 3845us (4153us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789265346.498275:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 0 00002000:00100000:2.0:1789265346.498292:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9fcb83efdc00 x1876180399591936/t4294967300(0) o4->5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp:672/0 lens 504/448 e 0 to 0 dl 1789265357 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789265346.498305:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fcb83efdc00 with x1876180399591936 ext(0->12) 00010000:00010000:2.0:1789265346.498317:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009b88e39d/0x9272d942b4a969de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdb9 expref: 9 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.498338:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009b88e39d/0x9272d942b4a969de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdb9 expref: 9 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265346.498360:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fcb83efdc00 00000100:00100000:0.0:1789265346.501804:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265346.501990:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399592064 00000100:00100000:1.0:1789265346.502003:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399592064 00010000:00010000:2.0:1789265346.502321:0:7926:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b88e39d/0x9272d942b4a969de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdb9 expref: 9 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265346.502407:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 53 00000100:00100000:2.0:1789265346.502421:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+9:2395:x1876180399592064:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265346.502452:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789265346.502475:0:7926:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789265346.502479:0:7926:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789265346 00002000:00010000:2.0:1789265346.502482:0:7926:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789265347 00002000:00010000:2.0:1789265346.502484:0:7926:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789265346 00002000:00010000:2.0:1789265346.502486:0:7926:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789265346.502494:0:7926:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b88e39d/0x9272d942b4a969de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdb9 expref: 9 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.502510:0:7926:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b88e39d/0x9272d942b4a969de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdb9 expref: 9 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.502538:0:7926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b88e39d/0x9272d942b4a969de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdb9 expref: 9 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.502572:0:7926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265346.502577:0:7926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265346.502768:0:7926:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000731fc844/0x9272d942b4a96a2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.502799:0:7926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000731fc844/0x9272d942b4a96a2b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.502884:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265346.502978:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+8:2395:x1876180399592064:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 561us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265346.502988:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 53 00010000:00010000:1.0:1789265346.504716:0:8914:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000731fc844/0x9272d942b4a96a2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.504740:0:8914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000731fc844/0x9272d942b4a96a2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.504780:0:8914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000731fc844/0x9272d942b4a96a2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.504790:0:8914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000731fc844/0x9272d942b4a96a2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.504801:0:8914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000731fc844/0x9272d942b4a96a2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.504810:0:8914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81692c00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265346.504815:0:8914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000731fc844/0x9272d942b4a96a2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.504851:0:8914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000731fc844/0x9272d942b4a96a2b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.504880:0:8914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000731fc844/0x9272d942b4a96a2b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.504900:0:8914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000731fc844/0x9272d942b4a96a2b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265346.505079:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+7:2396:x1876180399591808:12345-192.168.203.49@tcp:1:lfs.0 Request processed in 15382us (15608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265346.505091:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 31 00000100:00100000:0.0:1789265346.507865:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265346.507968:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399592320 00000100:00100000:1.0:1789265346.507983:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399592320 00000100:00100000:1.0:1789265346.508129:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 8 00000100:00100000:1.0:1789265346.508142:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+22:11149:x1876180399592320:12345-192.168.203.49@tcp:35:lfs.0 00000004:00010000:1.0:1789265346.508300:0:6520:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a96a1d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdd5 expref: 22 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265346.508962:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:1.0:1789265346.509016:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1789265346.509778:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:1.0:1789265346.509836:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96a32 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.509858:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a969c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdab expref: 26 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.509883:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96a32 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.509943:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a969c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdab expref: 26 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.509964:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a969c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdab expref: 26 pid: 8459 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265346.509982:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e98000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6520:1876180417506816:192.168.203.49@tcp:104: 00000100:00100000:1.0:1789265346.510867:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c48240 going to sleep for 11 seconds 00000100:00100000:2.0:1789265346.513839:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e98000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6520:1876180417506816:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265346.513880:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96a32 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265346.516384:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265346.516721:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399592448 00000100:00100000:1.0:1789265346.516734:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399592448 00010000:00010000:1.0:1789265346.516789:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a969c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdab expref: 27 pid: 8459 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265346.516832:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 54 00000100:00100000:1.0:1789265346.516843:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+27:2395:x1876180399592448:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265346.516862:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265346.516869:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a969c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdab expref: 27 pid: 8459 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.516884:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a969c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdab expref: 27 pid: 8459 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.516922:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a969c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdab expref: 27 pid: 8459 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.516957:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcca967b500) 00010000:00010000:1.0:1789265346.516963:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96a32 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.516974:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96a32 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.516982:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96a32 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265346.517016:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265346.517114:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+26:2395:x1876180399592448:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 272us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265346.517122:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 54 00010000:00010000:2.0:1789265346.517474:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96a32 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.517484:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96a32 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265346.517647:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1789265346.517790:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1789265346.517916:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83effb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1876180417506944:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789265346.517988:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265346.518059:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265346.518864:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417506944 00000100:00100000:1.0:1789265346.518876:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417506944 00000100:00100000:1.0:1789265346.518963:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789265346.518973:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1876180417506944:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789265346.519121:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1876180417506944:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 148us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265346.519130:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789265346.519913:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83effb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1876180417506944:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789265346.520176:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1789265346.520263:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83effb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1876180417507072:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789265346.520323:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265346.520379:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d8540 going to sleep for 11 seconds 00000100:00100000:1.0:1789265346.521095:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417507072 00000100:00100000:1.0:1789265346.521108:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417507072 00000100:00100000:1.0:1789265346.521179:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789265346.521190:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6520:x1876180417507072:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789265346.521386:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6520:x1876180417507072:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 197us (1062us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789265346.521410:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:0.0:1789265346.521675:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265346.521995:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83effb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1876180417507072:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789265346.522109:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1789265346.522167:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96a32 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.522179:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96a32 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.522187:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96a32 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.522193:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265346.522198:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96a32 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.522206:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96a32 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.522226:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcca967b500) 00010000:00010000:2.0:1789265346.522229:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789265346.522234:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96a32 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.522241:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96a32 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789265346.522381:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789265346.522457:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1789265346.522470:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 397752446472ns, next at 398752443862ns, rc = 0 00000001:00080000:2.0:1789265346.522477:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1789265346.522513:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcca967b500) 00010000:00010000:2.0:1789265346.522517:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789265346.522525:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a96a1d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdd5 expref: 30 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265346.522674:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+29:11149:x1876180399592320:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 14535us (14822us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1789265346.522684:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 8 00000020:00080000:2.0:1789265346.522689:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789265346.526525:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265346.526618:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399592576 00000100:00100000:2.0:1789265346.526631:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399592576 00000100:00100000:2.0:1789265346.526713:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 54 00000100:00100000:2.0:1789265346.526724:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+29:11149:x1876180399592576:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1789265346.526757:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265346.526787:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a96a39 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbddc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.526865:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a96a39 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbddc expref: 30 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.526882:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a96a39 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbddc expref: 30 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.526915:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:2.0:1789265346.526918:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265346.526922:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81692e00, rc 0) 00000100:00100000:2.0:1789265346.527001:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+30:11149:x1876180399592576:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 279us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265346.527060:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 54 00000100:00100000:1.0:1789265346.530998:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265346.531197:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399592832 00000100:00100000:3.0:1789265346.531210:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399592832 00000100:00100000:3.0:1789265346.531286:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 9 00000100:00100000:3.0:1789265346.531298:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdcfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+30:11149:x1876180399592832:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:3.0:1789265346.531639:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdcfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+31:11149:x1876180399592832:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 342us (656us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1789265346.531648:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 9 00000100:00100000:0.0:1789265346.562563:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417507200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265346.562660:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265346.563012:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417507200 00000100:00100000:2.0:1789265346.563039:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417507200 00000100:00100000:2.0:1789265346.563115:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789265346.563126:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180417507200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265346.563166:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265346.563852:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417507456:0@lo:400:kworker.0 00000100:00100000:1.0:1789265346.563913:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265346.563952:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265346.563958:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417507328:0@lo:400:kworker.0 00000100:00100000:1.0:1789265346.563989:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265346.564055:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417507328 00000100:00100000:1.0:1789265346.564061:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417507328 00000100:00100000:1.0:1789265346.564108:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1789265346.564116:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3644:x1876180417507328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265346.564170:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3644:x1876180417507328:12345-0@lo:400:kworker.0 Request processed in 54us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265346.564177:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1789265346.564221:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417507584:0@lo:400:kworker.0 00000100:00100000:1.0:1789265346.564251:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265346.564298:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417507584 00000100:00100000:1.0:1789265346.564302:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417507584 00000100:00100000:1.0:1789265346.564329:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789265346.564335:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417507584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265346.564375:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417507584:12345-0@lo:400:kworker.0 Request processed in 39us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265346.564381:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789265346.564423:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417507584:0@lo:400:kworker.0 00000100:00100000:1.0:1789265346.564451:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c287aa82-1100-4c72-b927-3b8d47a88a15:3644:1876180417507328:0@lo:400:kworker.0 00000100:00100000:2.0:1789265346.569718:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180417507200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6578us (7041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265346.569737:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789265346.572426:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417507200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265346.572895:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417507456 00000100:00100000:0.0:1789265346.572905:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417507456 00000100:00100000:0.0:1789265346.574321:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789265346.574345:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417507456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265346.574493:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417507456:12345-0@lo:400:kworker.0 Request processed in 159us (10579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265346.574502:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789265346.576474:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417507456:0@lo:400:kworker.0 00000100:00100000:1.0:1789265346.579172:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180417507968:0@lo:400:kworker.0 00000100:00100000:1.0:1789265346.579278:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265346.579338:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180417508480:0@lo:400:kworker.0 00000100:00100000:1.0:1789265346.579368:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265346.579395:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417507968 00000100:00100000:1.0:1789265346.579399:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789265346.579405:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417507968 00000100:00100000:1.0:1789265346.579405:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417507840:0@lo:400:kworker.0 00000100:00100000:3.0:1789265346.579467:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417508480 00000100:00100000:3.0:1789265346.579471:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417508480 00000100:00100000:1.0:1789265346.579473:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265346.579490:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417507840 00000100:00100000:1.0:1789265346.579491:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417508352:0@lo:400:kworker.0 00000100:00100000:3.0:1789265346.579492:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417507840 00000100:00100000:3.0:1789265346.579508:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789265346.579517:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180417507968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265346.579525:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265346.579576:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417508352 00000100:00100000:1.0:1789265346.579589:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417508352 00000100:00100000:3.0:1789265346.579590:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180417507968:12345-0@lo:400:kworker.0 Request processed in 64us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265346.579607:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789265346.579629:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1789265346.579635:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180417508480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265346.579664:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180417508480:12345-0@lo:400:kworker.0 Request processed in 30us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265346.579670:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1789265346.579683:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1789265346.579688:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417507840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265346.579714:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417507840:12345-0@lo:400:kworker.0 Request processed in 26us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265346.579727:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1789265346.579856:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789265346.579866:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417508352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265346.579911:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417508352:12345-0@lo:400:kworker.0 Request processed in 47us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265346.579918:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789265346.579963:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417507840:0@lo:400:kworker.0 00000100:00100000:1.0:1789265346.579974:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417508352:0@lo:400:kworker.0 00000100:00100000:1.0:1789265346.579983:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180417507968:0@lo:400:kworker.0 00000100:00100000:1.0:1789265346.579994:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180417508480:0@lo:400:kworker.0 00000100:00100000:1.0:1789265346.580077:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417507712:0@lo:400:kworker.0 00000100:00100000:1.0:1789265346.580124:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265346.580153:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417508224:0@lo:400:kworker.0 00000100:00100000:1.0:1789265346.580175:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265346.580194:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789265346.580200:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417508096:0@lo:400:kworker.0 00000100:00100000:1.0:1789265346.580221:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265346.580237:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417508608:0@lo:400:kworker.0 00000100:00100000:1.0:1789265346.580258:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265346.580480:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417508096 00000100:00100000:2.0:1789265346.580485:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417508096 00000100:00100000:2.0:1789265346.580521:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417508608 00000100:00100000:2.0:1789265346.580525:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417508608 00000100:00100000:2.0:1789265346.580557:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789265346.580564:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417508096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265346.580634:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417508096:12345-0@lo:400:kworker.0 Request processed in 66us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265346.580640:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789265346.580658:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789265346.580664:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876180417508608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265346.580688:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876180417508608:12345-0@lo:400:kworker.0 Request processed in 25us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265346.581163:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00080000:0.0:1789265346.581384:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789265346.581394:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265346.581397:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265346.581417:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417508224 00000100:00100000:0.0:1789265346.581423:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417508224 00000100:00100000:0.0:1789265346.581491:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789265346.581499:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417508224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265346.581568:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417508224:12345-0@lo:400:kworker.0 Request processed in 70us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265346.581577:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:1.0:1789265346.581948:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83dd8000 x1876180417508096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265346.581967:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417508096:0@lo:400:kworker.0 00010000:00080000:1.0:1789265346.581980:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83ddad80 x1876180417508608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265346.581989:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417508608:0@lo:400:kworker.0 00000100:00100000:1.0:1789265346.582001:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417508224:0@lo:400:kworker.0 00000100:00100000:3.0:1789265346.582209:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417507712 00000100:00100000:3.0:1789265346.582215:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417507712 00000100:00100000:3.0:1789265346.582254:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789265346.582262:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417507712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265346.582314:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417507712:12345-0@lo:400:kworker.0 Request processed in 53us (2189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265346.582320:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:2.0:1789265346.582850:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265346.583445:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417507712:0@lo:400:kworker.0 00000100:00100000:0.0:1789265346.615284:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265346.615574:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399593088 00000100:00100000:2.0:1789265346.615588:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399593088 00000100:00100000:2.0:1789265346.615689:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 55 00000100:00100000:2.0:1789265346.615699:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+31:11159:x1876180399593088:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1789265346.615732:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265346.615762:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692c00/0x9272d942b4a96a40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbde3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265346.615912:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789265346.616095:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692c00/0x9272d942b4a96a40 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbde3 expref: 33 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.616112:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcca967b300) 00010000:00010000:2.0:1789265346.616115:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265346.616120:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692c00/0x9272d942b4a96a40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbde3 expref: 33 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.616138:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81692c00, rc 0) 00000100:00100000:2.0:1789265346.616219:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+32:11159:x1876180399593088:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 521us (950us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1789265346.616229:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 55 00000100:00100000:0.0:1789265346.619915:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265346.620119:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399593216 00000100:00100000:2.0:1789265346.620132:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399593216 00000100:00100000:2.0:1789265346.620212:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 56 00000100:00100000:2.0:1789265346.620223:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+32:11159:x1876180399593216:12345-192.168.203.49@tcp:34:lfs.0 00010000:00010000:2.0:1789265346.620327:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a96a4e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.620350:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a96a4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.620387:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a96a4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.620403:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96a55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.620410:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96a55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.620417:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96a55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.620728:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96a5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.620739:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96a5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.620746:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96a5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265346.620810:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96a5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.620827:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a96a4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.620834:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a96a4e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.620842:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a96a4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.620859:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81692600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265346.620864:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a96a4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.620872:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a96a4e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.620897:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:2.0:1789265346.620900:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265346.620906:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a96a4e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.620913:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a96a4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.620930:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96a55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.620937:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96a55 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.620943:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96a55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.620948:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520aa00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265346.620951:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96a55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.620958:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96a55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.620975:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fcca967bd00) 00010000:00010000:2.0:1789265346.620978:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265346.620981:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96a55 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.620986:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96a55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.620996:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96a5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.621002:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96a5c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.621007:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96a5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.621012:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520b600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265346.621014:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96a5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.621324:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96a5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.621338:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:2.0:1789265346.621340:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265346.621344:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96a5c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.621350:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96a5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265346.621692:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+32:11159:x1876180399593216:12345-192.168.203.49@tcp:34:lfs.0 Request processed in 1466us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265346.621704:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 56 00000100:00100000:1.0:1789265346.624193:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265346.624268:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399593472 00000100:00100000:3.0:1789265346.624280:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399593472 00000100:00100000:3.0:1789265346.624364:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 10 00000100:00100000:3.0:1789265346.624375:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+32:11159:x1876180399593472:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:3.0:1789265346.624814:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+33:11159:x1876180399593472:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 438us (629us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1789265346.624822:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 10 00000100:00100000:0.0:1789265346.672194:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265346.672293:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399593728 00000100:00100000:3.0:1789265346.672306:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399593728 00000100:00100000:3.0:1789265346.672384:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 57 00000100:00100000:3.0:1789265346.672396:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+33:11162:x1876180399593728:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1789265346.672428:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265346.672742:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96a63 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbdea expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.672840:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96a6a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.672860:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96a6a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.672875:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96a6a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.672898:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96a71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.672907:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96a71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.672913:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96a71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.673069:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96a78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.673078:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96a78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.673084:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96a78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265346.673111:0:8459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789265346.673213:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96a6a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.673221:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96a6a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.673228:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96a6a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.673235:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520aa00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265346.673240:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96a6a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.673249:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96a6a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.673263:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:2.0:1789265346.673266:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265346.673271:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96a6a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.673277:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96a6a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.673292:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96a71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.673299:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96a71 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.673315:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96a71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.673321:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520ac00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265346.673324:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96a71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.673330:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96a71 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.673338:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fcca967bd00) 00010000:00010000:2.0:1789265346.673340:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265346.673343:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96a71 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.673349:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96a71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.673391:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96a63 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdea expref: 36 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.673404:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96a78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdea expref: 35 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.673411:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:2.0:1789265346.673413:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265346.673415:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520b800, rc 0) 00000100:00100000:2.0:1789265346.673672:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+35:11162:x1876180399593728:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 1276us (1491us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789265346.673693:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 57 00000100:00100000:0.0:1789265346.676873:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265346.676975:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399593856 00000100:00100000:2.0:1789265346.676989:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399593856 00000100:00100000:2.0:1789265346.677097:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 58 00000100:00100000:2.0:1789265346.677109:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+35:11162:x1876180399593856:12345-192.168.203.49@tcp:54:lfs.0 00010000:00010000:2.0:1789265346.677210:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96a86 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.677231:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96a86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.677245:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96a86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.677291:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96a86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.677299:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96a86 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.677307:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96a86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.677313:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520a600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265346.677318:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96a86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.677326:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96a86 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.677340:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:2.0:1789265346.677360:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265346.677367:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96a86 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.677374:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96a86 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265346.677476:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+35:11162:x1876180399593856:12345-192.168.203.49@tcp:54:lfs.0 Request processed in 367us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265346.677485:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 58 00000100:00100000:1.0:1789265346.679961:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265346.680214:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399594112 00000100:00100000:2.0:1789265346.680226:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399594112 00000100:00100000:2.0:1789265346.680338:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 11 00000100:00100000:2.0:1789265346.680351:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+35:11162:x1876180399594112:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:2.0:1789265346.680680:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+36:11162:x1876180399594112:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 330us (731us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789265346.680689:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 11 00010000:00010000:1.0:1789265346.883546:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265346.896711:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265346.897003:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399594368 00000100:00100000:2.0:1789265346.897016:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399594368 00000100:00100000:2.0:1789265346.897154:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 59 00000100:00100000:2.0:1789265346.897166:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+36:11193:x1876180399594368:12345-192.168.203.49@tcp:101:cat.0 00010000:00010000:2.0:1789265346.897201:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265346.897230:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96a8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbdf1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.897360:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96a94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.897376:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96a94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.897408:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96a94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265346.897423:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789265346.897594:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96a8d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdf1 expref: 39 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.897616:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96a94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdf1 expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.897626:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:2.0:1789265346.897629:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265346.897634:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520b600, rc 0) 00000100:00100000:2.0:1789265346.897717:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+38:11193:x1876180399594368:12345-192.168.203.49@tcp:101:cat.0 Request processed in 553us (1020us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789265346.897725:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 59 00000100:00100000:0.0:1789265346.900986:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265346.901087:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265346.901145:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399594752 00000100:00100000:2.0:1789265346.901159:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399594752 00000100:00100000:3.0:1789265346.901181:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399594624 00000100:00100000:3.0:1789265346.901188:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399594624 00000100:00100000:3.0:1789265346.901242:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 12 00000100:00100000:3.0:1789265346.901254:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+39:11193:x1876180399594624:12345-192.168.203.49@tcp:35:cat.0 00000100:00100000:2.0:1789265346.901284:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 4 00000100:00100000:2.0:1789265346.901294:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+39:2395:x1876180399594752:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265346.901312:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265346.901346:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96a94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdf1 expref: 39 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.901368:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:2.0:1789265346.901373:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265346.901465:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+38:2395:x1876180399594752:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 172us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265346.901473:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 4 00000100:00100000:3.0:1789265346.901761:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+38:11193:x1876180399594624:12345-192.168.203.49@tcp:35:cat.0 Request processed in 508us (790us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1789265346.901777:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 12 00000100:00100000:0.0:1789265346.997634:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265346.997787:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399595008 00000100:00100000:2.0:1789265346.997801:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399595008 00000100:00100000:2.0:1789265346.997880:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 60 00000100:00100000:2.0:1789265346.997901:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+38:11199:x1876180399595008:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:2.0:1789265346.997933:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265346.997937:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789265346.997971:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a969fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdc7 expref: 38 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.997995:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:2.0:1789265346.998000:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265346.998017:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96aa2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbdf8 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.998268:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96aa9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.998285:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96a78 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdea expref: 38 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.998295:0:8459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96aa9 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.998338:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96a78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdea expref: 38 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.998382:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96a78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdea expref: 38 pid: 8459 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265346.998399:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8459:1876180417508736:192.168.203.49@tcp:104: 00000100:00100000:2.0:1789265346.998539:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265347.006429:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265347.006542:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399595136 00000100:00100000:1.0:1789265347.006558:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399595136 00010000:00010000:1.0:1789265347.006650:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96a78 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdea expref: 39 pid: 8459 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265347.006707:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 55 00000100:00100000:1.0:1789265347.006719:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc812ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+39:2395:x1876180399595136:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265347.006746:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265347.006754:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96a78 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdea expref: 39 pid: 8459 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.006769:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96a78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdea expref: 39 pid: 8459 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.006799:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:1.0:1789265347.006805:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96aa9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.006815:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96aa9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.006824:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96aa9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.006846:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265347.006924:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc812ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+39:2395:x1876180399595136:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 208us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265347.006933:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 55 00000100:00080000:0.0:1789265347.007142:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789265347.008854:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96a78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdea expref: 38 pid: 8459 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265347.008899:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8459:1876180417508736:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265347.008936:0:8459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96aa9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.008948:0:8459:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96aa9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.008955:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96aa9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265347.008981:0:8459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789265347.009630:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96aa2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdf8 expref: 39 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.009654:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96aa9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdf8 expref: 38 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.009664:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:2.0:1789265347.009799:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789265347.009803:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520a600, rc 0) 00000100:00100000:2.0:1789265347.009962:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+38:11199:x1876180399595008:12345-192.168.203.49@tcp:101:dd.0 Request processed in 12061us (12338us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789265347.009972:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 60 00000100:00100000:0.0:1789265347.013345:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265347.013485:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399595264 00000100:00100000:3.0:1789265347.013499:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399595264 00000100:00100000:3.0:1789265347.013562:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 61 00000100:00100000:3.0:1789265347.013585:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc812a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+38:11199:x1876180399595264:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:3.0:1789265347.013610:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265347.013632:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a96ab7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbdff expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.013669:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6200/0x9272d942b4a96abe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.013685:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6200/0x9272d942b4a96abe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.013698:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6200/0x9272d942b4a96abe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.013829:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a96ab7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdff expref: 40 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.013850:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6200/0x9272d942b4a96abe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdff expref: 39 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.013859:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:3.0:1789265347.013862:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789265347.013865:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6200, rc 0) 00000100:00100000:3.0:1789265347.013954:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc812a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+39:11199:x1876180399595264:12345-192.168.203.49@tcp:101:dd.0 Request processed in 382us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265347.013969:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 61 00000100:00100000:0.0:1789265347.017600:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265347.027401:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399595520 00000100:00100000:2.0:1789265347.027421:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399595520 00000100:00100000:2.0:1789265347.027519:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 62 00000100:00100000:2.0:1789265347.027532:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+39:11199:x1876180399595520:12345-192.168.203.49@tcp:36:dd.0 00010000:00010000:3.0:1789265347.028847:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a96ac5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.028876:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a96ac5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.028900:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a96ac5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789265347.028960:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1789265347.028988:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f73a19af reply state 000000001ccc4467 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a96ac5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.029001:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a96ac5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.029010:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:3.0:1789265347.029013:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789265347.029017:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265347.029314:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+42:11199:x1876180399595520:12345-192.168.203.49@tcp:36:dd.0 Request processed in 1780us (11724us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1789265347.029324:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 62 00000020:00080000:3.0:1789265347.029331:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789265347.450300:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265347.450627:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399595648 00000100:00100000:2.0:1789265347.450640:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399595648 00000100:00100000:2.0:1789265347.450719:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 63 00000100:00100000:2.0:1789265347.450732:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc812a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+42:11213:x1876180399595648:12345-192.168.203.49@tcp:101:stat.0 00010000:00010000:2.0:1789265347.450761:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265347.450788:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96acc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbe06 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.450873:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96ad3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.450902:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96ad3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.450917:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96ad3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.450929:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96ada lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.450958:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96ada lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.450966:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96ada lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.451098:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96ae1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.451111:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96aa9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdf8 expref: 43 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.451120:0:8459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96ae1 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.451174:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96aa9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdf8 expref: 43 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.451191:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96aa9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdf8 expref: 43 pid: 8459 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265347.451207:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8459:1876180417508864:192.168.203.49@tcp:104: 00000100:00100000:2.0:1789265347.451326:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265347.454759:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265347.455395:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8459:1876180417508864:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265347.455435:0:8459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96ae1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265347.456200:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399595904 00000100:00100000:1.0:1789265347.456213:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399595904 00000100:00100000:1.0:1789265347.456300:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 13 00000100:00100000:1.0:1789265347.456311:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc812abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+44:6160:x1876180399595904:12345-192.168.203.49@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789265347.457326:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc812abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+45:6160:x1876180399595904:12345-192.168.203.49@tcp:35:ldlm_bl.0 Request processed in 1008us (2573us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1789265347.457338:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 13 00000100:00100000:1.0:1789265347.462656:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265347.462796:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399596032 00000100:00100000:0.0:1789265347.462813:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399596032 00010000:00010000:0.0:1789265347.462876:0:7926:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96aa9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdf8 expref: 45 pid: 8459 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265347.462945:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 56 00000100:00100000:0.0:1789265347.462959:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+45:2395:x1876180399596032:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265347.462981:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265347.462991:0:7926:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96aa9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdf8 expref: 45 pid: 8459 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.463008:0:7926:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96aa9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdf8 expref: 45 pid: 8459 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.463101:0:7926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96aa9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdf8 expref: 45 pid: 8459 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.464801:0:7926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:0.0:1789265347.464820:0:7926:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96ae1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.464838:0:7926:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.464848:0:7926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96ae1 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.464916:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265347.465016:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+44:2395:x1876180399596032:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 2056us (2366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265347.465054:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 56 00010000:00010000:2.0:1789265347.465822:0:8459:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.465861:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265347.465954:0:8459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789265347.465960:0:8459:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265347.466103:0:8459:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.466132:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.466146:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96ad3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.466154:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96ad3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.466161:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.466168:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520b800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265347.466173:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.466181:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96ad3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.466200:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:2.0:1789265347.466204:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265347.466209:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96ad3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.466228:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96ad3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.466248:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96ada lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.466254:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96ada lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.466262:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96ada lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.466268:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520ac00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265347.466272:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96ada lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.466297:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96ada lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.466307:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fcca967bd00) 00010000:00010000:2.0:1789265347.466310:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265347.466314:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96ada lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.466320:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96ada lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.466369:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96acc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe06 expref: 44 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.466392:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96ae1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe06 expref: 43 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.466416:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:2.0:1789265347.466419:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265347.466422:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520aa00, rc 0) 00000100:00100000:2.0:1789265347.466491:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc812a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+43:11213:x1876180399595648:12345-192.168.203.49@tcp:101:stat.0 Request processed in 15760us (16205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265347.466501:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 63 00000100:00100000:1.0:1789265347.573293:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265347.573665:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399596288 00000100:00100000:3.0:1789265347.573680:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399596288 00000100:00100000:3.0:1789265347.573756:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 64 00000100:00100000:3.0:1789265347.573767:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+43:11219:x1876180399596288:12345-192.168.203.49@tcp:36:truncate.0 00010000:00010000:3.0:1789265347.573848:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265347.574067:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96ae1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe06 expref: 43 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.574114:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:3.0:1789265347.574120:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265347.575232:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a96ae8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.575259:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a96ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.575272:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a96ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789265347.575365:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1789265347.575403:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005626cf0e reply state 00000000cf71b308 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a96ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.575419:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a96ae8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.575433:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:3.0:1789265347.575436:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789265347.575440:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265347.575619:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+45:11219:x1876180399596288:12345-192.168.203.49@tcp:36:truncate.0 Request processed in 1851us (2348us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1789265347.575630:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 64 00000020:00080000:3.0:1789265347.575636:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789265347.766892:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265347.767000:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399596416 00000100:00100000:3.0:1789265347.767013:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399596416 00000100:00100000:0.0:1789265347.767298:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 65 00000100:00100000:0.0:1789265347.767312:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc812a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+45:11233:x1876180399596416:12345-192.168.203.49@tcp:101:stat.0 00010000:00010000:0.0:1789265347.767355:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265347.767381:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96aef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbe0d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.767476:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a96af6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.767493:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a96af6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.767523:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a96af6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.767537:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5c00/0x9272d942b4a96afd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.767545:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5c00/0x9272d942b4a96afd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.767551:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5c00/0x9272d942b4a96afd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.767653:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96b04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.767663:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96b04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.767671:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96b04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265347.767725:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1789265347.767730:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265347.767757:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96b04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.767770:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96b04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.767780:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a96af6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.767797:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a96af6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.767805:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a96af6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.767812:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265347.767817:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a96af6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.767825:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a96af6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.767839:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:0.0:1789265347.767842:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265347.767847:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a96af6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.767854:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a96af6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.767872:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5c00/0x9272d942b4a96afd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.767890:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5c00/0x9272d942b4a96afd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.767896:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5c00/0x9272d942b4a96afd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.767902:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5c00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265347.767911:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5c00/0x9272d942b4a96afd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.767918:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5c00/0x9272d942b4a96afd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.767927:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fcca967bd00) 00010000:00010000:0.0:1789265347.767930:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265347.767933:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5c00/0x9272d942b4a96afd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.767938:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5c00/0x9272d942b4a96afd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.767985:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96aef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe0d expref: 47 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.768000:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96b04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe0d expref: 46 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.768008:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:0.0:1789265347.768010:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265347.768013:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5e00, rc 0) 00000100:00100000:0.0:1789265347.768157:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc812a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+46:11233:x1876180399596416:12345-192.168.203.49@tcp:101:stat.0 Request processed in 847us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265347.768166:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 65 00000100:00100000:0.0:1789265347.901239:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265347.901526:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399596672 00000100:00100000:3.0:1789265347.901540:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399596672 00000100:00100000:3.0:1789265347.901620:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 66 00000100:00100000:3.0:1789265347.901652:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+46:11243:x1876180399596672:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1789265347.901680:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265347.901706:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a96b0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbe14 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265347.902534:0:8459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789265347.902683:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a96b0b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe14 expref: 48 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.902702:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcca967b300) 00010000:00010000:3.0:1789265347.902705:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265347.902711:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a96b0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe14 expref: 48 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.902728:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b7000, rc 0) 00000100:00100000:3.0:1789265347.902959:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+47:11243:x1876180399596672:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 1309us (1733us total) trans 4294967341 rc 301/301 00000100:00100000:3.0:1789265347.902968:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 66 00010000:00010000:0.0:1789265347.906929:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265347.913304:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265347.913553:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399596928 00000100:00100000:3.0:1789265347.913567:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399596928 00000100:00100000:3.0:1789265347.913645:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 14 00000100:00100000:3.0:1789265347.913657:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+47:11243:x1876180399596928:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:3.0:1789265347.914533:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+48:11243:x1876180399596928:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 868us (1234us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1789265347.914547:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 14 00000100:00100000:1.0:1789265347.979660:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265347.979758:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399597184 00000100:00100000:3.0:1789265347.979790:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399597184 00000100:00100000:3.0:1789265347.979875:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 67 00000100:00100000:3.0:1789265347.979894:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+48:11250:x1876180399597184:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1789265347.979926:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265347.979952:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a96b19 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbe1b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.980127:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96b20 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.980145:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96b04 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe0d expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.980156:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96b20 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.980198:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96b04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe0d expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.980213:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96b04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe0d expref: 49 pid: 6518 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265347.980229:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83ddb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876180417508992:192.168.203.49@tcp:104: 00000100:00100000:3.0:1789265347.980334:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc99449f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265347.984283:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83ddb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876180417508992:192.168.203.49@tcp:104: 00010000:00010000:3.0:1789265347.984325:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96b20 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265347.986682:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265347.987109:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399597312 00000100:00100000:0.0:1789265347.987125:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399597312 00010000:00010000:0.0:1789265347.987208:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96b04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe0d expref: 50 pid: 6518 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265347.987256:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 57 00000100:00100000:0.0:1789265347.987267:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb09a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+50:2395:x1876180399597312:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265347.987287:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265347.987295:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96b04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe0d expref: 50 pid: 6518 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.987311:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96b04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe0d expref: 50 pid: 6518 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.987341:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96b04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe0d expref: 50 pid: 6518 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.987361:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:0.0:1789265347.987367:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96b20 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.987379:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96b20 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.987387:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96b20 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.987422:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265347.987508:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb09a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+49:2395:x1876180399597312:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 243us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265347.987516:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 57 00010000:00010000:3.0:1789265347.987651:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96b20 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.987669:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96b20 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265347.987692:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1789265347.987864:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a96b19 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe1b expref: 50 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.987894:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96b20 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe1b expref: 49 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.987902:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:3.0:1789265347.987905:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789265347.987908:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6a00, rc 0) 00000100:00100000:3.0:1789265347.987944:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+49:11250:x1876180399597184:12345-192.168.203.49@tcp:101:bash.0 Request processed in 8052us (8297us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1789265347.987952:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 67 00000100:00100000:0.0:1789265347.993226:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265347.993412:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399597568 00000100:00100000:3.0:1789265347.993426:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399597568 00000100:00100000:3.0:1789265347.993518:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 68 00000100:00100000:3.0:1789265347.993532:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc812ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+49:11250:x1876180399597568:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:3.0:1789265347.993862:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a96b2e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.993893:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a96b2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.993909:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a96b2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789265347.994423:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1789265347.994631:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3e63f14 reply state 00000000b4835ae5 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a96b2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.994652:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a96b2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265347.994661:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:3.0:1789265347.994664:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789265347.994667:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265347.994804:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc812ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+52:11250:x1876180399597568:12345-192.168.203.49@tcp:36:bash.0 Request processed in 1271us (1989us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1789265347.994813:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 68 00000020:00080000:3.0:1789265347.994819:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789265348.008181:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265348.008433:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399597696 00000100:00100000:3.0:1789265348.008447:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399597696 00000100:00100000:3.0:1789265348.008661:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 69 00000100:00100000:3.0:1789265348.008675:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+52:11250:x1876180399597696:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1789265348.008710:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265348.008740:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc8152fc00/0x9272d942b4a96b35 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbe22 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.008871:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc8152ec00/0x9272d942b4a96b3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.008903:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96b20 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe1b expref: 53 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.008948:0:8459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc8152ec00/0x9272d942b4a96b3c lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.009242:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96b20 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe1b expref: 53 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.009259:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96b20 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe1b expref: 53 pid: 6516 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265348.009275:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83ddb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8459:1876180417509120:192.168.203.49@tcp:104: 00000100:00100000:3.0:1789265348.010907:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3ea600 going to sleep for 11 seconds 00000100:00100000:1.0:1789265348.027735:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265348.028058:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399597824 00000100:00100000:2.0:1789265348.028072:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399597824 00010000:00010000:2.0:1789265348.028132:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96b20 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe1b expref: 54 pid: 6516 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265348.028176:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 58 00000100:00100000:2.0:1789265348.028200:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+54:2396:x1876180399597824:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265348.028221:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265348.028230:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96b20 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe1b expref: 54 pid: 6516 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.028247:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96b20 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe1b expref: 54 pid: 6516 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.028280:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:2.0:1789265348.028287:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc8152ec00/0x9272d942b4a96b3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.028300:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc8152ec00/0x9272d942b4a96b3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.028336:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc8152ec00/0x9272d942b4a96b3c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.028363:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265348.028450:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+54:2396:x1876180399597824:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 262us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265348.028458:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 58 00010000:00010000:3.0:1789265348.030148:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96b20 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe1b expref: 53 pid: 6516 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265348.030181:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83ddb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8459:1876180417509120:192.168.203.49@tcp:104: 00010000:00010000:3.0:1789265348.030465:0:8459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc8152ec00/0x9272d942b4a96b3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.030478:0:8459:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc8152ec00/0x9272d942b4a96b3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.030485:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc8152ec00/0x9272d942b4a96b3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265348.030575:0:8459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789265348.030582:0:8459:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265348.030610:0:8459:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc8152ec00/0x9272d942b4a96b3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.030682:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc8152fc00/0x9272d942b4a96b35 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe22 expref: 53 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.030702:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc8152ec00/0x9272d942b4a96b3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe22 expref: 52 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.030712:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:3.0:1789265348.030715:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265348.030719:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc8152ec00, rc 0) 00000100:00100000:3.0:1789265348.030806:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+52:11250:x1876180399597696:12345-192.168.203.49@tcp:101:bash.0 Request processed in 22134us (22641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265348.030816:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 69 00000100:00100000:1.0:1789265348.034784:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265348.036332:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399598080 00000100:00100000:2.0:1789265348.036352:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399598080 00000100:00100000:2.0:1789265348.036900:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 15 00000100:00100000:2.0:1789265348.036915:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdcd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+52:11250:x1876180399598080:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:2.0:1789265348.037385:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdcd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+53:11250:x1876180399598080:12345-192.168.203.49@tcp:35:bash.0 Request processed in 471us (2612us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789265348.037396:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 15 00000100:00100000:0.0:1789265348.168204:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265348.168342:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399598336 00000100:00100000:3.0:1789265348.168354:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399598336 00000100:00100000:3.0:1789265348.168434:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 70 00000100:00100000:3.0:1789265348.168448:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc812a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+53:11260:x1876180399598336:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1789265348.168489:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265348.168518:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc8152fc00/0x9272d942b4a96b43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbe29 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265348.168653:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789265348.168785:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc8152fc00/0x9272d942b4a96b43 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe29 expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.168803:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcca967b300) 00010000:00010000:3.0:1789265348.168806:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265348.168842:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc8152fc00/0x9272d942b4a96b43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe29 expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.168862:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc8152fc00, rc 0) 00000100:00100000:3.0:1789265348.168954:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc812a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+54:11260:x1876180399598336:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 509us (764us total) trans 4294967347 rc 301/301 00000100:00100000:3.0:1789265348.168963:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 70 00000100:00100000:1.0:1789265348.173779:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265348.173944:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399598464 00000100:00100000:3.0:1789265348.173958:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399598464 00000100:00100000:3.0:1789265348.174064:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 71 00000100:00100000:3.0:1789265348.174077:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+54:11260:x1876180399598464:12345-192.168.203.49@tcp:34:lfs.0 00010000:00010000:3.0:1789265348.174175:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc8152fc00/0x9272d942b4a96b51 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.174199:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc8152fc00/0x9272d942b4a96b51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.174212:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc8152fc00/0x9272d942b4a96b51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.174226:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96b58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.174233:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96b58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.174239:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96b58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.174333:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96b5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.174366:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96b5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.174374:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96b5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265348.174434:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96b5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.174449:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc8152fc00/0x9272d942b4a96b51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.174809:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc8152fc00/0x9272d942b4a96b51 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.174817:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc8152fc00/0x9272d942b4a96b51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.174905:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc8152fc00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265348.174911:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc8152fc00/0x9272d942b4a96b51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.174920:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc8152fc00/0x9272d942b4a96b51 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.174936:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:3.0:1789265348.174939:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265348.174944:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc8152fc00/0x9272d942b4a96b51 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.174950:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc8152fc00/0x9272d942b4a96b51 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.174978:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96b58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.174984:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96b58 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.174989:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96b58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.174994:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6a00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265348.174997:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96b58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.175003:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96b58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.175011:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fcca967bd00) 00010000:00010000:3.0:1789265348.175014:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265348.175016:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96b58 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.175614:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a96b58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.175631:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96b5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.175637:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96b5f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.175643:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96b5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.175660:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81491600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265348.175664:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96b5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.175670:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96b5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.175681:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:3.0:1789265348.175683:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265348.175687:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96b5f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.175693:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96b5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265348.175895:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+54:11260:x1876180399598464:12345-192.168.203.49@tcp:34:lfs.0 Request processed in 1815us (2124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265348.175907:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 71 00000100:00100000:1.0:1789265348.184865:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265348.185077:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399598720 00000100:00100000:3.0:1789265348.185090:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399598720 00000100:00100000:3.0:1789265348.185163:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 16 00000100:00100000:3.0:1789265348.185175:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+54:11260:x1876180399598720:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:3.0:1789265348.186251:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+55:11260:x1876180399598720:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 1070us (1393us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1789265348.186264:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 16 00000100:00100000:0.0:1789265348.257331:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265348.257566:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399598976 00000100:00100000:3.0:1789265348.257636:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399598976 00000100:00100000:3.0:1789265348.257723:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 72 00000100:00100000:3.0:1789265348.257754:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc812ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+55:11263:x1876180399598976:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1789265348.257788:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265348.257817:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96b66 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbe30 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.257932:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96b6d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.257951:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96b6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.257967:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96b6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.257980:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96b74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.257988:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96b74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.257994:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96b74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.258774:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96b7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.258792:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96b7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.258802:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96b7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265348.258815:0:8459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789265348.258938:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96b6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.258946:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96b6d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.258971:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96b6d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.258977:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81491e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265348.258982:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96b6d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.258989:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96b6d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.259005:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:2.0:1789265348.259008:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265348.259013:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96b6d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.259020:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96b6d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.259205:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96b74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.259211:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96b74 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.259218:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96b74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.259222:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265348.259226:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96b74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.259243:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96b74 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.259252:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fcca967bd00) 00010000:00010000:2.0:1789265348.259254:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265348.259257:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96b74 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.259262:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96b74 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.259318:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96b66 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe30 expref: 58 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.259334:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96b7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe30 expref: 57 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.259341:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:2.0:1789265348.259343:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265348.259345:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520b600, rc 0) 00000100:00100000:2.0:1789265348.259775:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc812ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+57:11263:x1876180399598976:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 2022us (2458us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1789265348.259786:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 72 00000100:00100000:1.0:1789265348.267892:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265348.268135:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265348.268569:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399599232 00000100:00100000:3.0:1789265348.268582:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399599232 00000100:00100000:3.0:1789265348.268674:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5 00000100:00100000:3.0:1789265348.268687:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+57:2395:x1876180399599232:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265348.268708:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265348.268740:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96b7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe30 expref: 57 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.268786:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:3.0:1789265348.268793:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265348.268885:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+56:2395:x1876180399599232:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 192us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265348.268894:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5 00000100:00100000:0.0:1789265348.269760:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399599104 00000100:00100000:0.0:1789265348.269773:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399599104 00000100:00100000:0.0:1789265348.269833:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 73 00000100:00100000:0.0:1789265348.269844:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+56:11263:x1876180399599104:12345-192.168.203.49@tcp:54:lfs.0 00010000:00010000:0.0:1789265348.269933:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96b89 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.269965:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96b89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.269981:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96b89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.270054:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96b89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.270061:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96b89 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.270068:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96b89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.270074:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265348.270079:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96b89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.270098:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96b89 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.270129:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:0.0:1789265348.270132:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265348.270138:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96b89 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.270145:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96b89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265348.270218:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+56:11263:x1876180399599104:12345-192.168.203.49@tcp:54:lfs.0 Request processed in 376us (2352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265348.270226:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 73 00000100:00100000:1.0:1789265348.274568:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265348.274681:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399599488 00000100:00100000:3.0:1789265348.274695:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399599488 00000100:00100000:3.0:1789265348.274809:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 17 00000100:00100000:3.0:1789265348.274822:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+56:11263:x1876180399599488:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:3.0:1789265348.275562:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+57:11263:x1876180399599488:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 738us (1005us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1789265348.275572:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 17 00000100:00100000:3.0:1789265348.439180:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265348.439300:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399599744 00000100:00100000:0.0:1789265348.439313:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399599744 00000100:00100000:0.0:1789265348.439393:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 74 00000100:00100000:0.0:1789265348.439404:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83ddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+57:11281:x1876180399599744:12345-192.168.203.49@tcp:101:cat.0 00010000:00010000:0.0:1789265348.439541:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265348.439571:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96b90 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbe37 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.439726:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a96b97 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.439745:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a96b97 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.439758:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a96b97 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265348.439771:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789265348.439939:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96b90 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe37 expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.439991:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a96b97 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe37 expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.440002:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:0.0:1789265348.440005:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789265348.440009:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da4000, rc 0) 00000100:00100000:0.0:1789265348.440138:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83ddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+59:11281:x1876180399599744:12345-192.168.203.49@tcp:101:cat.0 Request processed in 735us (971us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1789265348.440147:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 74 00000100:00100000:0.0:1789265348.462549:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265348.462775:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399599872 00000100:00100000:2.0:1789265348.462861:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399599872 00000100:00100000:2.0:1789265348.462949:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 75 00000100:00100000:2.0:1789265348.462960:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc812ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+59:11282:x1876180399599872:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1789265348.463003:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265348.463093:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96ba5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbe3e expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.463247:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96bac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.463266:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96bac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.463279:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96bac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265348.463330:0:8459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789265348.463333:0:8459:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265348.463353:0:8459:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96bac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.463382:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96ba5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe3e expref: 61 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.463403:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96bac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe3e expref: 60 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.463412:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:2.0:1789265348.463528:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265348.463533:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520bc00, rc 0) 00000100:00100000:2.0:1789265348.463731:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc812ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+60:11282:x1876180399599872:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 772us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265348.463740:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 75 00000100:00100000:1.0:1789265348.470152:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265348.470312:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399600256 00000100:00100000:2.0:1789265348.470326:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399600256 00000100:00100000:2.0:1789265348.470400:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 18 00000100:00100000:2.0:1789265348.470412:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+60:11282:x1876180399600256:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:2.0:1789265348.471054:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+61:11282:x1876180399600256:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 609us (893us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1789265348.471066:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 18 00000100:00100000:3.0:1789265348.473664:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265348.473896:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399600384 00000100:00100000:2.0:1789265348.473910:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399600384 00000100:00100000:2.0:1789265348.473989:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 6 00000100:00100000:2.0:1789265348.474001:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+61:11282:x1876180399600384:12345-192.168.203.49@tcp:103:lfs.0 00010000:00010000:2.0:1789265348.474018:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789265348.474083:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc8152ec00/0x9272d942b4a96b3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe22 expref: 61 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.474115:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a96b97 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe37 expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.474128:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a96a39 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbddc expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.474208:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:2.0:1789265348.474215:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265348.474379:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+58:11282:x1876180399600384:12345-192.168.203.49@tcp:103:lfs.0 Request processed in 379us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265348.474385:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 6 00000100:00100000:0.0:1789265348.476085:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265348.476207:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399600512 00000100:00100000:1.0:1789265348.476217:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399600512 00000100:00100000:1.0:1789265348.476278:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 76 00000100:00100000:1.0:1789265348.476287:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc812aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+58:11282:x1876180399600512:12345-192.168.203.49@tcp:58:lfs.0 00010000:00010000:1.0:1789265348.476538:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96bb3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265348.476566:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96bb3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265348.476590:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96bb3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265348.477009:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265348.477214:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1789265348.477320:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1789265348.477431:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc812aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+58:11282:x1876180399600512:12345-192.168.203.49@tcp:58:lfs.0 Request processed in 1141us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265348.477441:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 76 00000100:00100000:1.0:1789265348.504372:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265348.504457:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399600640 00000100:00100000:0.0:1789265348.504471:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399600640 00000100:00100000:0.0:1789265348.504549:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 77 00000100:00100000:0.0:1789265348.504570:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+58:11284:x1876180399600640:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:0.0:1789265348.504604:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265348.504632:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96bba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbe45 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.504716:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bc1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.504735:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bc1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.504749:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bc1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.504781:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96bc8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.505206:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.505216:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.505353:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a96bcf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.505364:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a96bcf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.505372:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a96bcf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265348.506059:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789265348.506067:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265348.506096:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a96bcf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.506111:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a96bcf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.506121:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bc1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.506128:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bc1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.506514:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bc1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.506521:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265348.506527:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bc1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.506535:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bc1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.506550:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:0.0:1789265348.506684:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265348.506691:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bc1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.506698:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bc1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.506717:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.506723:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96bc8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.506729:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.506733:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265348.506736:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.506751:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96bc8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.506760:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fcca967bd00) 00010000:00010000:0.0:1789265348.506762:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265348.506765:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96bc8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.506771:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96bc8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.507379:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96bba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe45 expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.507402:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a96bcf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe45 expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.507411:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:0.0:1789265348.507425:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265348.507428:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da4c00, rc 0) 00000100:00100000:0.0:1789265348.507535:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+59:11284:x1876180399600640:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 2966us (3175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265348.507545:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 77 00000040:00080000:3.0:1789265348.804650:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789265348.804669:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789265348.804716:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789265348.804726:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789265348.804857:0:13799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dd8a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1876180417509248:192.168.203.49@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789265348.804951:0:13799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3eaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265348.812070:0:13799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dd8a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1876180417509248:192.168.203.49@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789265348.820986:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265348.821253:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399600768 00000100:00100000:3.0:1789265348.821264:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399600768 00000100:00100000:3.0:1789265348.821325:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 78 00000100:00100000:3.0:1789265348.821335:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+59:11295:x1876180399600768:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789265348.821380:0:8459:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789265348.821499:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+59:11295:x1876180399600768:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 Request processed in 166us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265348.821507:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 78 00000100:00100000:1.0:1789265348.831957:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265348.832161:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399600896 00000100:00100000:0.0:1789265348.832185:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399600896 00000100:00100000:0.0:1789265348.832267:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 79 00000100:00100000:0.0:1789265348.832281:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+59:11295:x1876180399600896:12345-192.168.203.49@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789265348.832385:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96bd6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.832406:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96bd6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.832434:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96bd6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.834639:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bdd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.834665:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bdd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.834678:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bdd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.834724:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96be4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.834735:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96be4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.834913:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96be4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265348.835020:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789265348.835040:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265348.835056:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96be4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.835071:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96bd6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.835292:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96bd6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.835300:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96bd6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.835367:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265348.835372:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96bd6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.835380:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96bd6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.835392:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fccbd2b4c00) 00010000:00010000:0.0:1789265348.835396:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265348.835400:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96bd6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.835406:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96bd6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.835422:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bdd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.835428:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bdd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.835434:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bdd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.835438:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265348.835447:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bdd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.835516:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bdd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.835525:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9fccacd51400) 00010000:00010000:0.0:1789265348.835528:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265348.835531:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bdd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.835537:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bdd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.835554:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96be4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.835560:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96be4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.835566:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96be4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.835572:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265348.835575:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96be4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.835581:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96be4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.835587:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:0.0:1789265348.835589:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265348.835598:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96be4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.835604:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96be4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265348.835694:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+59:11295:x1876180399600896:12345-192.168.203.49@tcp:34:lhsmtool_posix.0 Request processed in 3412us (3748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265348.835712:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 79 00000100:00100000:1.0:1789265348.841864:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265348.842220:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399601152 00000100:00100000:0.0:1789265348.842233:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399601152 00000100:00100000:0.0:1789265348.842312:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 80 00000100:00100000:0.0:1789265348.842323:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+59:11295:x1876180399601152:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265348.842358:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265348.842385:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96beb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbe4c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.842544:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bf2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.842563:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.842578:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265348.842591:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789265348.842701:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.842710:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bf2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.842735:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bf2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.842742:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265348.842747:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bf2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.842755:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bf2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.842769:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:0.0:1789265348.842772:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265348.842777:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bf2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.842783:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96bf2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.842835:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96beb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe4c expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.842847:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fccbd2b4c00) 00010000:00010000:0.0:1789265348.842849:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265348.842853:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96beb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe4c expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.842864:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5600, rc 0) 00000100:00100000:0.0:1789265348.842966:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+60:11295:x1876180399601152:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 644us (1117us total) trans 4294967353 rc 301/301 00000100:00100000:0.0:1789265348.842985:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 80 00000100:00100000:1.0:1789265348.850125:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265348.850601:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399601280 00000100:00100000:3.0:1789265348.850613:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399601280 00000100:00100000:3.0:1789265348.850687:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 81 00000100:00100000:3.0:1789265348.850700:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+60:11295:x1876180399601280:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789265348.850745:0:8459:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789265348.850906:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+60:11295:x1876180399601280:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 Request processed in 208us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265348.850915:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 81 00000040:00080000:1.0:1789265348.868016:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789265348.868781:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265348.869828:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399601536 00000100:00100000:1.0:1789265348.869844:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399601536 00000100:00100000:1.0:1789265348.869932:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 82 00000100:00100000:1.0:1789265348.869944:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+60:11295:x1876180399601536:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265348.869971:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265348.869974:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789265348.870007:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96bac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe3e expref: 60 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265348.870402:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:1.0:1789265348.870410:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265348.870501:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96c00 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbe53 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789265348.870993:0:6518:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1789265348.871651:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96c07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265348.871671:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96c07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265348.871693:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96c07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265348.871778:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96c00 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe53 expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265348.871800:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96c07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe53 expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265348.871810:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fccacd4e000) 00010000:00010000:1.0:1789265348.871813:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265348.871816:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fe400, rc 0) 00000100:00100000:1.0:1789265348.871921:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+61:11295:x1876180399601536:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 1979us (3147us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1789265348.871932:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 82 00000100:00100000:2.0:1789265348.880103:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265348.880183:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399601792 00000100:00100000:2.0:1789265348.880359:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399601792 00000100:00100000:2.0:1789265348.880426:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 83 00000100:00100000:2.0:1789265348.880436:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+61:11295:x1876180399601792:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789265348.880500:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265348.880543:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96c07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe53 expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.880563:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fccacd4e000) 00010000:00010000:2.0:1789265348.880572:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265348.880596:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96c15 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.880611:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96c15 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.880627:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96c15 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.880674:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96c1c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x63683d08 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.880682:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96c1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x63683d08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.880689:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96c1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x63683d08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.880729:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96c15 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.880747:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96c15 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.880754:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96c15 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.880759:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520a800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265348.880764:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96c15 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.880772:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96c15 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.880780:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:2.0:1789265348.880783:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265348.880786:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96c15 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.880791:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96c15 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.880802:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96c1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x63683d08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.880807:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96c1c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x63683d08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.880813:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96c1c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x63683d08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.880817:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520b800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265348.880827:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96c1c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x63683d08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.880833:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96c1c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x63683d08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.880841:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x63683d08 (ffff9fcb83b86e00) 00010000:00010000:2.0:1789265348.880843:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265348.880846:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96c1c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x63683d08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.880851:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96c1c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x63683d08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265348.880951:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+60:11295:x1876180399601792:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 Request processed in 516us (868us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789265348.880959:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 83 00000100:00100000:2.0:1789265348.884952:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265348.885376:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399601920 00000100:00100000:1.0:1789265348.885386:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399601920 00000100:00100000:1.0:1789265348.885483:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 84 00000100:00100000:1.0:1789265348.885494:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+60:11295:x1876180399601920:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265348.885514:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265348.885537:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96c23 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbe5a expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265348.885573:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96c2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265348.885587:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96c2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265348.885610:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96c2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265348.885713:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96c23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe5a expref: 62 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265348.885732:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96c2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe5a expref: 61 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265348.885740:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fccacd4ef00) 00010000:00010000:1.0:1789265348.885743:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789265348.885746:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fe000, rc 0) 00000100:00100000:1.0:1789265348.885804:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+61:11295:x1876180399601920:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 312us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265348.885812:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 84 00000100:00100000:3.0:1789265348.894918:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265348.895930:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399602176 00000100:00100000:0.0:1789265348.895948:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399602176 00000100:00100000:0.0:1789265348.896071:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 85 00000100:00100000:0.0:1789265348.896085:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+61:11295:x1876180399602176:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789265348.896231:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96c31 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.896255:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96c31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.896270:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96c31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789265348.896529:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1789265348.896541:0:6517:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 400126517136ns, next at 401126513816ns, rc = 0 00000004:00010000:0.0:1789265348.896622:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000217b79e5 reply state 00000000651ae9ec transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96c31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.896639:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96c31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.896649:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fccacd4ef00) 00010000:00010000:0.0:1789265348.896652:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789265348.896656:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789265348.896787:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+63:11295:x1876180399602176:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 Request processed in 704us (1882us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1789265348.896796:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 85 00000001:00080000:0.0:1789265348.906981:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00000004:00080000:0.0:1789265348.906997:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:0.0:1789265348.907091:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1789265348.907319:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a96975 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.907332:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a96975 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.907340:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a96975 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.907346:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265348.907351:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a96975 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.907378:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a96975 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.907396:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fcca967bf00) 00010000:00010000:2.0:1789265348.907399:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265348.907404:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a96975 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.907411:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a96975 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.907430:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a9697c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.907436:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a9697c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.907443:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a9697c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.907448:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6c00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265348.907452:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a9697c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.907458:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a9697c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.907465:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:2.0:1789265348.907467:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265348.907470:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a9697c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.907487:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a9697c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.907504:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a969bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.907510:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a969bb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.907516:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a969bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789265348.908268:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fcb838d89c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1789265348.908275:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fcb83b75700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fcb838d8d80 00000020:00080000:0.0:1789265348.908279:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fcb83b75800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fcc82baac00 00010000:00010000:2.0:1789265348.909103:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7c00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265348.909109:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a969bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909118:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a969bb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909142:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fcca967bd00) 00010000:00010000:2.0:1789265348.909145:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265348.909150:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a969bb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909156:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a969bb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909192:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a96ac5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909199:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a96ac5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909220:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a96ac5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909225:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265348.909227:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a96ac5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909233:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a96ac5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909242:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:2.0:1789265348.909245:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265348.909247:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a96ac5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909253:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a96ac5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909265:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a96ae8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909397:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a96ae8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909406:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a96ae8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909411:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265348.909414:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a96ae8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909431:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a96ae8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909440:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:2.0:1789265348.909442:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265348.909445:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a96ae8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909451:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a96ae8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909463:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a96b2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909469:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a96b2e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909474:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a96b2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909480:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265348.909483:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a96b2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909489:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a96b2e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909496:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:2.0:1789265348.909499:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265348.909501:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a96b2e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909626:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a96b2e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909642:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96c31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909647:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96c31 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909653:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96c31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909658:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265348.909662:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96c31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909668:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96c31 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909677:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fccacd4ef00) 00010000:00010000:2.0:1789265348.909679:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789265348.909682:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96c31 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.909687:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96c31 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265348.909978:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb838f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417509504:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789265348.909985:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc812a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417509376:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789265348.910065:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789265348.910292:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1789265348.910569:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1789265348.911014:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265348.912802:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417509376 00000100:00100000:3.0:1789265348.912823:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417509376 00000100:00100000:1.0:1789265348.912884:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265348.912928:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417509504 00000100:00100000:3.0:1789265348.912934:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417509504 00000100:00100000:3.0:1789265348.913249:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789265348.913263:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417509376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789265348.913308:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789265348.913328:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876180417509504:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789265348.913362:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1789265348.913395:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aa605c2, atime: 0x6aa605c3, ctime: 0x6aa605c2, blocks: 0x8 00010000:00010000:1.0:1789265348.913402:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc537cfd/0x9272d942b4a96c38 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265348.913418:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1789265348.913423:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265348.913429:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc537cfd/0x9272d942b4a96c38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265348.913464:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc537cfd/0x9272d942b4a96c38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265348.913477:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc537cfd/0x9272d942b4a96c38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265348.913485:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc537cfd/0x9272d942b4a96c38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265348.913508:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789265348.913628:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180417509376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 367us (3561us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789265348.913639:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1789265348.913681:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265348.913691:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc537cfd/0x9272d942b4a96c38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265348.913699:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3643:x1876180417509504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 377us (2684us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789265348.913716:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:3.0:1789265348.913731:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ffc00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265348.913738:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc537cfd/0x9272d942b4a96c38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.913751:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc537cfd/0x9272d942b4a96c38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.913780:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc537cfd/0x9272d942b4a96c38 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.913788:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc537cfd/0x9272d942b4a96c38 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.913811:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265348.913813:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265348.913815:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789265348.914060:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fcc812a8000/2, rc 0, transno 4294967302 00000100:00100000:2.0:1789265348.914078:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc812a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417509376:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789265348.914123:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399602304 00000100:00080000:0.0:1789265348.914224:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265348.914232:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789265348.914280:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fcb838f5c00/2, rc 0, transno 4294967302 00000100:00100000:0.0:1789265348.914289:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb838f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417509504:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789265348.914385:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399602304 00000100:00100000:2.0:1789265348.914475:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 86 00000100:00100000:2.0:1789265348.914485:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+12:11295:x1876180399602304:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265348.914500:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265348.914516:0:8460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96c3f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbe61 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.915420:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96c3f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe61 expref: 13 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.915436:0:8460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96c3f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe61 expref: 13 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265348.915454:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fccacd4ef00) 00010000:00010000:2.0:1789265348.915458:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265348.915461:0:8460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520b800, rc 0) 00000100:00100000:2.0:1789265348.915577:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+13:11295:x1876180399602304:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 1091us (2710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265348.915585:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 86 00000100:00100000:0.0:1789265348.925886:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265348.927235:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399602432 00000100:00100000:3.0:1789265348.927258:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399602432 00000100:00100000:3.0:1789265348.927325:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 34 00000100:00100000:3.0:1789265348.927553:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc812aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1876180399602432:12345-192.168.203.49@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789265348.927631:0:8435:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp t0 exp 0000000000000000 cur 400 last 0 00000020:00000080:3.0:1789265348.927689:0:8435:0:(genops.c:1385:class_connect()) connect: client 5b43750b-84cf-4d62-9028-e016267b6509, cookie 0x9272d942b4a96c46 00002000:00100000:3.0:1789265348.927706:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5b43750b-84cf-4d62-9028-e016267b6509/ffff9fccbf558000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789265348.927729:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789265348.927812:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789265348.927852:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9fccbf55d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265348.928090:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc812aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+6:2392:x1876180399602432:12345-192.168.203.49@tcp:8:lhsmtool_posix.0 Request processed in 754us (2230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265348.928099:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 34 00010000:00010000:0.0:1789265348.931607:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265348.934905:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265348.934983:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399602560 00000100:00100000:1.0:1789265348.934999:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399602560 00000100:00100000:1.0:1789265348.935101:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 35 00000100:00100000:1.0:1789265348.935111:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+6:0:x1876180399602560:12345-192.168.203.49@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789265348.935199:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789265348.942350:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00100000:2.0:1789265348.942373:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5b43750b-84cf-4d62-9028-e016267b6509 00000001:00080000:2.0:1789265348.942381:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1789265348.943469:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:0:x1876180399602560:12345-192.168.203.49@tcp:2:lhsmtool_posix.0 Request processed in 8348us (8566us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789265348.943482:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 35 00000100:00100000:3.0:1789265348.954914:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265348.955053:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399602816 00000100:00100000:2.0:1789265348.955067:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399602816 00000100:00100000:2.0:1789265348.955152:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 19 00000100:00100000:2.0:1789265348.955165:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+13:11295:x1876180399602816:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789265348.956494:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+14:11295:x1876180399602816:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 Request processed in 1319us (1583us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1789265348.956510:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 19 00000100:00100000:2.0:1789265348.961384:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265348.961440:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399603072 00000100:00100000:2.0:1789265348.961453:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399603072 00000100:00100000:2.0:1789265348.961520:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 87 00000100:00100000:2.0:1789265348.961530:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+14:11295:x1876180399603072:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789265348.961669:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+14:11295:x1876180399603072:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 Request processed in 139us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265348.961692:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 87 00000100:00100000:1.0:1789265348.965362:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265348.965438:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399603200 00000100:00100000:3.0:1789265348.965455:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399603200 00000100:00100000:3.0:1789265348.965583:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 88 00000100:00100000:3.0:1789265348.965596:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+14:11295:x1876180399603200:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265348.965621:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265348.965649:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96c4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbe68 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.965784:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96c54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.965800:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96c54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.965813:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96c54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265348.965879:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265348.965903:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96c54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.965931:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96c4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe68 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.965967:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96c54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe68 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265348.965977:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fccacd4ef00) 00010000:00010000:3.0:1789265348.965980:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789265348.965983:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81490400, rc 0) 00000100:00100000:3.0:1789265348.966103:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+15:11295:x1876180399603200:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 509us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265348.966111:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 88 00000100:00100000:3.0:1789265348.971743:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265348.972412:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399603328 00000100:00100000:0.0:1789265348.972428:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399603328 00000100:00100000:0.0:1789265348.972496:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 36 00000100:00100000:0.0:1789265348.972507:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399603328:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265348.972538:0:8914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265348.972565:0:8914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001972dff4/0x9272d942b4a96c5b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbe6f expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789265348.972589:0:8914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa605c5, blocks: 0x0 00010000:00010000:0.0:1789265348.972608:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1789265348.972614:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265348.972623:0:8914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001972dff4/0x9272d942b4a96c5b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe6f expref: 6 pid: 8914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.972656:0:8914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001972dff4/0x9272d942b4a96c5b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe6f expref: 6 pid: 8914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.972668:0:8914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5600, rc 0) 00000100:00100000:0.0:1789265348.972732:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+6:2396:x1876180399603328:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 229us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265348.972739:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 36 00000100:00100000:2.0:1789265348.983117:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265348.983243:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399603584 00000100:00100000:3.0:1789265348.983256:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399603584 00000100:00100000:3.0:1789265348.983428:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 89 00000100:00100000:3.0:1789265348.983440:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+15:11295:x1876180399603584:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789265348.983588:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+15:11295:x1876180399603584:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 Request processed in 149us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265348.983599:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 89 00000100:00100000:3.0:1789265348.996952:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265348.997118:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399603712 00000100:00100000:0.0:1789265348.997133:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399603712 00000100:00100000:0.0:1789265348.997219:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 37 00000100:00100000:0.0:1789265348.997232:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+6:11295:x1876180399603712:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265348.997257:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265348.997282:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096eac9fc/0x9272d942b4a96c62 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbe76 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.997325:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001972dff4/0x9272d942b4a96c5b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe6f expref: 7 pid: 8914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.997334:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265348.997340:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265348.997346:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096eac9fc/0x9272d942b4a96c62 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe76 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.997388:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001972dff4/0x9272d942b4a96c5b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe6f expref: 7 pid: 8914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265348.997415:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001972dff4/0x9272d942b4a96c5b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe6f expref: 7 pid: 8914 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265348.997434:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc812aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1876180417509632:192.168.203.49@tcp:104: 00000100:00100000:0.0:1789265348.997543:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cb40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265349.007994:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc812aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1876180417509632:192.168.203.49@tcp:104: 00010000:00010000:0.0:1789265349.008060:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000096eac9fc/0x9272d942b4a96c62 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe76 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.008089:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da4000, rc 0) 00000100:00100000:0.0:1789265349.008162:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+7:11295:x1876180399603712:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 10932us (11224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265349.008171:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 37 00000100:00100000:2.0:1789265349.008716:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265349.010259:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399603840 00000100:00100000:0.0:1789265349.010279:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399603840 00010000:00010000:0.0:1789265349.010339:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001972dff4/0x9272d942b4a96c5b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe6f expref: 7 pid: 8914 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265349.010561:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 59 00000100:00100000:0.0:1789265349.010577:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+7:2395:x1876180399603840:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265349.010600:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265349.010630:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001972dff4/0x9272d942b4a96c5b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe6f expref: 7 pid: 8914 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.010661:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001972dff4/0x9272d942b4a96c5b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe6f expref: 7 pid: 8914 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.010947:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001972dff4/0x9272d942b4a96c5b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe6f expref: 7 pid: 8914 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.011487:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265349.011492:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265349.011504:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000096eac9fc/0x9272d942b4a96c62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe76 expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.011515:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096eac9fc/0x9272d942b4a96c62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe76 expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.011572:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000096eac9fc/0x9272d942b4a96c62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe76 expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265349.011593:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc812aa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6502:1876180417509760:192.168.203.49@tcp:105: 00000100:00100000:0.0:1789265349.012132:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cb40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265349.034359:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265349.034468:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399603968 00000100:00100000:1.0:1789265349.034480:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399603968 00002000:00100000:1.0:1789265349.034540:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9fcb83d44a80 x1876180399603968/t0(0) o4->5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp:675/0 lens 504/0 e 0 to 0 dl 1789265360 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1789265349.034565:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc812aa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6502:1876180417509760:192.168.203.49@tcp:105: 00002000:00100000:1.0:1789265349.034569:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fcb83d44a80 with x1876180399603968 ext(0->8) 00002000:00010000:1.0:1789265349.034574:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fcb83d44a80 00010000:00010000:0.0:1789265349.034592:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265349.034613:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 0 00000100:00100000:1.0:1789265349.034622:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5b43750b-84cf-4d62-9028-e016267b6509+7:2396:x1876180399603968:12345-192.168.203.49@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789265349.034656:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+7:2395:x1876180399603840:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 24083us (25943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265349.034664:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 59 00000100:00100000:1.0:1789265349.045318:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5b43750b-84cf-4d62-9028-e016267b6509+8:2396:x1876180399603968:12345-192.168.203.49@tcp:4:lhsmtool_posix.0 Request processed in 10685us (10956us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789265349.045334:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 0 00002000:00100000:1.0:1789265349.045654:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9fcb83d44a80 x1876180399603968/t4294967304(0) o4->5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp:675/0 lens 504/448 e 0 to 0 dl 1789265360 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789265349.045664:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fcb83d44a80 with x1876180399603968 ext(0->8) 00002000:00010000:1.0:1789265349.045670:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fcb83d44a80 00000100:00100000:2.0:1789265349.054211:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265349.054311:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399604096 00000100:00100000:1.0:1789265349.054324:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399604096 00000100:00100000:1.0:1789265349.054418:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 90 00000100:00100000:1.0:1789265349.054429:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+15:11295:x1876180399604096:12345-192.168.203.49@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789265349.054620:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+15:11295:x1876180399604096:12345-192.168.203.49@tcp:44:lhsmtool_posix.0 Request processed in 192us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265349.054629:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 90 00000100:00080000:2.0:1789265349.054781:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265349.058080:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265349.058283:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399604224 00000100:00100000:2.0:1789265349.058301:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399604224 00000100:00100000:2.0:1789265349.058385:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 38 00000100:00100000:2.0:1789265349.058397:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+8:2395:x1876180399604224:12345-192.168.203.49@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789265349.062732:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000100:00100000:1.0:1789265349.063242:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399604224:12345-192.168.203.49@tcp:16:lhsmtool_posix.0 Request processed in 4840us (5175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265349.063254:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 38 00000100:00100000:0.0:1789265349.074781:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265349.074864:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399604480 00000100:00100000:3.0:1789265349.074887:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399604480 00000100:00100000:3.0:1789265349.074971:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 91 00000100:00100000:3.0:1789265349.074983:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc812aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+15:11295:x1876180399604480:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789265349.075095:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265349.075143:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96c54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe68 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.075187:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fccacd4ef00) 00010000:00010000:3.0:1789265349.075193:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265349.075233:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96c69 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.075249:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96c69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.075261:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96c69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265349.075438:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000049838e reply state 000000006df5392a transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96c69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.075452:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96c69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.075459:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fccacd4ef00) 00010000:00010000:3.0:1789265349.075462:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789265349.075465:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265349.075609:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc812aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+16:11295:x1876180399604480:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 Request processed in 626us (840us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1789265349.075617:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 91 00000100:00100000:1.0:1789265349.085286:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265349.087104:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399604608 00000100:00100000:1.0:1789265349.087117:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399604608 00000100:00100000:1.0:1789265349.087189:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 39 00000100:00100000:1.0:1789265349.087200:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399604608:12345-192.168.203.49@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789265349.087671:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789265349.087677:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789265348 00002000:00010000:1.0:1789265349.087682:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789265347 00002000:00010000:1.0:1789265349.087686:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789265349 -> 1789265348 00002000:00010000:1.0:1789265349.087690:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1789265349.087761:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+7:2395:x1876180399604608:12345-192.168.203.49@tcp:2:lhsmtool_posix.0 Request processed in 561us (2484us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789265349.087771:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 39 00000100:00100000:1.0:1789265349.092539:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265349.092680:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399604864 00000100:00100000:3.0:1789265349.092696:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399604864 00000100:00100000:3.0:1789265349.092768:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 92 00000100:00100000:3.0:1789265349.093370:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+16:11295:x1876180399604864:12345-192.168.203.49@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789265349.093556:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96c70 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.093656:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96c2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe5a expref: 16 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.093667:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96c70 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.093706:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96c2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe5a expref: 16 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.093725:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96c2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe5a expref: 16 pid: 8459 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265349.093740:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83ddb800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8460:1876180417509888:192.168.203.49@tcp:104: 00000100:00100000:3.0:1789265349.093840:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3ea300 going to sleep for 11 seconds 00000100:00100000:0.0:1789265349.104236:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265349.104277:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399604992 00000100:00100000:0.0:1789265349.104288:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399604992 00010000:00010000:0.0:1789265349.104337:0:7926:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96c2a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe5a expref: 17 pid: 8459 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265349.104379:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 60 00000100:00100000:0.0:1789265349.104390:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+17:2396:x1876180399604992:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265349.104407:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265349.104426:0:7926:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96c2a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe5a expref: 17 pid: 8459 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.104442:0:7926:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96c2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe5a expref: 17 pid: 8459 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.104470:0:7926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fccacd4ef00) 00010000:00010000:0.0:1789265349.104476:0:7926:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96c70 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.104488:0:7926:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96c70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.104497:0:7926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96c70 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.104522:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265349.104588:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+17:2396:x1876180399604992:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 200us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265349.104620:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 60 00010000:00010000:3.0:1789265349.105833:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96c2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe5a expref: 16 pid: 8459 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265349.105887:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83ddb800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8460:1876180417509888:192.168.203.49@tcp:104: 00010000:00010000:3.0:1789265349.105916:0:8460:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96c70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.105936:0:8460:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96c70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.105944:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96c70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.105985:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96c70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.106010:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96c70 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.106018:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96c70 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.106052:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265349.106056:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96c70 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.106064:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96c70 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.106081:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fccacd4ef00) 00010000:00010000:3.0:1789265349.106085:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789265349.106089:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96c70 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.106096:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96c70 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265349.106382:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+15:11295:x1876180399604864:12345-192.168.203.49@tcp:55:lhsmtool_posix.0 Request processed in 13602us (13866us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789265349.106396:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 92 00000100:00100000:1.0:1789265349.116154:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265349.116229:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399605120 00000100:00100000:3.0:1789265349.116238:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399605120 00000100:00100000:3.0:1789265349.116547:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 40 00000100:00100000:3.0:1789265349.116655:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+7:2393:x1876180399605120:12345-192.168.203.49@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789265349.116754:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c8e254b7/0x9272d942b4a96c77 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.116790:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000096eac9fc/0x9272d942b4a96c62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe76 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.116799:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265349.116803:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265349.116809:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8e254b7/0x9272d942b4a96c77 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.116841:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000096eac9fc/0x9272d942b4a96c62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe76 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.116855:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000096eac9fc/0x9272d942b4a96c62 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe76 expref: 7 pid: 8433 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265349.116880:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83ddb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8435:1876180417510016:192.168.203.49@tcp:104: 00000100:00100000:3.0:1789265349.117119:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3ea300 going to sleep for 11 seconds 00000100:00100000:0.0:1789265349.124900:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb838f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417510144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265349.125011:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265349.125190:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265349.125218:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417510144 00000100:00100000:0.0:1789265349.125227:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417510144 00000100:00100000:0.0:1789265349.125285:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789265349.125296:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc812a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417510144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789265349.125340:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789265349.125395:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc812a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417510144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265349.125403:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789265349.125442:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399605248 00000100:00100000:0.0:1789265349.125446:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399605248 00010000:00010000:0.0:1789265349.125471:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000096eac9fc/0x9272d942b4a96c62 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe76 expref: 8 pid: 8433 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265349.125501:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 61 00000100:00100000:0.0:1789265349.125508:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc812abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+8:2395:x1876180399605248:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265349.125521:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265349.125549:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000096eac9fc/0x9272d942b4a96c62 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe76 expref: 8 pid: 8433 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.125563:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000096eac9fc/0x9272d942b4a96c62 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe76 expref: 8 pid: 8433 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.125618:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265349.125624:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265349.125632:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8e254b7/0x9272d942b4a96c77 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.125644:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8e254b7/0x9272d942b4a96c77 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.125674:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265349.125727:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc812abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+8:2395:x1876180399605248:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 219us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265349.125735:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 61 00010000:00010000:1.0:1789265349.125747:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096eac9fc/0x9272d942b4a96c62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe76 expref: 8 pid: 8433 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265349.125775:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83ddb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8435:1876180417510016:192.168.203.49@tcp:104: 00000100:00100000:0.0:1789265349.125795:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb838f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417510144:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789265349.125802:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c8e254b7/0x9272d942b4a96c77 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.125817:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c8e254b7/0x9272d942b4a96c77 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.125825:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8e254b7/0x9272d942b4a96c77 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.125867:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c8e254b7/0x9272d942b4a96c77 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.125889:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8e254b7/0x9272d942b4a96c77 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.125897:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8e254b7/0x9272d942b4a96c77 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.125904:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490200 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265349.125909:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8e254b7/0x9272d942b4a96c77 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.125917:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8e254b7/0x9272d942b4a96c77 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.126749:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8e254b7/0x9272d942b4a96c77 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.126763:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8e254b7/0x9272d942b4a96c77 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265349.126867:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+6:2393:x1876180399605120:12345-192.168.203.49@tcp:1:lhsmtool_posix.0 Request processed in 10308us (10719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265349.126888:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 40 00000100:00100000:2.0:1789265349.133783:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265349.134100:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399605504 00000100:00100000:1.0:1789265349.134117:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399605504 00000100:00100000:1.0:1789265349.134195:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 93 00000100:00100000:1.0:1789265349.134206:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+15:11295:x1876180399605504:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789265349.134586:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96c7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.134605:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6200/0x9272d942b4a96abe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdff expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.134615:0:8459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96c7e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.134658:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6200/0x9272d942b4a96abe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdff expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.134673:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6200/0x9272d942b4a96abe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdff expref: 15 pid: 6516 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265349.134687:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb838f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8459:1876180417510272:192.168.203.49@tcp:104: 00000100:00100000:1.0:1789265349.134800:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c480c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265349.137378:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417510400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265349.137480:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265349.139678:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265349.139707:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399605632 00000100:00100000:0.0:1789265349.139718:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399605632 00010000:00010000:0.0:1789265349.139763:0:7926:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6200/0x9272d942b4a96abe lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdff expref: 16 pid: 6516 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265349.139801:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 62 00000100:00100000:0.0:1789265349.139810:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb09a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+16:2396:x1876180399605632:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265349.139828:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265349.139835:0:7926:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6200/0x9272d942b4a96abe lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdff expref: 16 pid: 6516 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.139864:0:7926:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6200/0x9272d942b4a96abe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdff expref: 16 pid: 6516 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.139906:0:7926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:0.0:1789265349.139912:0:7926:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96c7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.139925:0:7926:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96c7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.139933:0:7926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96c7e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.139956:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265349.140013:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb09a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+16:2396:x1876180399605632:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 203us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265349.140066:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 62 00010000:00010000:0.0:1789265349.140427:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6200/0x9272d942b4a96abe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbdff expref: 15 pid: 6516 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265349.140445:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb838f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8459:1876180417510272:192.168.203.49@tcp:104: 00010000:00010000:0.0:1789265349.140476:0:8459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96c7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.140487:0:8459:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96c7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.140494:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96c7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.141007:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96c85 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.141052:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96c3f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe61 expref: 15 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.141062:0:8459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96c85 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.141101:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96c3f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe61 expref: 15 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.141117:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96c3f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe61 expref: 15 pid: 8460 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265349.141131:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f31880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8459:1876180417510528:192.168.203.49@tcp:104: 00000100:00100000:0.0:1789265349.141210:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cb40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265349.142945:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417510400 00000100:00100000:2.0:1789265349.142960:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417510400 00000100:00100000:2.0:1789265349.143049:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789265349.143061:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417510400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789265349.143111:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789265349.143229:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417510400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 170us (5749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265349.143238:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789265349.143315:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417510400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265349.146432:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265349.146655:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399605760 00000100:00100000:2.0:1789265349.146668:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399605760 00010000:00010000:2.0:1789265349.146725:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96c3f lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe61 expref: 16 pid: 8460 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265349.146777:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 63 00000100:00100000:2.0:1789265349.146788:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+16:2395:x1876180399605760:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265349.146807:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265349.146815:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96c3f lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe61 expref: 16 pid: 8460 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.146829:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96c3f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe61 expref: 16 pid: 8460 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.146857:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fccacd4ef00) 00010000:00010000:2.0:1789265349.146864:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96c85 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.146885:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96c85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.146915:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96c85 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.146940:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265349.147010:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+16:2395:x1876180399605760:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 223us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265349.147018:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 63 00010000:00010000:1.0:1789265349.148302:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96c3f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe61 expref: 15 pid: 8460 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265349.148330:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f31880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8459:1876180417510528:192.168.203.49@tcp:104: 00010000:00010000:1.0:1789265349.148360:0:8459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96c85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.148392:0:8459:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96c85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.148398:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96c85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265349.148554:0:8459:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1789265349.148728:0:8459:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1789265349.148768:0:8459:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1789265349.148881:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb838f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8459:1876180417510656:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789265349.148963:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265349.149004:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccae7636c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265349.152786:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417510656 00000100:00100000:3.0:1789265349.152808:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417510656 00000100:00100000:3.0:1789265349.152974:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789265349.152987:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8459:x1876180417510656:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789265349.153270:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8459:x1876180417510656:12345-0@lo:1000:mdt00_003.0 Request processed in 284us (4305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265349.153279:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789265349.153410:0:8459:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:0.0:1789265349.153418:0:8459:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fcc812a8000, transno 4294967302 00000100:00100000:0.0:1789265349.153443:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb838f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8459:1876180417510656:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1789265349.153782:0:8459:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:0.0:1789265349.153865:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f31180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8459:1876180417510784:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789265349.156613:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265349.156808:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cb4840 going to sleep for 11 seconds 00000100:00100000:3.0:1789265349.156922:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417510784 00000100:00100000:3.0:1789265349.156940:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417510784 00000100:00100000:3.0:1789265349.157018:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789265349.157247:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8459:x1876180417510784:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789265349.157628:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8459:x1876180417510784:12345-0@lo:1000:mdt00_003.0 Request processed in 384us (1019us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789265349.157637:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789265349.161598:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f31180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8459:1876180417510784:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1789265349.161688:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96c85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.161711:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96c85 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.161719:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96c85 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.161726:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5a00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265349.161731:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96c85 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.161740:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96c85 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.161762:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fccacd4ef00) 00010000:00010000:0.0:1789265349.161765:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265349.161771:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96c85 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.161776:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96c85 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.161822:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96bb3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.161828:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96bb3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.161833:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96bb3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.161838:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265349.161848:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96bb3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.161854:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96bb3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.161862:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:0.0:1789265349.161865:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265349.161877:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96bb3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.161883:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96bb3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.161909:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96c8c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.161925:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a96bcf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe45 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.161934:0:8459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96c8c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.161980:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a96bcf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe45 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.162001:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a96bcf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe45 expref: 18 pid: 6517 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265349.162016:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f33480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8459:1876180417510912:192.168.203.49@tcp:104: 00000100:00100000:0.0:1789265349.163362:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cb4840 going to sleep for 11 seconds 00000100:00100000:3.0:1789265349.166663:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265349.166713:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399605888 00000100:00100000:3.0:1789265349.166724:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399605888 00010000:00010000:3.0:1789265349.166773:0:7926:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a96bcf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe45 expref: 19 pid: 6517 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265349.166814:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 64 00000100:00100000:3.0:1789265349.166825:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+19:2396:x1876180399605888:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265349.166843:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265349.166850:0:7926:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a96bcf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe45 expref: 19 pid: 6517 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.166864:0:7926:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a96bcf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe45 expref: 19 pid: 6517 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.166903:0:7926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:3.0:1789265349.166909:0:7926:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96c8c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.166921:0:7926:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96c8c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.166954:0:7926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96c8c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.166980:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265349.167078:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+19:2396:x1876180399605888:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 254us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265349.167086:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 64 00010000:00010000:2.0:1789265349.168397:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a96bcf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe45 expref: 18 pid: 6517 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265349.168434:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f33480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8459:1876180417510912:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265349.168463:0:8459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96c8c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.168474:0:8459:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96c8c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.168480:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96c8c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.168495:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96c8c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.168502:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96c8c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.168510:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96c8c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.168516:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265349.168530:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96c8c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.168539:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96c8c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.168555:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:2.0:1789265349.168559:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265349.168564:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96c8c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.168570:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96c8c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.168581:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96c7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.168587:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96c7e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.168593:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96c7e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.168598:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fec00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265349.168601:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96c7e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.168606:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96c7e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.168613:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcb83b86600) 00010000:00010000:2.0:1789265349.168615:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789265349.168625:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96c7e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.168631:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96c7e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265349.168858:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+17:11295:x1876180399605504:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 Request processed in 34652us (35087us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1789265349.168878:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 93 00000020:00080000:2.0:1789265349.168886:0:8459:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789265349.171559:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265349.171570:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1789265349.172364:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265349.172410:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399606144 00000040:00080000:0.0:1789265349.172695:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789265349.172710:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789265349.173842:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399606144 00000100:00100000:3.0:1789265349.173949:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 20 00000100:00100000:3.0:1789265349.173962:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+17:11295:x1876180399606144:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789265349.176966:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789265349.177016:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1789265349.177090:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a96c93 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.177112:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a96c93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.177125:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a96c93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.177134:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a96c93 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.177142:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a96c93 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.177148:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a96c93 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.177182:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789265349.177322:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+19:11295:x1876180399606144:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 Request processed in 3357us (4961us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789265349.177333:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 20 00000020:00080000:3.0:1789265349.177340:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789265349.177734:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265349.177744:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a96c93 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.177754:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490200 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265349.177759:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a96c93 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.177769:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a96c93 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.177786:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fccacd4ef00) 00010000:00010000:0.0:1789265349.177790:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789265349.177796:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a96c93 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.177803:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a96c93 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.177815:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265349.177820:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265349.177821:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789265349.435822:0:14208:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265349.435833:0:14208:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789265349.435857:0:14208:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789265349.435875:0:14208:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789265349.548227:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265349.549798:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399606400 00000100:00100000:0.0:1789265349.549812:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399606400 00000100:00100000:0.0:1789265349.549921:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 94 00000100:00100000:0.0:1789265349.549932:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+19:11305:x1876180399606400:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:0.0:1789265349.549955:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265349.549981:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96c9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbe7d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.550109:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5c00/0x9272d942b4a96ca1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.550124:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5c00/0x9272d942b4a96ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.550137:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5c00/0x9272d942b4a96ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265349.550148:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789265349.550248:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96c9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe7d expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.550266:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5c00/0x9272d942b4a96ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe7d expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.550275:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:0.0:1789265349.550279:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789265349.550282:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5c00, rc 0) 00000100:00100000:0.0:1789265349.550346:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+21:11305:x1876180399606400:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 416us (2128us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1789265349.550354:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 94 00000100:00100000:0.0:1789265349.568733:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265349.570555:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399606528 00000100:00100000:3.0:1789265349.570569:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399606528 00000100:00100000:3.0:1789265349.572257:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 95 00000100:00100000:3.0:1789265349.572275:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+21:11305:x1876180399606528:12345-192.168.203.49@tcp:34:lfs.0 00010000:00010000:3.0:1789265349.572346:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96caf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572362:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96caf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572374:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96caf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572388:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96cb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572395:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572401:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572485:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96cbd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572499:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96cbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572506:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96cbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265349.572549:0:8460:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96cbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572561:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96caf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572568:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96caf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572575:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96caf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572580:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265349.572584:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96caf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572592:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96caf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572604:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:3.0:1789265349.572607:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265349.572611:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96caf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572617:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96caf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572637:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572643:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96cb6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572649:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572654:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81491600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265349.572657:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572663:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96cb6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572670:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fcca967b700) 00010000:00010000:3.0:1789265349.572672:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265349.572675:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96cb6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572681:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96cb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572696:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96cbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572703:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96cbd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572709:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96cbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572719:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265349.572723:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96cbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572729:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96cbd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572737:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fcca967b400) 00010000:00010000:3.0:1789265349.572740:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265349.572743:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96cbd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.572748:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96cbd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265349.572832:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+21:11305:x1876180399606528:12345-192.168.203.49@tcp:34:lfs.0 Request processed in 563us (4109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265349.572841:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 95 00000100:00100000:1.0:1789265349.639611:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265349.639635:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb838f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417511040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265349.639699:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265349.641058:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417511040 00000100:00100000:0.0:1789265349.641072:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417511040 00000100:00100000:0.0:1789265349.641137:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789265349.641148:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417511040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789265349.641185:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1789265349.641245:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417511040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265349.641253:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:0.0:1789265349.641272:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265349.641402:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb838f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417511040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265349.641722:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265349.641746:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399606784 00000100:00100000:1.0:1789265349.641750:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399606784 00000100:00100000:1.0:1789265349.641785:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 96 00000100:00100000:1.0:1789265349.641792:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+21:11308:x1876180399606784:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1789265349.641804:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265349.641823:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96cc4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbe84 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.641914:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a96ccb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.641930:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a96ccb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.641941:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a96ccb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.641957:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96cd2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.641964:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.641971:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.642105:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96cd9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.642113:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.642120:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265349.642128:0:8459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789265349.642200:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a96ccb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.642208:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a96ccb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.642221:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a96ccb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.642226:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ffa00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265349.642230:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a96ccb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.642237:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a96ccb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.642250:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:1.0:1789265349.642253:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265349.642258:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a96ccb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.642264:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a96ccb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.642274:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.642280:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96cd2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.642286:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.642291:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fea00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265349.642293:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.642306:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96cd2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.642314:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fccacd4e500) 00010000:00010000:1.0:1789265349.642316:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265349.642319:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96cd2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.642324:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96cd2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.642357:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96cc4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe84 expref: 24 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.642369:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe84 expref: 23 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.642376:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fccacd4ee00) 00010000:00010000:1.0:1789265349.642378:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265349.642380:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fe800, rc 0) 00000100:00100000:1.0:1789265349.642430:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+23:11308:x1876180399606784:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 638us (709us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789265349.642437:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 96 00000100:00100000:0.0:1789265349.644413:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf54a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417511168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265349.644491:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265349.651496:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417511168 00000100:00100000:3.0:1789265349.651509:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417511168 00000100:00100000:2.0:1789265349.652398:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265349.652604:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789265349.652614:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1876180417511168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265349.652639:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1789265349.652707:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1876180417511168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (8216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265349.652714:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789265349.652829:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf54a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417511168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265349.652885:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399606912 00000100:00100000:1.0:1789265349.652890:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399606912 00000100:00100000:1.0:1789265349.652958:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 97 00000100:00100000:1.0:1789265349.652966:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+23:11308:x1876180399606912:12345-192.168.203.49@tcp:54:lfs.0 00010000:00010000:1.0:1789265349.653109:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96ce7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.653195:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.653209:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.653243:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.653250:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96ce7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.653256:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96ce7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.653263:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ffc00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265349.653267:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96ce7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.653276:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96ce7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.653287:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fccacd4ee00) 00010000:00010000:1.0:1789265349.653290:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789265349.653294:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96ce7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.653301:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96ce7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265349.653478:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+23:11308:x1876180399606912:12345-192.168.203.49@tcp:54:lfs.0 Request processed in 512us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265349.653487:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 97 00000100:00100000:0.0:1789265349.657299:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265349.657427:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399607168 00000100:00100000:2.0:1789265349.657437:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399607168 00000100:00100000:2.0:1789265349.657494:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 21 00000100:00100000:2.0:1789265349.657504:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdcf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+23:11308:x1876180399607168:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:2.0:1789265349.657758:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdcf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+24:11308:x1876180399607168:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 255us (469us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1789265349.657766:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 21 00000100:00100000:2.0:1789265349.707890:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265349.707981:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399607424 00000100:00100000:3.0:1789265349.707990:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399607424 00000100:00100000:3.0:1789265349.708092:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 98 00000100:00100000:3.0:1789265349.708102:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+24:10835:x1876180399607424:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1789265349.708138:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265349.708159:0:8460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96cee lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbe8b expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.708282:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96cf5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.708297:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96cd9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe84 expref: 25 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.708306:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96cf5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.708338:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe84 expref: 25 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.708351:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96cd9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe84 expref: 25 pid: 8459 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265349.708363:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf54a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8460:1876180417511296:192.168.203.49@tcp:104: 00000100:00100000:3.0:1789265349.708449:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3ea300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265349.712794:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf54a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8460:1876180417511296:192.168.203.49@tcp:104: 00010000:00010000:3.0:1789265349.712827:0:8460:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96cf5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265349.713425:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265349.713734:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399607552 00000100:00100000:0.0:1789265349.713743:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399607552 00010000:00010000:0.0:1789265349.713781:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96cd9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe84 expref: 26 pid: 8459 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265349.713821:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 65 00000100:00100000:0.0:1789265349.713830:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+26:2395:x1876180399607552:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265349.713846:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265349.713853:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96cd9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe84 expref: 26 pid: 8459 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.713892:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe84 expref: 26 pid: 8459 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.713916:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96cd9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe84 expref: 26 pid: 8459 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.713931:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fccacd4ee00) 00010000:00010000:0.0:1789265349.713936:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96cf5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.713946:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96cf5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.713953:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96cf5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265349.713981:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265349.714170:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+25:2395:x1876180399607552:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 339us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265349.714178:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 65 00010000:00010000:2.0:1789265349.714350:0:8460:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96cf5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.714359:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96cf5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265349.714376:0:8460:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789265349.714504:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96cee lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe8b expref: 26 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.714532:0:8460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96cf5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe8b expref: 25 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.714540:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fccacd4ee00) 00010000:00010000:2.0:1789265349.714542:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789265349.714545:0:8460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81491600, rc 0) 00000100:00100000:2.0:1789265349.714572:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+25:10835:x1876180399607424:12345-192.168.203.49@tcp:101:bash.0 Request processed in 6473us (6706us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1789265349.714594:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 98 00000100:00100000:0.0:1789265349.718356:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265349.718710:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399607680 00000100:00100000:1.0:1789265349.718720:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399607680 00000100:00100000:1.0:1789265349.718777:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 99 00000100:00100000:1.0:1789265349.718787:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+25:10835:x1876180399607680:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1789265349.718811:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265349.718830:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96d03 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbe92 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.718862:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96d0a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.718886:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96d0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.718897:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96d0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.719009:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96d03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe92 expref: 27 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.719207:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96d0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe92 expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.719217:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fccacd4ee00) 00010000:00010000:1.0:1789265349.719226:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789265349.719231:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fea00, rc 0) 00000100:00100000:1.0:1789265349.719289:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+26:10835:x1876180399607680:12345-192.168.203.49@tcp:101:bash.0 Request processed in 503us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265349.719297:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 99 00000100:00100000:2.0:1789265349.728325:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265349.728422:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399607936 00000100:00100000:1.0:1789265349.728431:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399607936 00000100:00100000:1.0:1789265349.728491:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 100 00000100:00100000:1.0:1789265349.728501:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+26:10835:x1876180399607936:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:1.0:1789265349.728717:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96d11 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.728736:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96d11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.728747:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96d11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265349.728785:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:1.0:1789265349.728806:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9a5fed0 reply state 0000000080bb75fd transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96d11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.728820:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96d11 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.728828:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fccacd4ee00) 00010000:00010000:1.0:1789265349.728831:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789265349.728834:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789265349.728879:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:1.0:1789265349.728977:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+30:10835:x1876180399607936:12345-192.168.203.49@tcp:36:bash.0 Request processed in 476us (660us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1789265349.729001:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 100 00000020:00080000:1.0:1789265349.729006:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789265349.733929:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265349.734014:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399608064 00000100:00100000:3.0:1789265349.734054:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399608064 00000100:00100000:3.0:1789265349.734117:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 101 00000100:00100000:3.0:1789265349.734134:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+30:10835:x1876180399608064:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1789265349.734157:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265349.734190:0:8460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96d18 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbe99 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.734244:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96d18 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe99 expref: 31 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.734259:0:8460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96d18 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe99 expref: 31 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.734276:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fccacd4ee00) 00010000:00010000:3.0:1789265349.734279:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789265349.734283:0:8460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81490400, rc 0) 00000100:00100000:3.0:1789265349.734332:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+31:10835:x1876180399608064:12345-192.168.203.49@tcp:101:bash.0 Request processed in 207us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265349.734340:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 101 00000100:00100000:0.0:1789265349.744507:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265349.744890:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399608192 00000100:00100000:1.0:1789265349.744900:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399608192 00000100:00100000:1.0:1789265349.744960:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 41 00000100:00100000:1.0:1789265349.744969:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+6:10835:x1876180399608192:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1789265349.744987:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265349.745005:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068e08b86/0x9272d942b4a96d1f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbea0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789265349.745059:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa605c4, atime: 0x6aa605c3, ctime: 0x6aa605c4, blocks: 0x8 00010000:00010000:1.0:1789265349.745087:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1789265349.745092:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265349.745100:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068e08b86/0x9272d942b4a96d1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbea0 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.745116:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000068e08b86/0x9272d942b4a96d1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbea0 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.745266:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2ffa00, rc 0) 00000100:00100000:1.0:1789265349.745326:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+7:10835:x1876180399608192:12345-192.168.203.49@tcp:101:bash.0 Request processed in 357us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265349.745333:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 41 00000100:00100000:0.0:1789265349.763794:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265349.764060:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399608320 00000100:00100000:2.0:1789265349.764069:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399608320 00002000:00010000:2.0:1789265349.764109:0:8438:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1789265349.764113:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fcc913f0000 with x1876180399608320 ext(0->18446744073709551615) 00002000:00010000:2.0:1789265349.764124:0:8438:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fcc913f0000. 00000100:00100000:2.0:1789265349.764174:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1 00000100:00100000:2.0:1789265349.764184:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5b43750b-84cf-4d62-9028-e016267b6509+7:2393:x1876180399608320:12345-192.168.203.49@tcp:10:bash.0 00002000:00010000:2.0:1789265349.764453:0:8438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789265349.764457:0:8438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789265348 -> 1789265350 00002000:00010000:2.0:1789265349.764459:0:8438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1789265347 -> 1789265347 00002000:00010000:2.0:1789265349.764461:0:8438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789265348 -> 1789265350 00002000:00010000:2.0:1789265349.764463:0:8438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1789265349.764656:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5b43750b-84cf-4d62-9028-e016267b6509+8:2393:x1876180399608320:12345-192.168.203.49@tcp:10:bash.0 Request processed in 472us (870us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789265349.764678:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1 00002000:00010000:2.0:1789265349.764685:0:8438:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1789265349.764688:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fcc913f0000 with x1876180399608320 ext(0->18446744073709551615) 00002000:00010000:2.0:1789265349.764694:0:8438:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fcc913f0000. 00000100:00100000:2.0:1789265349.823017:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265349.823391:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399608448 00000100:00100000:1.0:1789265349.823400:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399608448 00000100:00100000:1.0:1789265349.823511:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 102 00000100:00100000:1.0:1789265349.823533:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+31:11322:x1876180399608448:12345-192.168.203.49@tcp:34:lfs.0 00010000:00010000:1.0:1789265349.823860:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96d26 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.823885:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96d26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.823898:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96d26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.823913:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a96d2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.823920:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a96d2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.824103:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a96d2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.824277:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96d34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.824287:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96d34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.824293:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96d34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265349.824332:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96d34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.824341:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96d26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.824354:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96d26 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.824360:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96d26 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.824365:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fe400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265349.824369:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96d26 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.824376:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96d26 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.824387:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:1.0:1789265349.824390:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265349.824393:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96d26 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.824399:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96d26 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.824615:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a96d2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.824623:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a96d2d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.824628:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a96d2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.824633:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265349.824640:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a96d2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.824646:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a96d2d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.824654:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fccacd4ea00) 00010000:00010000:1.0:1789265349.824656:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265349.824658:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a96d2d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.824663:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a96d2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.824729:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96d34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.824736:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96d34 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.824741:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96d34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.824746:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fe800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265349.824748:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96d34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.824753:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96d34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.824760:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fccacd4ee00) 00010000:00010000:1.0:1789265349.824762:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265349.824771:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96d34 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265349.824777:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96d34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265349.824920:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+31:11322:x1876180399608448:12345-192.168.203.49@tcp:34:lfs.0 Request processed in 1385us (1908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265349.824936:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 102 00000100:00100000:0.0:1789265349.870460:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265349.870665:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399608704 00000100:00100000:2.0:1789265349.870675:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399608704 00000100:00100000:2.0:1789265349.870736:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 103 00000100:00100000:2.0:1789265349.870746:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+31:11325:x1876180399608704:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1789265349.870769:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265349.870791:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96d3b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbea7 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.870878:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d42 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.870893:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d42 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.870906:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d42 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.870920:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96d49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.870938:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96d49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.870945:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96d49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.871114:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96d50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.871135:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96d50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.871143:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96d50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265349.871154:0:8459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789265349.871877:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d42 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.871887:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d42 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.871894:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.871899:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520aa00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265349.871904:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.871910:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d42 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.871930:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:2.0:1789265349.871932:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265349.871937:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d42 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.871954:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d42 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.871968:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96d49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.871973:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96d49 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.871978:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96d49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.871983:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520a600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265349.871987:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96d49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.871992:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96d49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.871999:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fcb83b86600) 00010000:00010000:2.0:1789265349.872001:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265349.872003:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96d49 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.872009:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96d49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.872152:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96d3b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbea7 expref: 34 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.872165:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96d50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbea7 expref: 33 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.872188:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fccacd4ee00) 00010000:00010000:2.0:1789265349.872190:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789265349.872193:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520b600, rc 0) 00000100:00100000:2.0:1789265349.872296:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+33:11325:x1876180399608704:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 1551us (1845us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1789265349.872302:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 103 00000100:00100000:0.0:1789265349.877643:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265349.877757:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399608832 00000100:00100000:2.0:1789265349.877767:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399608832 00000100:00100000:2.0:1789265349.877833:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 104 00000100:00100000:2.0:1789265349.877843:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+33:11325:x1876180399608832:12345-192.168.203.49@tcp:54:lfs.0 00010000:00010000:2.0:1789265349.877917:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.877933:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96cf5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe8b expref: 33 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.877943:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d5e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.877976:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96cf5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe8b expref: 33 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.877989:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96cf5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe8b expref: 33 pid: 8460 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265349.878002:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf40f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876180417511424:192.168.203.49@tcp:104: 00000100:00100000:2.0:1789265349.878122:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d8240 going to sleep for 11 seconds 00000100:00100000:1.0:1789265349.882940:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265349.883018:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399609088 00000100:00100000:3.0:1789265349.883059:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399609088 00000100:00100000:3.0:1789265349.883117:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 22 00000100:00100000:3.0:1789265349.883138:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+34:6161:x1876180399609088:12345-192.168.203.49@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789265349.883455:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf40f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876180417511424:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265349.883491:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265349.883775:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+35:6161:x1876180399609088:12345-192.168.203.49@tcp:35:ldlm_bl.0 Request processed in 637us (841us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1789265349.883784:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 22 00000100:00100000:1.0:1789265349.888830:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265349.889120:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399609216 00000100:00100000:3.0:1789265349.889251:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399609216 00010000:00010000:3.0:1789265349.889298:0:7926:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96cf5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe8b expref: 35 pid: 8460 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265349.889348:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 66 00000100:00100000:3.0:1789265349.889377:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+35:2396:x1876180399609216:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265349.889393:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265349.889400:0:7926:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96cf5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe8b expref: 35 pid: 8460 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.889716:0:7926:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96cf5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe8b expref: 35 pid: 8460 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.889741:0:7926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96cf5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe8b expref: 35 pid: 8460 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.889757:0:7926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fccacd4ee00) 00010000:00010000:3.0:1789265349.889763:0:7926:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.889773:0:7926:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.889781:0:7926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d5e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265349.889861:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265349.889932:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+34:2396:x1876180399609216:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 560us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265349.889941:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 66 00010000:00010000:2.0:1789265349.891010:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.891034:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.891077:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.891085:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d5e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.891092:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.891099:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520aa00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265349.891102:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.891110:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.891124:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fccacd4ee00) 00010000:00010000:2.0:1789265349.891127:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265349.891130:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d5e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265349.891154:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265349.891267:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+33:11325:x1876180399608832:12345-192.168.203.49@tcp:54:lfs.0 Request processed in 13423us (13861us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265349.891276:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 104 00000100:00100000:1.0:1789265349.896000:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265349.896133:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399609472 00000100:00100000:3.0:1789265349.896143:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399609472 00000100:00100000:3.0:1789265349.896200:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23 00000100:00100000:3.0:1789265349.896212:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+33:11325:x1876180399609472:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:3.0:1789265349.896479:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+34:11325:x1876180399609472:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 268us (489us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1789265349.896487:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23 00010000:00010000:3.0:1789265349.953357:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265350.014711:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265350.015091:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399609728 00000100:00100000:1.0:1789265350.015101:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399609728 00000100:00100000:1.0:1789265350.015162:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 105 00000100:00100000:1.0:1789265350.015172:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc812a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+34:11336:x1876180399609728:12345-192.168.203.49@tcp:101:cat.0 00010000:00010000:1.0:1789265350.015196:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265350.015216:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96d65 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbeae expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.015285:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96d6c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.015300:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96d6c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.015311:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96d6c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.015325:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96d73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.015347:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96d73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.015354:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96d73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.015462:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96d7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.015471:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96d7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.015479:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96d7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265350.015487:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789265350.015561:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96d6c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.015568:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96d6c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.015575:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96d6c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.015582:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265350.015586:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96d6c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.015592:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96d6c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.015615:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:1.0:1789265350.015618:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265350.015623:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96d6c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.015629:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96d6c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.015644:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96d73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.015650:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96d73 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.015656:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96d73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.015662:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fec00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265350.015664:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96d73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.015670:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96d73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.015809:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fccacd4ea00) 00010000:00010000:1.0:1789265350.015812:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265350.015816:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96d73 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.015822:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96d73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.015887:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96d65 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbeae expref: 37 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.015901:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96d7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbeae expref: 36 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.015909:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fccacd4ee00) 00010000:00010000:1.0:1789265350.015911:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265350.015914:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2ffe00, rc 0) 00000100:00100000:1.0:1789265350.015992:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc812a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+36:11336:x1876180399609728:12345-192.168.203.49@tcp:101:cat.0 Request processed in 820us (1290us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1789265350.016000:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 105 00000100:00100000:2.0:1789265350.024232:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265350.024457:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399609984 00000100:00100000:3.0:1789265350.024467:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399609984 00000100:00100000:3.0:1789265350.024525:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24 00000100:00100000:3.0:1789265350.024535:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+36:11336:x1876180399609984:12345-192.168.203.49@tcp:35:cat.0 00000100:00100000:3.0:1789265350.024821:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+37:11336:x1876180399609984:12345-192.168.203.49@tcp:35:cat.0 Request processed in 286us (597us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1789265350.024829:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24 00000100:00100000:0.0:1789265350.056672:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265350.057162:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399610240 00000100:00100000:2.0:1789265350.057172:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399610240 00000100:00100000:2.0:1789265350.057232:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 106 00000100:00100000:2.0:1789265350.057243:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+37:11337:x1876180399610240:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:2.0:1789265350.057298:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1789265350.057325:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96d18 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe99 expref: 37 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.057360:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96d7a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbeae expref: 36 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.057373:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96d50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbea7 expref: 35 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.057384:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96d0a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe92 expref: 34 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.057394:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fccacd4ee00) 00010000:00010000:2.0:1789265350.057398:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265350.057601:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d88 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.057617:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d88 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.057628:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d88 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.057644:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96d8f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.057652:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96d8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.057659:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96d8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.057739:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96d96 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.057747:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96d96 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.057754:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96d96 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265350.057982:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1789265350.057992:0:8459:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 401287968660ns, next at 402287966112ns, rc = 0 00010000:00010000:2.0:1789265350.060674:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96d9d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.060697:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96d9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.060724:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96d9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.060733:0:8459:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96d9d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.060739:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96d9d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.060745:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96d9d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.060774:0:8459:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265350.060799:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96d96 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.060807:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96d96 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.060813:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96d96 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.060820:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520b800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265350.060824:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96d96 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.060827:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265350.060834:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96d96 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.060847:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96d9d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.060848:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fccacd4ee00) 00010000:00010000:2.0:1789265350.060855:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789265350.061200:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96d96 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.061207:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96d96 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.061227:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d88 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.061234:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d88 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.061240:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d88 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.061246:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520aa00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265350.061248:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d88 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.061255:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d88 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.061264:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:2.0:1789265350.061267:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265350.061270:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d88 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.061276:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96d88 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265350.061286:0:8459:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7a6b1ea reply state 000000006e28217d transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96d8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.061290:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520a800 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265350.061298:0:7473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96d9d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.061307:0:7473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96d9d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.061327:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96d8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.061329:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fccacd4ee00) 00010000:00010000:1.0:1789265350.061334:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789265350.061338:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96d9d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.061343:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96d9d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.061363:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265350.061364:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265350.061366:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265350.061467:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fcb83b86600) 00010000:00010000:2.0:1789265350.061470:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789265350.061473:0:8459:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265350.061617:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+35:11337:x1876180399610240:12345-192.168.203.49@tcp:36:rm.0 Request processed in 4371us (4949us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1789265350.061626:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 106 00000100:00100000:0.0:1789265350.174454:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265350.175295:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399610496 00000100:00100000:2.0:1789265350.175306:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399610496 00000100:00100000:2.0:1789265350.175386:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 107 00000100:00100000:2.0:1789265350.175397:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc812abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+35:11343:x1876180399610496:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1789265350.175433:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265350.175689:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96da4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbeb5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.175794:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96dab lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.175809:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96dab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.175821:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96dab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.175833:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96db2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.175855:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96db2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.175872:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96db2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789265350.177189:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1789265350.177389:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96db9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.177414:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96db9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.177425:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96db9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.178927:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96dab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.178943:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96dab lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.178951:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96dab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.178957:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520b800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265350.178962:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96dab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.178970:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96dab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.179004:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:2.0:1789265350.179008:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265350.179013:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96dab lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.179019:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96dab lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265350.179054:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a889f38 reply state 00000000691c260b transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96db2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.179065:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96db2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.179071:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fcb83b86600) 00010000:00010000:2.0:1789265350.179073:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789265350.179076:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789265350.179227:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96da4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbeb5 expref: 38 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.179248:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96db9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbeb5 expref: 37 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.179255:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcb83b86300) 00010000:00010000:2.0:1789265350.179258:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265350.179260:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520bc00, rc 0) 00000100:00100000:2.0:1789265350.179422:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc812abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+38:11343:x1876180399610496:12345-192.168.203.49@tcp:101:bash.0 Request processed in 4026us (4984us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1789265350.179432:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 107 00000100:00100000:1.0:1789265350.187159:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265350.187911:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399610624 00000100:00100000:0.0:1789265350.187922:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399610624 00000100:00100000:0.0:1789265350.188093:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 42 00000100:00100000:0.0:1789265350.188105:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+7:2396:x1876180399610624:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1789265350.188122:0:8914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265350.188145:0:8914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a96dc7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbebc expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789265350.188178:0:8914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265350.188198:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=401s v=(0 0) 00010000:00010000:0.0:1789265350.188202:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265350.188212:0:8914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a96dc7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbebc expref: 8 pid: 8914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.188232:0:8914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a96dc7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbebc expref: 8 pid: 8914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.188245:0:8914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5400, rc 0) 00000100:00100000:0.0:1789265350.188299:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+8:2396:x1876180399610624:12345-192.168.203.49@tcp:101:bash.0 Request processed in 198us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265350.188307:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 42 00000100:00080000:2.0:1789265350.194473:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265350.197554:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265350.198108:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399610752 00000100:00100000:1.0:1789265350.198119:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399610752 00000100:00100000:1.0:1789265350.198357:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 43 00000100:00100000:1.0:1789265350.198368:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+8:11343:x1876180399610752:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1789265350.198404:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265350.198422:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b106c9b8/0x9272d942b4a96dce lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbec3 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.198454:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a96dc7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbebc expref: 9 pid: 8914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.198464:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265350.198468:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265350.198474:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b106c9b8/0x9272d942b4a96dce lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbec3 expref: 9 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.198506:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a96dc7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbebc expref: 9 pid: 8914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.198521:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a96dc7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbebc expref: 9 pid: 8914 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265350.198556:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb838f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8434:1876180417511552:192.168.203.49@tcp:104: 00000100:00100000:1.0:1789265350.198903:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada13540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265350.204195:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265350.204318:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb838f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8434:1876180417511552:192.168.203.49@tcp:104: 00010000:00010000:1.0:1789265350.204351:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b106c9b8/0x9272d942b4a96dce lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbec3 expref: 9 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.204386:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fec00, rc 0) 00000100:00100000:1.0:1789265350.204456:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+9:11343:x1876180399610752:12345-192.168.203.49@tcp:101:bash.0 Request processed in 6090us (6911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265350.204465:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 43 00000100:00100000:0.0:1789265350.205216:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399610880 00000100:00100000:0.0:1789265350.205225:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399610880 00010000:00010000:0.0:1789265350.205263:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a96dc7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbebc expref: 9 pid: 8914 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265350.205325:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 67 00000100:00100000:0.0:1789265350.205335:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+9:2396:x1876180399610880:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265350.205350:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265350.205370:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a96dc7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbebc expref: 9 pid: 8914 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.206879:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a96dc7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbebc expref: 9 pid: 8914 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.206909:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a96dc7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbebc expref: 9 pid: 8914 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.206926:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265350.206931:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265350.206941:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b106c9b8/0x9272d942b4a96dce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbec3 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.206951:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b106c9b8/0x9272d942b4a96dce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbec3 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.207062:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b106c9b8/0x9272d942b4a96dce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbec3 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265350.207079:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf609f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6502:1876180417511680:192.168.203.49@tcp:105: 00000100:00100000:0.0:1789265350.207190:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c48600 going to sleep for 11 seconds 00000100:00100000:0.0:1789265350.216688:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf609f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6502:1876180417511680:192.168.203.49@tcp:105: 00010000:00010000:0.0:1789265350.216728:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265350.216794:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+8:2396:x1876180399610880:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 11459us (12607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265350.216804:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 67 00000100:00100000:3.0:1789265350.222576:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265350.222739:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399611136 00000100:00100000:1.0:1789265350.222749:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399611136 00000100:00100000:1.0:1789265350.222804:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 25 00000100:00100000:1.0:1789265350.222814:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+38:11343:x1876180399611136:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:1.0:1789265350.223189:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+39:11343:x1876180399611136:12345-192.168.203.49@tcp:35:bash.0 Request processed in 375us (622us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1789265350.223198:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 25 00000100:00100000:2.0:1789265350.404539:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265350.404656:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399611264 00000100:00100000:1.0:1789265350.404666:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399611264 00000100:00100000:1.0:1789265350.404729:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 108 00000100:00100000:1.0:1789265350.404739:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+39:11359:x1876180399611264:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1789265350.404762:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265350.404782:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96dd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbeca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.404872:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a96ddc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.404888:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a96ddc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.404900:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a96ddc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265350.404946:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789265350.404950:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789265350.404968:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a96ddc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.404994:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96dd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbeca expref: 41 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.405010:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a96ddc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbeca expref: 40 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.405018:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:1.0:1789265350.405079:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265350.405084:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2ff400, rc 0) 00000100:00100000:1.0:1789265350.405140:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+40:11359:x1876180399611264:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 402us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265350.405148:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 108 00000100:00100000:0.0:1789265350.410100:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265350.410257:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399611520 00000100:00100000:2.0:1789265350.410267:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399611520 00000100:00100000:2.0:1789265350.410328:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 109 00000100:00100000:2.0:1789265350.410339:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+40:11359:x1876180399611520:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1789265350.410361:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265350.410383:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96de3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbed1 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.410505:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96dea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.410518:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96dea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.410529:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96dea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265350.410540:0:8459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789265350.410644:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96de3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbed1 expref: 43 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.410662:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96dea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbed1 expref: 42 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.410670:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcb83b86300) 00010000:00010000:2.0:1789265350.410673:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265350.410677:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520a800, rc 0) 00000100:00100000:2.0:1789265350.410742:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+42:11359:x1876180399611520:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 405us (652us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1789265350.410763:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 109 00000100:00100000:3.0:1789265350.418154:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265350.418515:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399611776 00000100:00100000:2.0:1789265350.418525:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399611776 00000100:00100000:2.0:1789265350.418644:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 110 00000100:00100000:2.0:1789265350.418656:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf548000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+42:11359:x1876180399611776:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1789265350.418680:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265350.418701:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96df8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbed8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.418804:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96dff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.418833:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96dff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.418845:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96dff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265350.418856:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789265350.418972:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96df8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbed8 expref: 45 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.418991:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96dff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbed8 expref: 44 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.418999:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcb83b86300) 00010000:00010000:2.0:1789265350.419001:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789265350.419005:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520ac00, rc 0) 00000100:00100000:2.0:1789265350.419135:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf548000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+44:11359:x1876180399611776:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 482us (991us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1789265350.419142:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 110 00000100:00100000:1.0:1789265350.423387:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265350.423939:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399611904 00000100:00100000:0.0:1789265350.423950:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399611904 00000100:00100000:0.0:1789265350.424105:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:0.0:1789265350.424117:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+44:2396:x1876180399611904:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265350.424134:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265350.424157:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96dea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbed1 expref: 44 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.424174:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcb83b86300) 00010000:00010000:0.0:1789265350.424179:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265350.424233:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+43:2396:x1876180399611904:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 118us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265350.424241:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:0.0:1789265350.426479:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265350.427221:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399612032 00000100:00100000:1.0:1789265350.427245:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399612032 00000100:00100000:1.0:1789265350.427344:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 44 00000100:00100000:1.0:1789265350.427353:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+8:2395:x1876180399612032:12345-192.168.203.49@tcp:1:lfs.0 00010000:00010000:1.0:1789265350.427404:0:8914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc537cfd/0x9272d942b4a96e0d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.427426:0:8914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b106c9b8/0x9272d942b4a96dce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbec3 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.427435:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265350.427439:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789265350.427444:0:8914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc537cfd/0x9272d942b4a96e0d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.427505:0:8914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b106c9b8/0x9272d942b4a96dce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbec3 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.427519:0:8914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b106c9b8/0x9272d942b4a96dce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbec3 expref: 8 pid: 8434 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265350.427534:0:8914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf613100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8914:1876180417511808:192.168.203.49@tcp:104: 00000100:00100000:1.0:1789265350.427627:0:8914:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada13000 going to sleep for 11 seconds 00000100:00100000:1.0:1789265350.437156:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265350.437675:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399612160 00000100:00100000:3.0:1789265350.437684:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399612160 00002000:00100000:3.0:1789265350.437736:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9fccbf613800 x1876180399612160/t0(0) o4->5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp:676/0 lens 504/0 e 0 to 0 dl 1789265361 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265350.437747:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fccbf613800 with x1876180399612160 ext(0->8) 00010000:00010000:3.0:1789265350.437756:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b106c9b8/0x9272d942b4a96dce lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbec3 expref: 9 pid: 8434 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.437772:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b106c9b8/0x9272d942b4a96dce lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbec3 expref: 9 pid: 8434 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265350.437779:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fccbf613800 00000100:00100000:3.0:1789265350.437826:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1 00000100:00100000:3.0:1789265350.437836:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5b43750b-84cf-4d62-9028-e016267b6509+9:2395:x1876180399612160:12345-192.168.203.49@tcp:4:lfs.0 00000100:00100000:2.0:1789265350.438588:0:8914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf613100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8914:1876180417511808:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265350.438612:0:8914:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bc537cfd/0x9272d942b4a96e0d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265350.440400:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5b43750b-84cf-4d62-9028-e016267b6509+11:2395:x1876180399612160:12345-192.168.203.49@tcp:4:lfs.0 Request processed in 2557us (3245us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789265350.440413:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1 00002000:00100000:3.0:1789265350.440425:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9fccbf613800 x1876180399612160/t4294967303(0) o4->5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp:676/0 lens 504/448 e 0 to 0 dl 1789265361 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265350.440435:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fccbf613800 with x1876180399612160 ext(0->8) 00010000:00010000:3.0:1789265350.440445:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b106c9b8/0x9272d942b4a96dce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbec3 expref: 11 pid: 8434 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.440462:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b106c9b8/0x9272d942b4a96dce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbec3 expref: 11 pid: 8434 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265350.440471:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fccbf613800 00000100:00100000:2.0:1789265350.443117:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265350.443204:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399612288 00000100:00100000:3.0:1789265350.443215:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399612288 00010000:00010000:3.0:1789265350.443252:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b106c9b8/0x9272d942b4a96dce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbec3 expref: 11 pid: 8434 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265350.443297:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 68 00000100:00100000:3.0:1789265350.443306:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+11:2396:x1876180399612288:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265350.443321:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789265350.443342:0:6503:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789265350.443345:0:6503:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789265350 00002000:00010000:3.0:1789265350.443362:0:6503:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789265351 00002000:00010000:3.0:1789265350.443364:0:6503:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789265350 00002000:00010000:3.0:1789265350.443366:0:6503:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789265350.443373:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b106c9b8/0x9272d942b4a96dce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbec3 expref: 11 pid: 8434 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.443386:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b106c9b8/0x9272d942b4a96dce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbec3 expref: 11 pid: 8434 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.443471:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b106c9b8/0x9272d942b4a96dce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbec3 expref: 11 pid: 8434 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.443488:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265350.443492:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265350.443497:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc537cfd/0x9272d942b4a96e0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.443506:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc537cfd/0x9272d942b4a96e0d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.443575:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265350.443629:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+10:2396:x1876180399612288:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 323us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265350.443636:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 68 00010000:00010000:2.0:1789265350.450929:0:8914:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bc537cfd/0x9272d942b4a96e0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.450949:0:8914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc537cfd/0x9272d942b4a96e0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.450982:0:8914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc537cfd/0x9272d942b4a96e0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.450991:0:8914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc537cfd/0x9272d942b4a96e0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.451000:0:8914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc537cfd/0x9272d942b4a96e0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.451007:0:8914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ffc00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265350.451011:0:8914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc537cfd/0x9272d942b4a96e0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.451053:0:8914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc537cfd/0x9272d942b4a96e0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.451073:0:8914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc537cfd/0x9272d942b4a96e0d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.451080:0:8914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc537cfd/0x9272d942b4a96e0d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265350.451198:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+9:2395:x1876180399612032:12345-192.168.203.49@tcp:1:lfs.0 Request processed in 23842us (24723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265350.451208:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 44 00000100:00100000:2.0:1789265350.456768:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265350.456909:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399612544 00000100:00100000:1.0:1789265350.456919:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399612544 00000100:00100000:1.0:1789265350.457056:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 26 00000100:00100000:1.0:1789265350.457068:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdcd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+43:11359:x1876180399612544:12345-192.168.203.49@tcp:35:lfs.0 00000004:00010000:1.0:1789265350.457143:0:6520:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96dff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbed8 expref: 43 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265350.457315:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1789265350.457345:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1789265350.457640:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:1.0:1789265350.457674:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96e14 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.457687:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96db9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbeb5 expref: 47 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.457696:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96e14 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.457728:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96db9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbeb5 expref: 47 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.457742:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96db9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbeb5 expref: 47 pid: 6516 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265350.457756:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf612d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6520:1876180417511936:192.168.203.49@tcp:104: 00000100:00100000:1.0:1789265350.459109:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada13000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265350.462489:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265350.462676:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399612672 00000100:00100000:3.0:1789265350.462686:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399612672 00010000:00010000:3.0:1789265350.462725:0:7926:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96db9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbeb5 expref: 48 pid: 6516 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265350.462802:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 69 00000100:00100000:3.0:1789265350.462813:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+48:2395:x1876180399612672:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265350.462828:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265350.462837:0:7926:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96db9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbeb5 expref: 48 pid: 6516 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.462851:0:7926:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96db9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbeb5 expref: 48 pid: 6516 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.462884:0:7926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcb83b86300) 00010000:00010000:3.0:1789265350.462891:0:7926:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96e14 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.462900:0:7926:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96e14 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.462906:0:7926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96e14 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.462925:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265350.462991:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+48:2395:x1876180399612672:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 180us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265350.462999:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 69 00010000:00010000:1.0:1789265350.463927:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96db9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbeb5 expref: 47 pid: 6516 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265350.463948:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf612d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6520:1876180417511936:192.168.203.49@tcp:104: 00010000:00010000:1.0:1789265350.463982:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96e14 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.464001:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96e14 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.464006:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96e14 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265350.464130:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1789265350.464235:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1789265350.464335:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf612d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1876180417512064:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789265350.464430:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265350.464458:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada139c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265350.464504:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417512064 00000100:00100000:2.0:1789265350.464510:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417512064 00000100:00100000:2.0:1789265350.464560:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789265350.464569:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6520:x1876180417512064:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1789265350.464657:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265350.464661:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6520:x1876180417512064:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 92us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265350.464670:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789265350.464883:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf612d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1876180417512064:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789265350.464996:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1789265350.465066:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf612d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1876180417512192:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789265350.465093:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265350.465116:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc906d46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265350.465203:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417512192 00000100:00100000:0.0:1789265350.465208:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417512192 00000100:00100000:0.0:1789265350.465239:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789265350.465246:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6520:x1876180417512192:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789265350.465799:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6520:x1876180417512192:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 551us (703us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789265350.465806:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789265350.466118:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf612d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1876180417512192:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789265350.466373:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1789265350.466420:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96e14 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.466431:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96e14 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.466438:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96e14 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.466444:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ffe00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265350.466521:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96e14 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.466530:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96e14 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.466544:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcb83b86300) 00010000:00010000:1.0:1789265350.466547:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789265350.466552:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96e14 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.466559:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96e14 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789265350.466797:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789265350.466856:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1789265350.467453:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 401697429240ns, next at 402697426088ns, rc = 0 00000001:00080000:1.0:1789265350.467463:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1789265350.467498:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcb83b86300) 00010000:00010000:1.0:1789265350.467501:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789265350.467509:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96dff lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbed8 expref: 51 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265350.467686:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdcd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+50:11359:x1876180399612544:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 10620us (10925us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1789265350.467695:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 26 00000020:00080000:1.0:1789265350.467699:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789265350.472742:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265350.472843:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399612800 00000100:00100000:0.0:1789265350.472854:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399612800 00000100:00100000:0.0:1789265350.472966:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 111 00000100:00100000:0.0:1789265350.472976:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+50:11359:x1876180399612800:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:0.0:1789265350.473000:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265350.473060:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a96e1b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbedf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.473127:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a96e1b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbedf expref: 51 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.473142:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a96e1b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbedf expref: 51 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.473163:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:0.0:1789265350.473166:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265350.473178:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da4000, rc 0) 00000100:00100000:0.0:1789265350.473235:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+51:11359:x1876180399612800:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 260us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265350.473242:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 111 00000100:00100000:0.0:1789265350.479004:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265350.484828:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399613056 00000100:00100000:3.0:1789265350.484844:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399613056 00000100:00100000:3.0:1789265350.484932:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 27 00000100:00100000:3.0:1789265350.484942:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+51:11359:x1876180399613056:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:3.0:1789265350.485216:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+52:11359:x1876180399613056:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 274us (6225us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1789265350.485224:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 27 00000100:00100000:1.0:1789265350.616580:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265350.616778:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399613184 00000100:00100000:3.0:1789265350.616788:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399613184 00000100:00100000:3.0:1789265350.616926:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 112 00000100:00100000:3.0:1789265350.616936:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+52:11369:x1876180399613184:12345-192.168.203.49@tcp:34:lfs.0 00010000:00010000:3.0:1789265350.617015:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96e22 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617082:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96e22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617095:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96e22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617109:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96e29 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617117:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96e29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617123:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96e29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617195:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96e30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617204:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96e30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617231:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96e30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265350.617278:0:8460:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96e30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617292:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96e22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617299:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96e22 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617306:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96e22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617311:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81491600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265350.617315:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96e22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617323:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96e22 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617335:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:3.0:1789265350.617526:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265350.617532:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96e22 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617539:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96e22 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617553:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96e29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617565:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96e29 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617572:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96e29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617577:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81491e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265350.617580:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96e29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617587:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96e29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617596:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fcb83b86600) 00010000:00010000:3.0:1789265350.617599:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265350.617602:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96e29 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617609:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96e29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617620:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96e30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617627:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96e30 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617633:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96e30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617638:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265350.617646:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96e30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617653:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96e30 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617661:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:3.0:1789265350.617664:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265350.617667:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96e30 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.617673:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96e30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265350.617975:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+52:11369:x1876180399613184:12345-192.168.203.49@tcp:34:lfs.0 Request processed in 1039us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265350.617984:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 112 00000100:00100000:2.0:1789265350.658872:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265350.658980:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399613440 00000100:00100000:0.0:1789265350.658990:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399613440 00000100:00100000:0.0:1789265350.659095:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 113 00000100:00100000:0.0:1789265350.659120:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+52:11372:x1876180399613440:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:0.0:1789265350.659141:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265350.659161:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a96e37 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbee6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.659235:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e3e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.659250:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e3e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.659262:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e3e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.659275:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96e45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.659282:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96e45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.659289:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96e45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.659409:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a96e4c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.659485:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a96e4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.659492:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a96e4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265350.659514:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789265350.659589:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e3e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.659596:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e3e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.659603:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e3e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.659609:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265350.659613:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e3e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.659620:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e3e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.659631:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:0.0:1789265350.659634:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265350.659638:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e3e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.659645:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e3e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.659656:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96e45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.659662:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96e45 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.659678:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96e45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.659683:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5a00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265350.659686:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96e45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.659702:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96e45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.659711:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fcb83b86600) 00010000:00010000:0.0:1789265350.659714:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265350.659716:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96e45 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.659721:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96e45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.659754:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a96e37 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbee6 expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.659767:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a96e4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbee6 expref: 54 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.659776:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:0.0:1789265350.659778:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265350.659781:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5400, rc 0) 00000100:00100000:0.0:1789265350.659839:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+54:11372:x1876180399613440:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 720us (980us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1789265350.659855:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 113 00000100:00100000:0.0:1789265350.662784:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265350.662968:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399613568 00000100:00100000:2.0:1789265350.662978:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399613568 00000100:00100000:2.0:1789265350.663083:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 114 00000100:00100000:2.0:1789265350.663094:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+54:11372:x1876180399613568:12345-192.168.203.49@tcp:54:lfs.0 00010000:00010000:2.0:1789265350.663160:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96e5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.663177:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96e5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.663188:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96e5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.663224:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96e5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.663231:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96e5a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.663237:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96e5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.663243:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520b800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265350.663247:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96e5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.663254:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96e5a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.663265:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:2.0:1789265350.663268:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265350.663273:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96e5a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.663289:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96e5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265350.663381:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+54:11372:x1876180399613568:12345-192.168.203.49@tcp:54:lfs.0 Request processed in 288us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265350.663388:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 114 00000100:00100000:1.0:1789265350.668952:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265350.669475:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399613824 00000100:00100000:3.0:1789265350.669490:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399613824 00000100:00100000:3.0:1789265350.669587:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 28 00000100:00100000:3.0:1789265350.669599:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+54:11372:x1876180399613824:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:3.0:1789265350.669944:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+55:11372:x1876180399613824:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 346us (1004us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1789265350.669953:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 28 00000100:00100000:2.0:1789265350.739934:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265350.740071:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399614080 00000100:00100000:3.0:1789265350.740081:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399614080 00000100:00100000:3.0:1789265350.740132:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 115 00000100:00100000:3.0:1789265350.740141:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+55:11382:x1876180399614080:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1789265350.740163:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265350.740179:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789265350.740205:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a96ddc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbeca expref: 55 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.740222:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:3.0:1789265350.740227:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265350.740239:0:8460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96e61 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbeed expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.740393:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96e68 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.740408:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a96e4c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbee6 expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.740416:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96e68 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.740593:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a96e4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbee6 expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.740607:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a96e4c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbee6 expref: 55 pid: 6516 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265350.740620:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf54a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8460:1876180417512320:192.168.203.49@tcp:104: 00000100:00100000:3.0:1789265350.740704:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3eaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265350.747286:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265350.747325:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf54a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8460:1876180417512320:192.168.203.49@tcp:104: 00010000:00010000:3.0:1789265350.747365:0:8460:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96e68 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265350.752010:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399614208 00000100:00100000:2.0:1789265350.752040:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399614208 00010000:00010000:2.0:1789265350.752098:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a96e4c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbee6 expref: 56 pid: 6516 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265350.752135:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 70 00000100:00100000:2.0:1789265350.752145:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+56:2395:x1876180399614208:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265350.752160:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265350.752166:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a96e4c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbee6 expref: 56 pid: 6516 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.752178:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a96e4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbee6 expref: 56 pid: 6516 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.752201:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a96e4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbee6 expref: 56 pid: 6516 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.752218:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:2.0:1789265350.752223:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96e68 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.752246:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96e68 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.752253:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96e68 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.752278:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265350.752334:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+55:2395:x1876180399614208:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 191us (5058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265350.752342:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 70 00010000:00010000:3.0:1789265350.752543:0:8460:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96e68 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.752552:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96e68 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265350.752571:0:8460:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789265350.752769:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96e61 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbeed expref: 56 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.752787:0:8460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96e68 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbeed expref: 55 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.752794:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:3.0:1789265350.752797:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789265350.752799:0:8460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81491e00, rc 0) 00000100:00100000:3.0:1789265350.752842:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+55:11382:x1876180399614080:12345-192.168.203.49@tcp:101:bash.0 Request processed in 12701us (12918us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1789265350.752849:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 115 00000100:00100000:0.0:1789265350.755111:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265350.755195:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399614336 00000100:00100000:2.0:1789265350.755204:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399614336 00000100:00100000:2.0:1789265350.755262:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 116 00000100:00100000:2.0:1789265350.755272:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+55:11382:x1876180399614336:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1789265350.755298:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265350.755330:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96e76 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbef4 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.755366:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96e7d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.755382:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96e7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.755394:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96e7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.755508:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96e76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbef4 expref: 57 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.755536:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96e7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbef4 expref: 56 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.755545:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:2.0:1789265350.755549:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789265350.755553:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520bc00, rc 0) 00000100:00100000:2.0:1789265350.755611:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+56:11382:x1876180399614336:12345-192.168.203.49@tcp:101:bash.0 Request processed in 340us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265350.755619:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 116 00000100:00100000:1.0:1789265350.764631:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265350.764762:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399614592 00000100:00100000:2.0:1789265350.764775:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399614592 00000100:00100000:2.0:1789265350.764895:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 117 00000100:00100000:2.0:1789265350.764907:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+56:11382:x1876180399614592:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:2.0:1789265350.765245:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96e84 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.765264:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96e84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.765277:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96e84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265350.765320:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1789265350.765340:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1288313 reply state 000000005a201bb5 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96e84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.765352:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96e84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.765368:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:2.0:1789265350.765371:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789265350.765374:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265350.765631:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+59:11382:x1876180399614592:12345-192.168.203.49@tcp:36:bash.0 Request processed in 724us (1011us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1789265350.765639:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 117 00000020:00080000:2.0:1789265350.765643:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789265350.768066:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265350.768166:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399614720 00000100:00100000:0.0:1789265350.768176:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399614720 00000100:00100000:0.0:1789265350.768238:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 118 00000100:00100000:0.0:1789265350.768248:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+59:11382:x1876180399614720:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1789265350.768270:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265350.768289:0:8460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96e8b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbefb expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.768382:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.768397:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96e68 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbeed expref: 60 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.768416:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e92 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.768455:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96e68 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbeed expref: 60 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.768467:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96e68 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbeed expref: 60 pid: 8460 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265350.768480:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8460:1876180417512448:192.168.203.49@tcp:104: 00000100:00100000:0.0:1789265350.768578:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c48600 going to sleep for 11 seconds 00000100:00100000:1.0:1789265350.771635:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265350.771712:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399614848 00000100:00100000:3.0:1789265350.771720:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399614848 00010000:00010000:3.0:1789265350.771756:0:7926:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96e68 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbeed expref: 61 pid: 8460 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265350.771802:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 71 00000100:00100000:3.0:1789265350.771811:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf610e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+61:2395:x1876180399614848:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265350.771846:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265350.771853:0:7926:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96e68 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbeed expref: 61 pid: 8460 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.771879:0:7926:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96e68 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbeed expref: 61 pid: 8460 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.771904:0:7926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:3.0:1789265350.771910:0:7926:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.771921:0:7926:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.771930:0:7926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e92 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.771948:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265350.772005:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf610e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+61:2395:x1876180399614848:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 195us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265350.772014:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 71 00010000:00010000:0.0:1789265350.773162:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a96e68 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbeed expref: 60 pid: 8460 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265350.773186:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8460:1876180417512448:192.168.203.49@tcp:104: 00010000:00010000:0.0:1789265350.773208:0:8460:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.773218:0:8460:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.773224:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265350.773280:0:8460:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789265350.773285:0:8460:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265350.773311:0:8460:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.773344:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96e8b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbefb expref: 60 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.773360:0:8460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbefb expref: 59 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.773370:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:0.0:1789265350.773373:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265350.773376:0:8460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5e00, rc 0) 00000100:00100000:0.0:1789265350.773526:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+59:11382:x1876180399614720:12345-192.168.203.49@tcp:101:bash.0 Request processed in 5279us (5503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265350.773557:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 118 00000100:00100000:1.0:1789265350.778998:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265350.779205:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399615104 00000100:00100000:2.0:1789265350.779214:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399615104 00000100:00100000:2.0:1789265350.779302:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 29 00000100:00100000:2.0:1789265350.779312:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+59:11382:x1876180399615104:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:2.0:1789265350.779539:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+60:11382:x1876180399615104:12345-192.168.203.49@tcp:35:bash.0 Request processed in 228us (550us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1789265350.779546:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 29 00000100:00100000:1.0:1789265350.868065:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265350.868195:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399615232 00000100:00100000:0.0:1789265350.868212:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399615232 00000100:00100000:0.0:1789265350.868313:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 119 00000100:00100000:0.0:1789265350.868324:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+60:11388:x1876180399615232:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:0.0:1789265350.868357:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265350.868384:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a96e99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbf02 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.868488:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96ea0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.868507:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.868522:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265350.868578:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789265350.868582:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265350.868606:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.868635:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a96e99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf02 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.868658:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf02 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.868702:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:0.0:1789265350.868706:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265350.868710:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da4200, rc 0) 00000100:00100000:0.0:1789265350.868804:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+61:11388:x1876180399615232:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 481us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265350.868812:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 119 00000100:00100000:0.0:1789265350.872525:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265350.872699:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399615360 00000100:00100000:2.0:1789265350.872713:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399615360 00000100:00100000:2.0:1789265350.872840:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 120 00000100:00100000:2.0:1789265350.872853:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+61:11388:x1876180399615360:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1789265350.872890:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265350.872916:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96ea7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbf09 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.872998:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96eae lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.873016:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96eae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.873096:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96eae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.873112:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96eb5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.873131:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.873138:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.873512:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a96ebc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.873526:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a96ebc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.873534:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a96ebc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265350.873812:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789265350.873818:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265350.873848:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a96ebc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.873872:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a96ebc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.873882:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96eae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.873904:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96eae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.873911:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96eae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.873918:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520aa00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265350.873923:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96eae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.873931:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96eae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.873946:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:2.0:1789265350.873949:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265350.873954:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96eae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.873960:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96eae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.873975:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.873981:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96eb5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.873988:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.873993:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520a800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265350.874002:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.874010:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96eb5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.874018:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fcb83b86600) 00010000:00010000:2.0:1789265350.874314:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265350.874319:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96eb5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.874327:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a96eb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.874372:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a96ea7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf09 expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.874390:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a96ebc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf09 expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.874520:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:2.0:1789265350.874523:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265350.874526:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81692e00, rc 0) 00000100:00100000:2.0:1789265350.874715:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+62:11388:x1876180399615360:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 1863us (2202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265350.874725:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 120 00000100:00100000:1.0:1789265350.878972:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265350.879092:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399615744 00000100:00100000:2.0:1789265350.879105:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399615744 00000100:00100000:2.0:1789265350.879190:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 8 00000100:00100000:2.0:1789265350.879202:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf610700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+62:2395:x1876180399615744:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265350.879240:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265350.879283:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a96ebc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf09 expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.879308:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:2.0:1789265350.879313:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265350.879389:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf610700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+61:2395:x1876180399615744:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 189us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265350.879397:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 8 00000100:00100000:1.0:1789265350.882316:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265350.882725:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399615616 00000100:00100000:0.0:1789265350.882739:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399615616 00000100:00100000:0.0:1789265350.882850:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 121 00000100:00100000:0.0:1789265350.882872:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+61:11388:x1876180399615616:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:0.0:1789265350.882899:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265350.882927:0:8460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a96ec3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbf10 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.883097:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96eca lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.883127:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e92 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbefb expref: 62 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.883139:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96eca lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.884141:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbefb expref: 62 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.884202:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbefb expref: 62 pid: 8460 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265350.884221:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8460:1876180417512576:192.168.203.49@tcp:104: 00000100:00100000:0.0:1789265350.884355:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c48600 going to sleep for 11 seconds 00000100:00100000:1.0:1789265350.888092:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265350.888252:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399615872 00000100:00100000:3.0:1789265350.888265:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399615872 00010000:00010000:3.0:1789265350.888317:0:7926:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e92 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbefb expref: 63 pid: 8460 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265350.888363:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 72 00000100:00100000:3.0:1789265350.888375:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf611880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+63:2396:x1876180399615872:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265350.888425:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265350.888434:0:7926:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e92 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbefb expref: 63 pid: 8460 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.888449:0:7926:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbefb expref: 63 pid: 8460 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.888477:0:7926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:3.0:1789265350.888482:0:7926:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96eca lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.888493:0:7926:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96eca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.888501:0:7926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96eca lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.888525:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265350.888610:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf611880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+63:2396:x1876180399615872:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 236us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265350.888619:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 72 00010000:00010000:0.0:1789265350.889110:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96e92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbefb expref: 62 pid: 8460 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265350.889131:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8460:1876180417512576:192.168.203.49@tcp:104: 00010000:00010000:0.0:1789265350.889157:0:8460:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96eca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.889167:0:8460:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96eca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.889185:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96eca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265350.889209:0:8460:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789265350.889381:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a96ec3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf10 expref: 63 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.889408:0:8460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96eca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf10 expref: 62 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.889417:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:0.0:1789265350.889432:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789265350.889435:0:8460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5600, rc 0) 00000100:00100000:0.0:1789265350.889491:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+62:11388:x1876180399615616:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 6630us (7187us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1789265350.889500:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 121 00000100:00100000:1.0:1789265350.895253:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265350.895450:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399616128 00000100:00100000:3.0:1789265350.895465:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399616128 00000100:00100000:3.0:1789265350.895550:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 9 00000100:00100000:3.0:1789265350.895562:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf613b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+62:11388:x1876180399616128:12345-192.168.203.49@tcp:103:lfs.0 00010000:00010000:3.0:1789265350.895582:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265350.895616:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a96e1b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbedf expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.895666:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:3.0:1789265350.895672:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265350.895741:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf613b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+61:11388:x1876180399616128:12345-192.168.203.49@tcp:103:lfs.0 Request processed in 182us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265350.895749:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 9 00000100:00100000:1.0:1789265350.898829:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265350.898940:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399616256 00000100:00100000:2.0:1789265350.898954:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399616256 00000100:00100000:2.0:1789265350.899050:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 122 00000100:00100000:2.0:1789265350.899063:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+61:11388:x1876180399616256:12345-192.168.203.49@tcp:58:lfs.0 00010000:00010000:2.0:1789265350.899224:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a96ed8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.899248:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a96ed8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.899262:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a96ed8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265350.899395:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1789265350.899510:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+61:11388:x1876180399616256:12345-192.168.203.49@tcp:58:lfs.0 Request processed in 449us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265350.899519:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 122 00000100:00100000:3.0:1789265350.902584:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265350.902937:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399616384 00000100:00100000:2.0:1789265350.902950:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399616384 00000100:00100000:2.0:1789265350.903083:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 123 00000100:00100000:2.0:1789265350.903096:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+61:11388:x1876180399616384:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1789265350.903134:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265350.903162:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a96edf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbf17 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.903246:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a96ed8 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.903258:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a96edf lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf17 expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.903282:0:6518:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a96ed8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.903298:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a96edf lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf17 expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.903315:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:2.0:1789265350.903319:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265350.903323:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a96edf lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf17 expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265350.903332:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81692600, rc 0) 00000100:00100000:2.0:1789265350.903563:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+62:11388:x1876180399616384:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 307us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265350.903571:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 123 00010000:00010000:0.0:1789265350.981720:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265350.985671:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265350.985722:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265350.985770:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265350.985809:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265350.985880:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265350.985905:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399616512 00000100:00100000:0.0:1789265350.985919:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399616512 00000100:00100000:0.0:1789265350.985997:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 381 00000100:00100000:0.0:1789265350.986009:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2393:x1876180399616512:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265350.986131:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2393:x1876180399616512:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 123us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265350.986140:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 381 00000100:00100000:0.0:1789265350.986183:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399616768 00000100:00100000:0.0:1789265350.986187:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399616768 00000100:00100000:0.0:1789265350.986228:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 105 00000100:00100000:0.0:1789265350.986235:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+8:2393:x1876180399616768:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265350.986267:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+8:2393:x1876180399616768:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 33us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265350.986275:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 105 00000100:00080000:0.0:1789265350.986292:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265350.986304:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399616640 00000100:00100000:0.0:1789265350.986308:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399616640 00000100:00100000:0.0:1789265350.986343:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399616896 00000100:00100000:0.0:1789265350.986346:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399616896 00000100:00100000:0.0:1789265350.986365:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399617024 00000100:00100000:0.0:1789265350.986368:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399617024 00000100:00100000:0.0:1789265350.986384:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 284 00000100:00100000:0.0:1789265350.986400:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+5:2393:x1876180399616640:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265350.986433:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+5:2393:x1876180399616640:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 35us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265350.986440:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 284 00000100:00100000:0.0:1789265350.986455:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 285 00000100:00100000:0.0:1789265350.986461:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399616896:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265350.986485:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399616896:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 24us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265350.986491:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 285 00000100:00100000:0.0:1789265350.986503:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 286 00000100:00100000:0.0:1789265350.986509:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb849ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399617024:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265350.986534:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb849ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399617024:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 25us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265350.986541:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 286 00000100:00080000:0.0:1789265350.986555:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265350.986558:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265351.169711:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417512704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265351.169819:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265351.169967:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417512704 00000100:00100000:2.0:1789265351.169998:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417512704 00000100:00080000:3.0:1789265351.170267:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265351.170408:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789265351.170421:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417512704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789265351.170470:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265351.170552:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417512704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 134us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265351.170559:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789265351.170686:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417512704:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1789265351.233616:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265351.233630:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265351.233759:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1789265351.233772:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789265351.234580:0:13799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1876180417512832:192.168.203.49@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789265351.234983:0:13799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c48780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265351.246085:0:13799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1876180417512832:192.168.203.49@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789265351.246136:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265351.249988:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399617152 00000100:00100000:1.0:1789265351.250012:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399617152 00000100:00100000:1.0:1789265351.250184:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 124 00000100:00100000:1.0:1789265351.250200:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf548700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+62:11389:x1876180399617152:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 00000100:00080000:3.0:1789265351.250212:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:1.0:1789265351.250253:0:8460:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789265351.250452:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf548700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+62:11389:x1876180399617152:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 Request processed in 255us (4318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265351.250462:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 124 00000100:00100000:1.0:1789265351.256757:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265351.256908:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399617280 00000100:00100000:3.0:1789265351.256923:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399617280 00000100:00100000:3.0:1789265351.257235:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 125 00000100:00100000:3.0:1789265351.257249:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb849cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+62:11389:x1876180399617280:12345-192.168.203.49@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789265351.257366:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96ee6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257388:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96ee6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257417:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96ee6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257446:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96eed lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257462:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96eed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257490:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96eed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257521:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96ef4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257531:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257539:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265351.257603:0:8459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789265351.257609:0:8459:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265351.257637:0:8459:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257650:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96ee6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257658:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96ee6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257665:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96ee6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257672:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265351.257678:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96ee6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257686:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96ee6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257709:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fccbd2b4c00) 00010000:00010000:3.0:1789265351.257712:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265351.257718:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96ee6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257725:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a96ee6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257741:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96eed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257747:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96eed lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257753:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96eed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257760:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81491600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265351.257763:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96eed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257770:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96eed lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257779:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9fcca967b700) 00010000:00010000:3.0:1789265351.257781:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265351.257784:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96eed lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257790:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a96eed lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257823:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257830:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96ef4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257836:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257841:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265351.257845:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257852:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96ef4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257872:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:3.0:1789265351.257875:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265351.257878:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96ef4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.257884:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96ef4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265351.258004:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb849cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+62:11389:x1876180399617280:12345-192.168.203.49@tcp:34:lhsmtool_posix.0 Request processed in 758us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265351.258013:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 125 00000100:00100000:2.0:1789265351.262748:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265351.262885:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399617536 00000100:00100000:0.0:1789265351.262900:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399617536 00000100:00100000:0.0:1789265351.262993:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 126 00000100:00100000:0.0:1789265351.263006:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+62:11389:x1876180399617536:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265351.263076:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265351.263255:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96efb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbf1e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.263396:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.263416:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.263431:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265351.263445:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789265351.263550:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.263559:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f02 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.263566:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.263572:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265351.263578:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.263608:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.263623:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:0.0:1789265351.263626:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789265351.263632:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f02 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.263639:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.263771:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96efb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf1e expref: 64 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.263783:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fccbd2b4c00) 00010000:00010000:0.0:1789265351.263785:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265351.263789:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96efb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf1e expref: 64 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.263800:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5e00, rc 0) 00000100:00100000:0.0:1789265351.263889:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+63:11389:x1876180399617536:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 886us (1156us total) trans 4294967399 rc 301/301 00000100:00100000:0.0:1789265351.263897:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 126 00000100:00100000:0.0:1789265351.272325:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265351.272428:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399617664 00000100:00100000:2.0:1789265351.272441:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399617664 00000100:00100000:2.0:1789265351.272520:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 127 00000100:00100000:2.0:1789265351.272533:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+63:11389:x1876180399617664:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789265351.272582:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789265351.272777:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+63:11389:x1876180399617664:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 Request processed in 246us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265351.272786:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 127 00000100:00100000:3.0:1789265351.282157:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265351.282261:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399617920 00000100:00100000:1.0:1789265351.282276:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399617920 00000100:00100000:1.0:1789265351.282344:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 128 00000100:00100000:1.0:1789265351.282357:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf549880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+63:11389:x1876180399617920:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265351.282387:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265351.282410:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789265351.282454:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96ea0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf02 expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.282485:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:1.0:1789265351.282491:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265351.282511:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96f10 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbf25 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789265351.283272:0:8459:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1789265351.283446:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96f17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.283461:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96f17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.283473:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96f17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.283537:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96f10 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf25 expref: 65 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.283556:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96f17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf25 expref: 64 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.283565:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fccacd4ea00) 00010000:00010000:1.0:1789265351.283568:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265351.283571:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2ffc00, rc 0) 00000100:00100000:1.0:1789265351.283825:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf549880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+64:11389:x1876180399617920:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 1469us (1682us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1789265351.283864:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 128 00000100:00100000:1.0:1789265351.290982:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265351.291237:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399618176 00000100:00100000:0.0:1789265351.291250:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399618176 00000100:00100000:0.0:1789265351.291322:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 129 00000100:00100000:0.0:1789265351.291333:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb849cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+64:11389:x1876180399618176:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789265351.291442:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265351.291479:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96f17 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf25 expref: 64 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.291503:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fccacd4ea00) 00010000:00010000:0.0:1789265351.291516:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265351.291541:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96f25 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.291557:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96f25 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.291568:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96f25 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.291584:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f2c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x4eeb4887 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.291592:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x4eeb4887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.291599:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x4eeb4887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.291655:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96f25 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.291674:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96f25 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.291681:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96f25 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.291695:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265351.291701:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96f25 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.291709:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96f25 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.291719:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:0.0:1789265351.291722:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265351.291727:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96f25 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.291733:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96f25 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.291744:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x4eeb4887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.291749:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f2c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x4eeb4887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.291755:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f2c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x4eeb4887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.291760:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265351.291762:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f2c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x4eeb4887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.291767:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f2c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x4eeb4887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.291786:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x4eeb4887 (ffff9fcca9673500) 00010000:00010000:0.0:1789265351.291789:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265351.291792:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f2c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x4eeb4887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.291798:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f2c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x4eeb4887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265351.291913:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb849cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+63:11389:x1876180399618176:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 Request processed in 580us (943us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789265351.291921:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 129 00000100:00100000:3.0:1789265351.296885:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265351.300453:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399618304 00000100:00100000:0.0:1789265351.300470:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399618304 00000100:00100000:0.0:1789265351.300548:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 130 00000100:00100000:0.0:1789265351.300558:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+63:11389:x1876180399618304:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265351.300584:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265351.300612:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96f33 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbf2c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.300656:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96f3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.300929:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96f3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.300944:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96f3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.301203:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a96f33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf2c expref: 65 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.301230:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96f3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf2c expref: 64 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.301240:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fcca9673c00) 00010000:00010000:0.0:1789265351.301243:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789265351.301247:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5800, rc 0) 00000100:00100000:0.0:1789265351.301386:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+64:11389:x1876180399618304:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 827us (4515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265351.301394:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 130 00000100:00100000:3.0:1789265351.305378:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265351.305525:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399618560 00000100:00100000:1.0:1789265351.305540:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399618560 00000100:00100000:1.0:1789265351.305637:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 131 00000100:00100000:1.0:1789265351.305650:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+64:11389:x1876180399618560:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789265351.305782:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96f41 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.305805:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96f41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.305820:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96f41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265351.306110:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1789265351.306123:0:8459:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 402536099506ns, next at 403536095822ns, rc = 0 00000004:00010000:1.0:1789265351.306187:0:8459:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd59e68c reply state 00000000a85b50b8 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96f41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.306204:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96f41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.306213:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fcca9673c00) 00010000:00010000:1.0:1789265351.306215:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789265351.306219:0:8459:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789265351.306346:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+66:11389:x1876180399618560:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 Request processed in 697us (980us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1789265351.306354:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 131 00000100:00100000:1.0:1789265351.309994:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265351.310319:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399618688 00000100:00100000:2.0:1789265351.310332:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399618688 00000100:00100000:1.0:1789265351.310490:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 132 00000100:00100000:1.0:1789265351.310504:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb849cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+66:11389:x1876180399618688:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265351.310540:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265351.310568:0:8460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96f48 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbf33 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.310844:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96f48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf33 expref: 67 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.310874:0:8460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96f48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf33 expref: 67 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.310899:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fcca9673c00) 00010000:00010000:1.0:1789265351.310903:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265351.310907:0:8460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2ffe00, rc 0) 00000100:00100000:1.0:1789265351.311112:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb849cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+67:11389:x1876180399618688:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 610us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265351.311130:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 132 00000100:00100000:3.0:1789265351.314526:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265351.316213:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399618816 00000100:00100000:1.0:1789265351.316234:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399618816 00000100:00100000:1.0:1789265351.316386:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 45 00000100:00100000:1.0:1789265351.316410:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+8:2395:x1876180399618816:12345-192.168.203.49@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789265351.316940:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+9:2395:x1876180399618816:12345-192.168.203.49@tcp:2:lhsmtool_posix.0 Request processed in 538us (2422us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789265351.316951:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 45 00000100:00100000:3.0:1789265351.323907:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265351.325139:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399619072 00000100:00100000:0.0:1789265351.325160:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399619072 00000100:00100000:0.0:1789265351.325247:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 30 00000100:00100000:0.0:1789265351.325259:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+67:11389:x1876180399619072:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789265351.325809:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+68:11389:x1876180399619072:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 Request processed in 549us (1914us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1789265351.325820:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 30 00000100:00100000:3.0:1789265351.333155:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265351.333963:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399619328 00000100:00100000:0.0:1789265351.333978:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399619328 00000100:00100000:0.0:1789265351.334165:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 133 00000100:00100000:0.0:1789265351.334178:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+68:11389:x1876180399619328:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789265351.334344:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+68:11389:x1876180399619328:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 Request processed in 168us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265351.334353:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 133 00000100:00100000:3.0:1789265351.341001:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265351.341161:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399619456 00000100:00100000:1.0:1789265351.341174:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399619456 00000100:00100000:1.0:1789265351.341256:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 134 00000100:00100000:1.0:1789265351.341269:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+68:11389:x1876180399619456:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265351.341310:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265351.341338:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a96f4f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbf3a expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.341433:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96f56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.341463:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96f56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.341479:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96f56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265351.341540:0:8459:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789265351.341565:0:8459:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96f56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.341605:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a96f4f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf3a expref: 70 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.341626:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96f56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf3a expref: 69 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.341636:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fcca9673c00) 00010000:00010000:1.0:1789265351.341639:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789265351.341643:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fe800, rc 0) 00000100:00100000:1.0:1789265351.342085:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+69:11389:x1876180399619456:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 473us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265351.342096:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 134 00000100:00100000:3.0:1789265351.348277:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265351.354875:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399619584 00000100:00100000:0.0:1789265351.360932:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399619584 00000100:00100000:1.0:1789265351.361305:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 46 00000100:00100000:1.0:1789265351.361320:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+9:2395:x1876180399619584:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265351.361343:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265351.361374:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c15dd05/0x9272d942b4a96f5d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbf41 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789265351.361409:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa605c8, blocks: 0x0 00010000:00010000:1.0:1789265351.361436:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=402s v=(0 0) 00010000:00010000:1.0:1789265351.361442:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265351.361454:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c15dd05/0x9272d942b4a96f5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf41 expref: 10 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.361476:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c15dd05/0x9272d942b4a96f5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf41 expref: 10 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.361493:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2ff800, rc 0) 00000100:00100000:1.0:1789265351.361593:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+10:2395:x1876180399619584:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 277us (13329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265351.361601:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 46 00000100:00100000:3.0:1789265351.369188:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265351.370192:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399619840 00000100:00100000:1.0:1789265351.370213:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399619840 00000100:00100000:1.0:1789265351.370307:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 135 00000100:00100000:1.0:1789265351.370320:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+69:11389:x1876180399619840:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789265351.370501:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+69:11389:x1876180399619840:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 Request processed in 183us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265351.370510:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 135 00000100:00100000:3.0:1789265351.379739:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265351.386412:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399619968 00000100:00100000:2.0:1789265351.386438:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399619968 00000100:00100000:2.0:1789265351.386538:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 47 00000100:00100000:2.0:1789265351.386551:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+10:11389:x1876180399619968:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265351.386575:0:8914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265351.386608:0:8914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000731fc844/0x9272d942b4a96f64 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbf48 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265351.386649:0:8914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c15dd05/0x9272d942b4a96f5d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf41 expref: 11 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265351.386676:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265351.386681:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265351.386687:0:8914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000731fc844/0x9272d942b4a96f64 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf48 expref: 11 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265351.386731:0:8914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000c15dd05/0x9272d942b4a96f5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf41 expref: 11 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265351.386748:0:8914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000c15dd05/0x9272d942b4a96f5d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf41 expref: 11 pid: 8433 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265351.386766:0:8914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8914:1876180417512960:192.168.203.49@tcp:104: 00000100:00100000:2.0:1789265351.386919:0:8914:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265351.389979:0:8914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8914:1876180417512960:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265351.390075:0:8914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000731fc844/0x9272d942b4a96f64 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf48 expref: 11 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265351.390114:0:8914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81692c00, rc 0) 00000100:00100000:2.0:1789265351.390197:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+11:11389:x1876180399619968:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 3648us (10470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265351.390209:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 47 00000100:00100000:1.0:1789265351.398565:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265351.398867:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399620096 00000100:00100000:0.0:1789265351.398881:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399620096 00010000:00010000:0.0:1789265351.398933:0:7926:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000c15dd05/0x9272d942b4a96f5d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf41 expref: 11 pid: 8433 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265351.398984:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 73 00000100:00100000:0.0:1789265351.398995:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+11:2396:x1876180399620096:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265351.399014:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265351.399065:0:7926:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000c15dd05/0x9272d942b4a96f5d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf41 expref: 11 pid: 8433 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.399081:0:7926:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000c15dd05/0x9272d942b4a96f5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf41 expref: 11 pid: 8433 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.399111:0:7926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c15dd05/0x9272d942b4a96f5d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf41 expref: 11 pid: 8433 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.399133:0:7926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265351.399137:0:7926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265351.399148:0:7926:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000731fc844/0x9272d942b4a96f64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf48 expref: 10 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.399160:0:7926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000731fc844/0x9272d942b4a96f64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf48 expref: 10 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.399207:0:7926:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000731fc844/0x9272d942b4a96f64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf48 expref: 10 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265351.399245:0:7926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf609c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7926:1876180417513088:192.168.203.49@tcp:105: 00000100:00100000:0.0:1789265351.399370:0:7926:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c48300 going to sleep for 11 seconds 00000100:00100000:0.0:1789265351.410759:0:7926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf609c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7926:1876180417513088:192.168.203.49@tcp:105: 00010000:00010000:0.0:1789265351.410797:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265351.410902:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+10:2396:x1876180399620096:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 11907us (12349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265351.410917:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 73 00000100:00100000:3.0:1789265351.415471:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265351.416907:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399620224 00000100:00100000:2.0:1789265351.416928:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399620224 00002000:00100000:2.0:1789265351.417010:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9fcb838f5f80 x1876180399620224/t0(0) o4->5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp:677/0 lens 504/0 e 0 to 0 dl 1789265362 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789265351.417086:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fcb838f5f80 with x1876180399620224 ext(0->12) 00002000:00010000:2.0:1789265351.417095:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fcb838f5f80 00000100:00100000:2.0:1789265351.417141:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 2 00000100:00100000:2.0:1789265351.417153:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5b43750b-84cf-4d62-9028-e016267b6509+10:2395:x1876180399620224:12345-192.168.203.49@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789265351.420790:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5b43750b-84cf-4d62-9028-e016267b6509+12:2395:x1876180399620224:12345-192.168.203.49@tcp:4:lhsmtool_posix.0 Request processed in 3620us (5870us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789265351.420810:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 2 00002000:00100000:2.0:1789265351.420827:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9fcb838f5f80 x1876180399620224/t4294967309(0) o4->5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp:677/0 lens 504/448 e 0 to 0 dl 1789265362 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789265351.420840:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fcb838f5f80 with x1876180399620224 ext(0->12) 00002000:00010000:2.0:1789265351.420848:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fcb838f5f80 00000100:00100000:3.0:1789265351.435232:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265351.435546:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399620352 00000100:00100000:0.0:1789265351.435559:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399620352 00000100:00100000:0.0:1789265351.435681:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 136 00000100:00100000:0.0:1789265351.435693:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+69:11389:x1876180399620352:12345-192.168.203.49@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789265351.440092:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1789265351.440111:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1789265351.440148:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1789265351.440179:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fcc906d4180 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1789265351.440185:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fccb5e39100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fcc906d4240 00000020:00080000:2.0:1789265351.440188:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fccbc51a700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fcb82d8d000 00000004:00080000:2.0:1789265351.440212:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1789265351.440234:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fcb83cb4780 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1789265351.440237:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fcb8218e700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fcb83cb4c00 00000020:00080000:2.0:1789265351.440240:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fcb8218ef00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fcb83917800 00000020:00080000:2.0:1789265351.440254:0:6495:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:3.0:1789265351.440464:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96c69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.440475:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96c69 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.440482:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96c69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.440488:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81491000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265351.440493:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96c69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.440500:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96c69 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.440518:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fccacd4ef00) 00010000:00010000:3.0:1789265351.440521:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265351.440525:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96c69 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.440531:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96c69 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.440566:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96d11 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.440682:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96d11 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.440688:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96d11 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.440693:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fe000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265351.440697:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96d11 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.440703:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96d11 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.440713:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fccacd4ee00) 00010000:00010000:3.0:1789265351.440715:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265351.440718:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96d11 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265351.440724:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417513344:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1789265351.440725:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a96d11 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265351.440793:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265351.440810:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96d8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.440818:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96d8f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.440824:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96d8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265351.440834:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1789265351.440836:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520a600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265351.440841:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96d8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265351.440843:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417513216:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789265351.440866:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96d8f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.440877:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fcb83b86600) 00010000:00010000:3.0:1789265351.440880:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265351.440883:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96d8f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265351.440884:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265351.440894:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a96d8f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.440909:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96db2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.440915:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96db2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.440921:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96db2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.440926:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520b600 already unused, calling callback (ffffffffc17a14f0) 00000100:00100000:0.0:1789265351.440927:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417513344 00010000:00010000:3.0:1789265351.440930:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96db2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265351.440936:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417513344 00010000:00010000:3.0:1789265351.440938:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96db2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.440961:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fcb83b86600) 00010000:00010000:3.0:1789265351.440964:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265351.440967:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96db2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.440973:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a96db2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265351.440989:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417513216 00000100:00100000:0.0:1789265351.440994:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417513216 00010000:00010000:3.0:1789265351.440997:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96e84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.441004:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96e84 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.441011:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96e84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.441016:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520ac00 already unused, calling callback (ffffffffc17a14f0) 00000100:00100000:0.0:1789265351.441020:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789265351.441057:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3642:x1876180417513344:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1789265351.441064:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96e84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.441075:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96e84 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.441086:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:3.0:1789265351.441089:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265351.441092:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96e84 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.441100:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a96e84 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.441129:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96f41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.441136:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96f41 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.441143:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96f41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.441149:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fe400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265351.441153:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96f41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.441160:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96f41 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789265351.441181:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789265351.441187:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789265352 00002000:00010000:0.0:1789265351.441195:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789265351.441198:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789265352 -> 1789265352 00002000:00010000:0.0:1789265351.441200:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1789265351.441238:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3642:x1876180417513344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 183us (447us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789265351.441246:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789265351.441261:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789265351.441268:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3642:x1876180417513216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789265351.441284:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:0.0:1789265351.441301:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba8b6fa1/0x9272d942b4a96f6b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.441319:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000068e08b86/0x9272d942b4a96d1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbea0 expref: 11 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.441327:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789265351.441331:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265351.441335:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba8b6fa1/0x9272d942b4a96f6b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.441360:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000068e08b86/0x9272d942b4a96d1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbea0 expref: 11 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.441373:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000068e08b86/0x9272d942b4a96d1f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbea0 expref: 11 pid: 8434 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265351.441385:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8434:1876180417513472:192.168.203.49@tcp:104: 00000100:00100000:0.0:1789265351.441452:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c48b40 going to sleep for 11 seconds 00000004:00080000:0.0:1789265351.441487:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fccbf609c00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789265351.441493:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417513344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789265351.441576:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+17:11389:x1876180399620352:12345-192.168.203.49@tcp:44:lhsmtool_posix.0 Request processed in 5885us (6359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265351.441584:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 136 00010000:00010000:3.0:1789265351.441806:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fcca9673c00) 00010000:00010000:3.0:1789265351.441809:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789265351.441813:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96f41 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.441820:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96f41 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789265351.441832:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:2.0:1789265351.441847:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1789265351.441904:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1789265351.451166:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265351.451190:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417513600:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789265351.451264:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265351.452315:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417513600 00000100:00100000:0.0:1789265351.452326:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417513600 00000100:00100000:0.0:1789265351.452390:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789265351.452399:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3644:x1876180417513600:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789265351.452429:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:0.0:1789265351.452459:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa605c6, atime: 0x6aa605c7, ctime: 0x6aa605c6, blocks: 0x8 00010000:00010000:0.0:1789265351.452467:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a96f72 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.452483:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=402s v=(0 0) 00010000:00010000:0.0:1789265351.452487:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265351.452492:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a96f72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.452509:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a96f72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.452519:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a96f72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.452546:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a96f72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.452576:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789265351.452744:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3644:x1876180417513600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 345us (1479us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789265351.452753:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:2.0:1789265351.452762:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fccbf60a680/2, rc 0, transno 4294967305 00000100:00100000:2.0:1789265351.452772:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417513600:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789265351.453011:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265351.453019:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a96f72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.453056:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5e00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265351.453061:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a96f72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.453079:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a96f72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.453096:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a96f72 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.453104:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a96f72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.453121:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265351.453123:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265351.453125:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265351.453718:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265351.453901:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8434:1876180417513472:192.168.203.49@tcp:104: 00010000:00010000:0.0:1789265351.453921:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba8b6fa1/0x9272d942b4a96f6b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265351.456878:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399620480 00000100:00100000:3.0:1789265351.456893:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399620480 00010000:00010000:3.0:1789265351.456941:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000068e08b86/0x9272d942b4a96d1f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbea0 expref: 12 pid: 8434 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265351.457149:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 74 00000100:00100000:3.0:1789265351.457159:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb849cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+12:2396:x1876180399620480:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265351.457188:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265351.457195:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000068e08b86/0x9272d942b4a96d1f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbea0 expref: 12 pid: 8434 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.457207:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000068e08b86/0x9272d942b4a96d1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbea0 expref: 12 pid: 8434 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.457248:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068e08b86/0x9272d942b4a96d1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbea0 expref: 12 pid: 8434 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.457265:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265351.457269:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265351.457274:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba8b6fa1/0x9272d942b4a96f6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.457284:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba8b6fa1/0x9272d942b4a96f6b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.457312:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265351.457378:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb849cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+11:2396:x1876180399620480:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 220us (3662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265351.457385:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 74 00000100:00100000:2.0:1789265351.457510:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265351.457685:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399620608 00000100:00100000:0.0:1789265351.457691:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399620608 00000100:00100000:0.0:1789265351.457723:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 51 00000100:00100000:0.0:1789265351.457731:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+11:2394:x1876180399620608:12345-192.168.203.49@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1789265351.458171:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba8b6fa1/0x9272d942b4a96f6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265351.458184:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba8b6fa1/0x9272d942b4a96f6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265351.458194:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba8b6fa1/0x9272d942b4a96f6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265351.458202:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba8b6fa1/0x9272d942b4a96f6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265351.458222:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265351.458330:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265351.458339:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba8b6fa1/0x9272d942b4a96f6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.458348:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5200 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265351.458353:0:7473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba8b6fa1/0x9272d942b4a96f6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.458364:0:7473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba8b6fa1/0x9272d942b4a96f6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.458383:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba8b6fa1/0x9272d942b4a96f6b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.458392:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba8b6fa1/0x9272d942b4a96f6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.458414:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265351.458417:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265351.458418:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265351.459012:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3642:x1876180417513216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17742us (18126us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789265351.459049:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:0.0:1789265351.459361:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fccbf60aa00/2, rc 0, transno 4294967311 00000100:00100000:0.0:1789265351.459375:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417513216:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1789265351.460590:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1789265351.460607:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1789265351.463427:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+6:2394:x1876180399620608:12345-192.168.203.49@tcp:16:lhsmtool_posix.0 Request processed in 5684us (5906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265351.463460:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 51 00000100:00100000:2.0:1789265351.473767:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265351.474242:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399620864 00000100:00100000:0.0:1789265351.474253:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399620864 00000100:00100000:0.0:1789265351.474319:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 137 00000100:00100000:0.0:1789265351.474330:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+16:11389:x1876180399620864:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789265351.474387:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265351.474427:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a96f56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf3a expref: 16 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.474446:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fcca9673c00) 00010000:00010000:0.0:1789265351.474451:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265351.474481:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96f79 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.474494:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96f79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.474504:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96f79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789265351.474635:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7143aa7 reply state 000000005d143fdf transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96f79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.474648:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96f79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.474654:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fcca9673c00) 00010000:00010000:0.0:1789265351.474657:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789265351.474659:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789265351.474762:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+17:11389:x1876180399620864:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 Request processed in 434us (1005us total) trans 4294967403 rc 0/0 00000100:00100000:0.0:1789265351.474770:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 137 00000100:00100000:2.0:1789265351.477943:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265351.478238:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399620992 00000100:00100000:0.0:1789265351.478251:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399620992 00000100:00100000:0.0:1789265351.478561:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 52 00000100:00100000:0.0:1789265351.478575:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+6:2396:x1876180399620992:12345-192.168.203.49@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789265351.478808:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789265351.478812:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1789265352 -> 1789265351 00002000:00010000:0.0:1789265351.478815:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789265351 00002000:00010000:0.0:1789265351.478817:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789265352 -> 1789265351 00002000:00010000:0.0:1789265351.478818:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789265351.478915:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+7:2396:x1876180399620992:12345-192.168.203.49@tcp:2:lhsmtool_posix.0 Request processed in 342us (989us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789265351.478925:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 52 00000100:00100000:1.0:1789265351.482361:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265351.483139:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399621248 00000100:00100000:1.0:1789265351.483151:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399621248 00000100:00100000:1.0:1789265351.483234:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 138 00000100:00100000:1.0:1789265351.483254:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb849cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+17:11389:x1876180399621248:12345-192.168.203.49@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789265351.483413:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96f80 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.483430:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96f3a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf2c expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.483439:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96f80 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.483475:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96f3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf2c expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.483489:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96f3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf2c expref: 17 pid: 6516 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265351.483506:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb849cd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876180417513728:192.168.203.49@tcp:104: 00000100:00100000:1.0:1789265351.483606:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc906d4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265351.489315:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb849cd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876180417513728:192.168.203.49@tcp:104: 00010000:00010000:1.0:1789265351.489344:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96f80 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265351.490706:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265351.490885:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399621376 00000100:00100000:1.0:1789265351.490894:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399621376 00010000:00010000:1.0:1789265351.490937:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96f3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf2c expref: 18 pid: 6516 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265351.490977:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 75 00000100:00100000:1.0:1789265351.490987:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+18:2396:x1876180399621376:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265351.491002:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265351.491008:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96f3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf2c expref: 18 pid: 6516 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.491052:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96f3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf2c expref: 18 pid: 6516 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.491077:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a96f3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf2c expref: 18 pid: 6516 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.491097:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fcca9673c00) 00010000:00010000:1.0:1789265351.491102:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96f80 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.491111:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96f80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.491117:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96f80 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.491139:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265351.491314:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+17:2396:x1876180399621376:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 328us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265351.491326:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 75 00010000:00010000:2.0:1789265351.491443:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96f80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265351.491451:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96f80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265351.491491:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96f80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265351.491498:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96f80 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265351.491505:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96f80 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265351.491513:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fec00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265351.491518:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96f80 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265351.491527:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96f80 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265351.491538:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fcca9673c00) 00010000:00010000:2.0:1789265351.491542:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789265351.491547:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96f80 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265351.491552:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a96f80 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265351.491615:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb849cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+16:11389:x1876180399621248:12345-192.168.203.49@tcp:55:lhsmtool_posix.0 Request processed in 8371us (9266us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789265351.491634:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 138 00000100:00100000:2.0:1789265351.495526:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265351.499878:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399621504 00000100:00100000:0.0:1789265351.499895:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399621504 00000100:00100000:1.0:1789265351.501937:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 53 00000100:00100000:1.0:1789265351.501953:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+7:2395:x1876180399621504:12345-192.168.203.49@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789265351.501999:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bc537cfd/0x9272d942b4a96f87 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.502019:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000731fc844/0x9272d942b4a96f64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf48 expref: 7 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.502055:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265351.502059:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789265351.502063:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc537cfd/0x9272d942b4a96f87 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.502101:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000731fc844/0x9272d942b4a96f64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf48 expref: 7 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.502116:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000731fc844/0x9272d942b4a96f64 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf48 expref: 7 pid: 8914 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265351.502130:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb849cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8434:1876180417513856:192.168.203.49@tcp:104: 00000100:00100000:1.0:1789265351.502231:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc906d4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265351.509506:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265351.509555:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399621632 00000100:00100000:3.0:1789265351.509568:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399621632 00010000:00010000:3.0:1789265351.509620:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000731fc844/0x9272d942b4a96f64 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf48 expref: 8 pid: 8914 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265351.509666:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 76 00000100:00100000:3.0:1789265351.509678:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+8:2395:x1876180399621632:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265351.509697:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265351.509726:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000731fc844/0x9272d942b4a96f64 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf48 expref: 8 pid: 8914 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.509757:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000731fc844/0x9272d942b4a96f64 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf48 expref: 8 pid: 8914 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.509790:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265351.509795:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265351.509802:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc537cfd/0x9272d942b4a96f87 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.509814:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc537cfd/0x9272d942b4a96f87 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.509840:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265351.509918:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+8:2395:x1876180399621632:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 241us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265351.509927:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 76 00010000:00010000:0.0:1789265351.513186:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000731fc844/0x9272d942b4a96f64 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf48 expref: 7 pid: 8914 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265351.513217:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb849cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8434:1876180417513856:192.168.203.49@tcp:104: 00010000:00010000:0.0:1789265351.513244:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bc537cfd/0x9272d942b4a96f87 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.513255:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bc537cfd/0x9272d942b4a96f87 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.513265:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc537cfd/0x9272d942b4a96f87 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.513296:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bc537cfd/0x9272d942b4a96f87 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.513342:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc537cfd/0x9272d942b4a96f87 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.513350:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc537cfd/0x9272d942b4a96f87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.513357:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ffc00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265351.513361:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc537cfd/0x9272d942b4a96f87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.513369:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc537cfd/0x9272d942b4a96f87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.513392:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc537cfd/0x9272d942b4a96f87 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.513399:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc537cfd/0x9272d942b4a96f87 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265351.513493:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399621504:12345-192.168.203.49@tcp:1:lhsmtool_posix.0 Request processed in 11543us (17976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265351.513503:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 53 00000100:00100000:3.0:1789265351.527806:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265351.527965:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399621888 00000100:00100000:0.0:1789265351.527980:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399621888 00000100:00100000:0.0:1789265351.528110:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 139 00000100:00100000:0.0:1789265351.528145:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+16:11389:x1876180399621888:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789265351.528271:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f8e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.528296:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96e7d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbef4 expref: 16 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.528309:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f8e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.528497:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96e7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbef4 expref: 16 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.528538:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96e7d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbef4 expref: 16 pid: 8459 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265351.528554:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb849cfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876180417513984:192.168.203.49@tcp:104: 00000100:00100000:1.0:1789265351.528649:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc906d4540 going to sleep for 11 seconds 00000100:00100000:1.0:1789265351.538272:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb849cfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876180417513984:192.168.203.49@tcp:104: 00010000:00010000:1.0:1789265351.538306:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f8e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265351.544281:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265351.544401:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399622016 00000100:00100000:0.0:1789265351.544414:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399622016 00010000:00010000:0.0:1789265351.544464:0:7926:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96e7d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbef4 expref: 17 pid: 8459 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265351.544510:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 77 00000100:00100000:0.0:1789265351.544520:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+17:2395:x1876180399622016:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265351.544534:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265351.544540:0:7926:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96e7d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbef4 expref: 17 pid: 8459 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.544553:0:7926:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96e7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbef4 expref: 17 pid: 8459 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.544587:0:7926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a96e7d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbef4 expref: 17 pid: 8459 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.544606:0:7926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:0.0:1789265351.544626:0:7926:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a96edf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf17 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.544637:0:7926:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f8e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.544644:0:7926:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.544651:0:7926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f8e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.544693:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265351.544876:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265351.544885:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.545985:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96f95 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.546018:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96f48 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf33 expref: 17 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265351.546039:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+17:2395:x1876180399622016:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 1492us (1745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265351.546060:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 77 00010000:00010000:3.0:1789265351.546080:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96f95 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.546299:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96f48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf33 expref: 16 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265351.546333:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96f48 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf33 expref: 16 pid: 8460 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265351.546352:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d27800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876180417514112:192.168.203.49@tcp:104: 00000100:00100000:3.0:1789265351.546533:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3ea300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265351.550268:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265351.550492:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399622144 00000100:00100000:2.0:1789265351.550507:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399622144 00010000:00010000:2.0:1789265351.550555:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96f48 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf33 expref: 17 pid: 8460 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265351.551306:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d27800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876180417514112:192.168.203.49@tcp:104: 00010000:00010000:0.0:1789265351.551347:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96f95 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265351.551508:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 78 00000100:00100000:2.0:1789265351.551522:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+17:2396:x1876180399622144:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265351.551538:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265351.551546:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96f48 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf33 expref: 17 pid: 8460 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265351.551561:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96f48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf33 expref: 17 pid: 8460 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265351.551789:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96f48 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf33 expref: 17 pid: 8460 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265351.551805:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fcca9673c00) 00010000:00010000:2.0:1789265351.551810:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96f95 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265351.551918:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96f95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265351.551927:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96f95 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265351.552240:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265351.552305:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+16:2396:x1876180399622144:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 785us (2049us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265351.552330:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 78 00010000:00010000:0.0:1789265351.552748:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96f95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.552757:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96f95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789265351.552870:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1789265351.552987:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1789265351.555202:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1789265351.555375:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6516:1876180417514240:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789265351.555460:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265351.555495:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc913b7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265351.555556:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417514240 00000100:00100000:3.0:1789265351.555572:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417514240 00000100:00100000:3.0:1789265351.555658:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789265351.555671:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6516:x1876180417514240:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789265351.555823:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6516:x1876180417514240:12345-0@lo:1000:mdt00_000.0 Request processed in 155us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265351.555832:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789265351.555888:0:6516:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1789265351.555900:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:0.0:1789265351.555924:0:6516:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fccbf609c00, transno 4294967310 00000100:00100000:0.0:1789265351.555948:0:6516:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9fccbf60aa00 x1876180417513216/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789265367 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265351.555960:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6516:1876180417514240:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789265351.556133:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1789265351.556191:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6516:1876180417514368:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789265351.556230:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265351.556988:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c48600 going to sleep for 11 seconds 00000100:00100000:1.0:1789265351.557619:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417514368 00000100:00100000:1.0:1789265351.557628:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417514368 00000100:00100000:1.0:1789265351.557687:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789265351.557695:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6516:x1876180417514368:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789265351.557875:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6516:x1876180417514368:12345-0@lo:1000:mdt00_000.0 Request processed in 179us (1645us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789265351.557882:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789265351.558056:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6516:1876180417514368:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789265351.558104:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96f95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.558125:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96f95 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.558132:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96f95 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.558138:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81491000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265351.558142:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96f95 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.558148:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96f95 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.558182:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fcca9673c00) 00010000:00010000:0.0:1789265351.558185:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265351.558190:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96f95 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.558195:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a96f95 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.558218:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a96ed8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.558224:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a96ed8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.558229:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a96ed8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.558233:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81692e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265351.558235:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a96ed8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.558240:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a96ed8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.558246:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:0.0:1789265351.558249:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265351.558255:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a96edf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf17 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.558265:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a96edf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf17 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.558283:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a96edf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf17 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.558313:0:6516:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a96edf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf17 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265351.560627:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876180417514496:192.168.203.49@tcp:105: 00000100:00100000:0.0:1789265351.560743:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb094ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265351.564248:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265351.564345:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876180417514496:192.168.203.49@tcp:105: 00010000:00010000:0.0:1789265351.564379:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a96ed8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.564390:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692e00/0x9272d942b4a96ed8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.564427:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96f9c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.564440:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96f9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.564450:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96f9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.564459:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96f9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.564464:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96f9c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.564485:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96f9c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.564491:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265351.564495:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96f9c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.564501:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96f9c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.564512:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:0.0:1789265351.564514:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265351.564517:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96f9c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.564523:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a96f9c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.564532:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.564537:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f8e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.564542:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f8e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.564546:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265351.564548:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f8e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.564563:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f8e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.564570:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:0.0:1789265351.564572:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789265351.564575:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f8e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.564580:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a96f8e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265351.564765:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+19:11389:x1876180399621888:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 Request processed in 36623us (36972us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1789265351.564775:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 139 00000020:00080000:0.0:1789265351.564781:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789265351.564886:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399622272 00000100:00100000:1.0:1789265351.564894:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399622272 00000100:00100000:1.0:1789265351.564951:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 31 00000100:00100000:1.0:1789265351.564962:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+19:11388:x1876180399622272:12345-192.168.203.49@tcp:49:lfs.0 00000100:00100000:1.0:1789265351.565115:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+19:11388:x1876180399622272:12345-192.168.203.49@tcp:49:lfs.0 Request processed in 155us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265351.565122:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 31 00000040:00080000:3.0:1789265351.565356:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789265351.565365:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789265351.569805:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789265351.570140:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789265351.575438:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265351.575546:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265351.575647:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399622784 00000100:00100000:0.0:1789265351.575662:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399622784 00000100:00100000:0.0:1789265351.575748:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 140 00000100:00100000:0.0:1789265351.575760:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+19:11388:x1876180399622784:12345-192.168.203.49@tcp:58:lfs.0 00000040:00080000:0.0:1789265351.575953:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1789265351.576074:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+19:11388:x1876180399622784:12345-192.168.203.49@tcp:58:lfs.0 Request processed in 316us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265351.576082:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 140 00000100:00100000:1.0:1789265351.576683:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399622528 00000100:00100000:1.0:1789265351.576722:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399622528 00000100:00100000:1.0:1789265351.576782:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 32 00000100:00100000:1.0:1789265351.576793:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdcc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+19:11389:x1876180399622528:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789265351.577096:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789265351.577136:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:1.0:1789265351.577171:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96fa3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.577190:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96fa3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.577205:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96fa3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.577215:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96fa3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.577222:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96fa3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.577228:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96fa3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.577246:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789265351.577344:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdcc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+21:11389:x1876180399622528:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 Request processed in 553us (1919us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1789265351.577352:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 32 00000020:00080000:1.0:1789265351.577357:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789265351.577377:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265351.577390:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96fa3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.577400:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff200 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265351.577421:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96fa3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.577431:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96fa3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.577448:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fcca9673c00) 00010000:00010000:0.0:1789265351.577451:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789265351.577455:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96fa3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.577461:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96fa3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.577477:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265351.577479:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265351.577481:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265351.618625:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265351.618832:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399622912 00000100:00100000:1.0:1789265351.618865:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399622912 00000100:00100000:1.0:1789265351.619229:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 141 00000100:00100000:1.0:1789265351.619260:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+21:11391:x1876180399622912:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1789265351.619296:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265351.619332:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96faa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbf4f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.619415:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96fb1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.619441:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96fb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.619456:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96fb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.619473:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96fb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.619482:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.619490:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.619585:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96fbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.619598:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96eca lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf10 expref: 22 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.619609:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96fbf lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.619662:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96eca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf10 expref: 22 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.619678:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96eca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf10 expref: 22 pid: 8460 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265351.619693:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb849cfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876180417514624:192.168.203.49@tcp:104: 00000100:00100000:1.0:1789265351.619809:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc906d4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265351.624938:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265351.625135:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399623168 00000100:00100000:0.0:1789265351.625149:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399623168 00000100:00100000:0.0:1789265351.625228:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 33 00000100:00100000:0.0:1789265351.625239:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+23:6160:x1876180399623168:12345-192.168.203.49@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789265351.625344:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb849cfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876180417514624:192.168.203.49@tcp:104: 00010000:00010000:1.0:1789265351.625386:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96fbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265351.625483:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+24:6160:x1876180399623168:12345-192.168.203.49@tcp:35:ldlm_bl.0 Request processed in 243us (566us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1789265351.625492:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 33 00000100:00100000:3.0:1789265351.628072:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265351.628242:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399623296 00000100:00100000:0.0:1789265351.628251:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399623296 00010000:00010000:0.0:1789265351.628288:0:7926:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96eca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf10 expref: 24 pid: 8460 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265351.628325:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 79 00000100:00100000:0.0:1789265351.628349:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+24:2395:x1876180399623296:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265351.628363:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265351.628370:0:7926:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96eca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf10 expref: 24 pid: 8460 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.628383:0:7926:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96eca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf10 expref: 24 pid: 8460 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.628501:0:7926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a96eca lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf10 expref: 24 pid: 8460 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.628518:0:7926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:0.0:1789265351.628522:0:7926:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96fbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.628531:0:7926:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96fbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.628539:0:7926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96fbf lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265351.628574:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265351.628625:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+23:2395:x1876180399623296:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 277us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265351.628633:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 79 00010000:00010000:1.0:1789265351.630520:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96fbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.630536:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96fbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265351.630600:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789265351.630605:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789265351.630623:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96fbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.630638:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96fbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.630648:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96fb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.630674:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96fb1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.630682:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96fb1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.630687:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fea00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265351.630692:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96fb1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.630699:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96fb1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.630712:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:1.0:1789265351.630715:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265351.630719:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96fb1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.630726:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a96fb1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.630739:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.630744:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96fb8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.630750:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.630755:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ffe00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265351.630762:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.630768:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96fb8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.630775:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fccacd4e500) 00010000:00010000:1.0:1789265351.630777:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265351.630780:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96fb8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.630785:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a96fb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.630824:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a96faa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf4f expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.630836:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96fbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf4f expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265351.630843:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:1.0:1789265351.630845:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265351.630847:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2ffc00, rc 0) 00000100:00100000:1.0:1789265351.630924:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+22:11391:x1876180399622912:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 11666us (12313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265351.630933:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 141 00000100:00100000:0.0:1789265351.682084:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265351.682108:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb849cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417514752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265351.682177:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265351.682290:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417514752 00000100:00100000:1.0:1789265351.682299:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417514752 00000100:00100000:1.0:1789265351.682351:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789265351.682359:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3643:x1876180417514752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265351.682388:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265351.682436:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3643:x1876180417514752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265351.682444:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789265351.682490:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb849cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417514752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265351.683765:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb849cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417515008:0@lo:400:kworker.0 00000100:00100000:1.0:1789265351.683796:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb849cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417515264:0@lo:400:kworker.0 00000100:00100000:3.0:1789265351.683819:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265351.683843:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265351.683849:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb849cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417515520:0@lo:400:kworker.0 00000100:00100000:1.0:1789265351.683884:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb849cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417515776:0@lo:400:kworker.0 00000100:00100000:3.0:1789265351.683898:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265351.683920:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265351.683928:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb849cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417516032:0@lo:400:kworker.0 00000100:00100000:1.0:1789265351.683943:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789265351.683951:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb849cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417515136:0@lo:400:kworker.0 00000100:00100000:3.0:1789265351.683990:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265351.683992:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265351.684016:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789265351.684047:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb849ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417515648:0@lo:400:kworker.0 00000100:00100000:3.0:1789265351.684050:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb849cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417514880:0@lo:400:kworker.0 00000100:00100000:2.0:1789265351.684141:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417515776 00000100:00100000:2.0:1789265351.684148:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417515776 00000100:00100000:2.0:1789265351.684196:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789265351.684204:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb849cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417515776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265351.684265:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417515008 00000100:00100000:0.0:1789265351.684270:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417515008 00000100:00100000:0.0:1789265351.684299:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417515520 00000100:00100000:0.0:1789265351.684303:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417515520 00000100:00100000:0.0:1789265351.684324:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417516032 00000100:00100000:0.0:1789265351.684327:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417516032 00000100:00100000:0.0:1789265351.684343:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789265351.684349:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417515008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265351.684598:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265351.684609:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265351.684642:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb849cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417515392:0@lo:400:kworker.0 00000100:00100000:1.0:1789265351.684655:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417515264 00000100:00100000:1.0:1789265351.684660:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417515264 00000100:00100000:1.0:1789265351.684687:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417515136 00000100:00100000:1.0:1789265351.684690:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417515136 00000100:00100000:1.0:1789265351.684705:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789265351.684713:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb849ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417515264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265351.684756:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb849ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417515264:12345-0@lo:400:kworker.0 Request processed in 43us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265351.684762:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789265351.684778:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789265351.684784:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417515136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265351.684826:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417515136:12345-0@lo:400:kworker.0 Request processed in 42us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265351.684833:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789265351.684875:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265351.684893:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb849cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180417515904:0@lo:400:kworker.0 00000100:00100000:3.0:1789265351.684917:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265351.684939:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417514880 00000100:00100000:3.0:1789265351.684943:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417514880 00000100:00100000:3.0:1789265351.684973:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1789265351.684979:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417514880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265351.685016:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417514880:12345-0@lo:400:kworker.0 Request processed in 37us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265351.685046:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1789265351.685097:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb849cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417514880:0@lo:400:kworker.0 00000100:00080000:3.0:1789265351.685130:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265351.685134:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265351.685137:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265351.685146:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417515648 00000100:00100000:3.0:1789265351.685150:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417515648 00000100:00080000:3.0:1789265351.685165:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265351.685180:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417515392 00000100:00100000:3.0:1789265351.685183:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417515392 00000100:00100000:3.0:1789265351.685342:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417515904 00000100:00100000:3.0:1789265351.685347:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417515904 00000100:00080000:3.0:1789265351.685360:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265351.685376:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789265351.685390:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417515520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265351.685541:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417515520:12345-0@lo:400:kworker.0 Request processed in 151us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265351.685548:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789265351.685578:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb849cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417515520:0@lo:400:kworker.0 00000100:00100000:3.0:1789265351.685598:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789265351.685604:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876180417516032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265351.685637:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876180417516032:12345-0@lo:400:kworker.0 Request processed in 34us (1652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265351.685643:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00010000:00080000:3.0:1789265351.685669:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb849cca80 x1876180417516032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265351.686576:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb849cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417516032:0@lo:400:kworker.0 00000100:00100000:3.0:1789265351.686614:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789265351.686625:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417515648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265351.686672:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417515648:12345-0@lo:400:kworker.0 Request processed in 52us (2065us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265351.687287:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789265351.687311:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789265351.687320:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417515392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265351.687366:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb849cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417515136:0@lo:400:kworker.0 00000100:00100000:3.0:1789265351.687377:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417515392:12345-0@lo:400:kworker.0 Request processed in 58us (2701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265351.687385:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00010000:00080000:1.0:1789265351.687388:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb849ced80 x1876180417515648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265351.687400:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb849ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417515648:0@lo:400:kworker.0 00000100:00100000:1.0:1789265351.687414:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb849cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417515264:0@lo:400:kworker.0 00000100:00100000:1.0:1789265351.687447:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1789265351.687457:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876180417515904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265351.687497:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876180417515904:12345-0@lo:400:kworker.0 Request processed in 42us (2579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265351.687503:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1789265351.687773:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417515008:12345-0@lo:400:kworker.0 Request processed in 3422us (3953us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265351.687782:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789265351.688836:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb849cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417515392:0@lo:400:kworker.0 00000100:00100000:3.0:1789265351.688883:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb849cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180417515904:0@lo:400:kworker.0 00000100:00100000:3.0:1789265351.688894:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb849cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417515008:0@lo:400:kworker.0 00000100:00100000:2.0:1789265351.692150:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb849cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417515776:12345-0@lo:400:kworker.0 Request processed in 7937us (8221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265351.692166:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789265351.692338:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb849cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417515776:0@lo:400:kworker.0 00010000:00010000:3.0:1789265352.003603:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789265352.069612:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1789265352.069629:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000040:00080000:2.0:1789265352.397531:0:14260:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265352.397542:0:14260:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265352.397575:0:14260:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789265352.397582:0:14260:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789265352.581650:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265352.583283:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265352.583330:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789265352.583339:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789265352.583586:0:13799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf608700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1876180417516160:192.168.203.49@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789265352.583747:0:13799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265352.587890:0:13799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf608700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1876180417516160:192.168.203.49@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789265352.591343:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265352.591548:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399623424 00000100:00100000:0.0:1789265352.591559:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399623424 00000100:00100000:0.0:1789265352.591618:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 142 00000100:00100000:0.0:1789265352.591628:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+22:11403:x1876180399623424:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789265352.591755:0:6518:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789265352.591923:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+22:11403:x1876180399623424:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 Request processed in 295us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265352.591930:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 142 00000100:00100000:0.0:1789265352.612623:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265352.614173:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399623680 00000100:00100000:0.0:1789265352.614198:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399623680 00000100:00100000:0.0:1789265352.614265:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 143 00000100:00100000:0.0:1789265352.614275:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+22:11403:x1876180399623680:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265352.614293:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265352.614361:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a96fc6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbf56 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265352.614755:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96fcd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265352.614771:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96fcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265352.614782:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96fcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265352.614794:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789265352.614914:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a96fc6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf56 expref: 25 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265352.614931:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96fcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf56 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265352.614939:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:0.0:1789265352.614942:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265352.614945:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5a00, rc 0) 00000100:00100000:0.0:1789265352.615011:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+24:11403:x1876180399623680:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 737us (2397us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1789265352.615019:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 143 00000100:00100000:3.0:1789265352.622773:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265352.622898:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399623808 00000100:00100000:0.0:1789265352.622921:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399623808 00000100:00100000:0.0:1789265352.622997:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 10 00000100:00100000:0.0:1789265352.623007:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83e39050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+24:2395:x1876180399623808:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265352.623042:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265352.623069:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a96fcd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf56 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265352.623084:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:0.0:1789265352.623088:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265352.623141:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83e39050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+23:2395:x1876180399623808:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 135us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265352.623148:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 10 00000100:00100000:0.0:1789265352.624777:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265352.624884:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399624064 00000100:00100000:3.0:1789265352.624892:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399624064 00000100:00100000:3.0:1789265352.625771:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 144 00000100:00100000:3.0:1789265352.625785:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+23:11403:x1876180399624064:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789265352.625874:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96fdb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265352.625891:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96fdb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265352.625903:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96fdb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265352.626073:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96fdb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265352.626082:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96fdb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265352.626089:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96fdb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265352.626095:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265352.626114:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96fdb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265352.626122:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96fdb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265352.626135:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:3.0:1789265352.626138:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789265352.626143:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96fdb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265352.626149:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a96fdb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265352.626289:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+24:11403:x1876180399624064:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 Request processed in 506us (1518us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789265352.626298:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 144 00000040:00080000:2.0:1789265352.626508:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265352.626518:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265352.629249:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789265352.629270:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789265352.635867:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265352.636298:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399624320 00000100:00100000:1.0:1789265352.636308:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399624320 00000100:00100000:1.0:1789265352.636367:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 34 00000100:00100000:1.0:1789265352.636378:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+24:11403:x1876180399624320:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789265352.636614:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+25:11403:x1876180399624320:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 Request processed in 237us (767us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1789265352.636622:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 34 00010000:00010000:1.0:1789265353.025318:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265354.050642:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265354.242940:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265354.242976:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417516288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265354.243080:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265354.243131:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417516288 00000100:00100000:2.0:1789265354.243138:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417516288 00000100:00100000:2.0:1789265354.243191:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789265354.243200:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417516288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789265354.243232:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1789265354.243297:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417516288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265354.243304:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789265354.243352:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417516288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265354.244063:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265354.244075:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417516416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265354.244115:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265354.244198:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417516416 00000100:00100000:0.0:1789265354.244204:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417516416 00000100:00100000:0.0:1789265354.244245:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789265354.244254:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417516416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789265354.244275:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789265354.244322:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417516416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265354.244329:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789265354.244400:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417516416:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1789265354.437916:0:14311:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265354.437926:0:14311:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265354.437960:0:14311:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789265354.437967:0:14311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789265354.703141:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265354.703192:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399624576 00000100:00100000:1.0:1789265354.703202:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399624576 00000100:00100000:1.0:1789265354.703344:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 145 00000100:00100000:1.0:1789265354.703366:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+25:11424:x1876180399624576:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1789265354.703508:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265354.703532:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a96fe2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbf5d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265354.703640:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96fe9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265354.703656:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96fe9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265354.703669:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96fe9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265354.703682:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789265354.703784:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a96fe2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf5d expref: 28 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265354.703803:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96fe9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf5d expref: 27 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265354.703812:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:1.0:1789265354.703815:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789265354.703819:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fe400, rc 0) 00000100:00100000:1.0:1789265354.705531:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+27:11424:x1876180399624576:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 2158us (2389us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1789265354.705562:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 145 00000100:00080000:1.0:1789265354.705607:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265354.714746:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265354.714787:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399624704 00000100:00100000:2.0:1789265354.714797:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399624704 00000100:00100000:2.0:1789265354.716390:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 146 00000100:00100000:2.0:1789265354.716515:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+27:11424:x1876180399624704:12345-192.168.203.49@tcp:54:lfs.0 00010000:00010000:2.0:1789265354.716585:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96ff7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265354.716605:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265354.716625:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265354.716663:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265354.716670:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96ff7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265354.716677:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265354.716682:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520aa00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265354.716686:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265354.716692:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96ff7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265354.716703:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:2.0:1789265354.716705:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265354.716710:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96ff7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265354.716715:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a96ff7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265354.716787:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+27:11424:x1876180399624704:12345-192.168.203.49@tcp:54:lfs.0 Request processed in 384us (2049us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265354.716795:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 146 00000100:00100000:3.0:1789265354.753311:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265354.753333:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417516544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265354.753413:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265354.753481:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417516544 00000100:00100000:3.0:1789265354.753488:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417516544 00000100:00100000:3.0:1789265354.753539:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789265354.753548:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb849cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1876180417516544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265354.753585:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789265354.753630:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb849cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1876180417516544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265354.753637:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1789265354.753660:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265354.753696:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417516544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265354.759170:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265354.766923:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417516672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265354.766997:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265354.767504:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417516672 00000100:00100000:1.0:1789265354.767514:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417516672 00000100:00100000:1.0:1789265354.767577:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789265354.767586:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417516672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789265354.767610:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789265354.767672:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417516672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265354.767680:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789265354.767929:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417516672:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789265354.769855:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265354.829847:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265354.829955:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399624832 00000100:00100000:0.0:1789265354.829966:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399624832 00000100:00100000:0.0:1789265354.830100:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 54 00000100:00100000:0.0:1789265354.830111:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+6:2394:x1876180399624832:12345-192.168.203.49@tcp:101:cat.0 00010000:00010000:0.0:1789265354.830129:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265354.830149:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096eac9fc/0x9272d942b4a96ffe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbf64 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789265354.830173:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa605c7, atime: 0x6aa605c7, ctime: 0x6aa605c7, blocks: 0x8 00010000:00010000:0.0:1789265354.830192:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=406s v=(0 0) 00010000:00010000:0.0:1789265354.830197:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265354.830206:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096eac9fc/0x9272d942b4a96ffe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf64 expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265354.830226:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000096eac9fc/0x9272d942b4a96ffe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf64 expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265354.830239:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da4000, rc 0) 00000100:00100000:0.0:1789265354.830291:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+7:2394:x1876180399624832:12345-192.168.203.49@tcp:101:cat.0 Request processed in 182us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265354.830298:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 54 00000100:00080000:3.0:1789265354.832994:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265354.835774:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265354.835867:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399624960 00000100:00100000:3.0:1789265354.835877:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399624960 00002000:00100000:3.0:1789265354.835928:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9fcc8376ea00 x1876180399624960/t0(0) o3->5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp:680/0 lens 488/0 e 0 to 0 dl 1789265365 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265354.835940:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fcc8376ea00 with x1876180399624960 ext(0->4095) 00002000:00010000:3.0:1789265354.835946:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fcc8376ea00 00000100:00100000:3.0:1789265354.835979:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 3 00000100:00100000:3.0:1789265354.835989:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5b43750b-84cf-4d62-9028-e016267b6509+7:2396:x1876180399624960:12345-192.168.203.49@tcp:3:cat.0 00000100:00100000:3.0:1789265354.837637:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5b43750b-84cf-4d62-9028-e016267b6509+7:2396:x1876180399624960:12345-192.168.203.49@tcp:3:cat.0 Request processed in 1641us (1865us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789265354.837650:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 3 00002000:00100000:3.0:1789265354.837659:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9fcc8376ea00 x1876180399624960/t0(0) o3->5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp:680/0 lens 488/4536 e 0 to 0 dl 1789265365 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265354.837669:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fcc8376ea00 with x1876180399624960 ext(0->4095) 00002000:00010000:3.0:1789265354.837674:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fcc8376ea00 00010000:00010000:3.0:1789265355.079398:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265356.104243:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265356.110207:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265356.110260:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265356.110285:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265356.110306:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265356.110336:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265356.110358:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265356.110382:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265356.110424:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399625600 00000100:00100000:0.0:1789265356.110434:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399625600 00000100:00100000:0.0:1789265356.110486:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399625472 00000100:00100000:0.0:1789265356.110489:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399625472 00000100:00100000:0.0:1789265356.110511:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 107 00000100:00100000:0.0:1789265356.110521:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2393:x1876180399625600:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265356.110584:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2393:x1876180399625600:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 66us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265356.110592:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 107 00000100:00100000:0.0:1789265356.110607:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 108 00000100:00100000:0.0:1789265356.110613:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+7:2393:x1876180399625472:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265356.110635:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+7:2393:x1876180399625472:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 23us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265356.110641:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 108 00000100:00100000:0.0:1789265356.110661:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399625344 00000100:00100000:0.0:1789265356.110664:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399625344 00000100:00100000:0.0:1789265356.110690:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399625856 00000100:00100000:0.0:1789265356.110693:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399625856 00000100:00100000:0.0:1789265356.110704:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399625216 00000100:00100000:0.0:1789265356.110707:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399625216 00000100:00100000:0.0:1789265356.110719:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399625728 00000100:00100000:0.0:1789265356.110722:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399625728 00000100:00100000:0.0:1789265356.110736:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 293 00000100:00100000:0.0:1789265356.110742:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2393:x1876180399625344:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265356.110770:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2393:x1876180399625344:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 28us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265356.110776:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 293 00000100:00100000:0.0:1789265356.110797:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 294 00000100:00100000:0.0:1789265356.110804:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399625856:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265356.110840:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399625856:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 37us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265356.110847:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 294 00000100:00100000:0.0:1789265356.110859:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 295 00000100:00100000:0.0:1789265356.110864:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+27:2393:x1876180399625216:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265356.110888:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+27:2393:x1876180399625216:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 24us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265356.110894:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 295 00000100:00100000:0.0:1789265356.110906:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 296 00000100:00100000:0.0:1789265356.110911:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399625728:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265356.110933:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2393:x1876180399625728:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 22us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265356.110938:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 296 00000100:00100000:3.0:1789265356.111348:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399625088 00000100:00100000:3.0:1789265356.111353:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399625088 00000100:00100000:3.0:1789265356.111402:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 383 00000100:00100000:3.0:1789265356.111409:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2393:x1876180399625088:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265356.111447:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2393:x1876180399625088:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 38us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265356.111453:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 383 00000100:00080000:3.0:1789265356.111482:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265356.111486:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265356.111489:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789265356.111491:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265356.299235:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb849cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417516800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265356.299317:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265356.299798:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417516800 00000100:00100000:3.0:1789265356.299808:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417516800 00000100:00100000:3.0:1789265356.299892:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789265356.299902:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84847480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417516800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789265356.299938:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265356.299991:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84847480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417516800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265356.299998:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789265356.300072:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb849cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417516800:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789265356.301505:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265356.802019:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265356.802062:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb849cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417516928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265356.802172:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265356.802228:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417517312:0@lo:400:kworker.0 00000100:00100000:2.0:1789265356.802236:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417517056:0@lo:400:kworker.0 00000100:00100000:1.0:1789265356.802261:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265356.802281:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265356.802306:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417517568:0@lo:400:kworker.0 00000100:00100000:2.0:1789265356.802327:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265356.802341:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417518080:0@lo:400:kworker.0 00000100:00100000:3.0:1789265356.802623:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417517056 00000100:00100000:3.0:1789265356.802631:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417517056 00000100:00100000:3.0:1789265356.802679:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1789265356.802679:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417517824:0@lo:400:kworker.0 00000100:00100000:3.0:1789265356.802692:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3641:x1876180417517056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265356.802730:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265356.802756:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417518336:0@lo:400:kworker.0 00000100:00100000:3.0:1789265356.802761:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3641:x1876180417517056:12345-0@lo:400:kworker.0 Request processed in 70us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265356.802770:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1789265356.802792:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265356.802812:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417517184:0@lo:400:kworker.0 00000100:00100000:1.0:1789265356.802829:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789265356.802838:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417517440:0@lo:400:kworker.0 00000100:00100000:3.0:1789265356.802855:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265356.802875:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265356.802877:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417517696:0@lo:400:kworker.0 00000100:00100000:1.0:1789265356.802908:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417517952:0@lo:400:kworker.0 00000100:00100000:3.0:1789265356.802909:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265356.802933:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180417518208:0@lo:400:kworker.0 00000100:00100000:3.0:1789265356.802955:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265356.802990:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417517568 00000100:00100000:3.0:1789265356.802994:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417517568 00000100:00100000:3.0:1789265356.803014:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417517824 00000100:00100000:3.0:1789265356.803017:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417517824 00000100:00100000:3.0:1789265356.803061:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417518336 00000100:00100000:3.0:1789265356.803064:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417518336 00000100:00100000:3.0:1789265356.803089:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417517184 00000100:00100000:3.0:1789265356.803092:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417517184 00000100:00100000:3.0:1789265356.803103:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417517696 00000100:00100000:3.0:1789265356.803105:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417517696 00000100:00100000:3.0:1789265356.803116:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417518208 00000100:00100000:3.0:1789265356.803118:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417518208 00000100:00100000:3.0:1789265356.803131:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1789265356.803137:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417517568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265356.803172:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417517568:12345-0@lo:400:kworker.0 Request processed in 35us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265356.803178:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1789265356.803192:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789265356.803198:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417517824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265356.803223:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417517824:12345-0@lo:400:kworker.0 Request processed in 26us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265356.803228:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789265356.803247:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1789265356.803253:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417518336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265356.803281:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417518336:12345-0@lo:400:kworker.0 Request processed in 28us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265356.803287:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1789265356.803297:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1789265356.803302:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb849cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417517184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265356.803330:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb849cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417517184:12345-0@lo:400:kworker.0 Request processed in 27us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265356.803336:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1789265356.803348:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1789265356.803354:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb849cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417517696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265356.803385:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb849cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417517696:12345-0@lo:400:kworker.0 Request processed in 32us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265356.803390:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1789265356.803400:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1789265356.803406:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb849cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876180417518208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265356.803429:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb849cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876180417518208:12345-0@lo:400:kworker.0 Request processed in 23us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265356.803434:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1789265356.803469:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417517184:0@lo:400:kworker.0 00000100:00100000:3.0:1789265356.803480:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417517696:0@lo:400:kworker.0 00000100:00100000:3.0:1789265356.803487:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180417518208:0@lo:400:kworker.0 00000100:00100000:3.0:1789265356.803532:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417517312 00000100:00100000:3.0:1789265356.803541:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417517312 00000100:00100000:3.0:1789265356.803562:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417517440 00000100:00100000:3.0:1789265356.803565:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417517440 00000100:00100000:3.0:1789265356.803575:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789265356.803580:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417517312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265356.803615:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417517312:12345-0@lo:400:kworker.0 Request processed in 34us (1354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265356.803621:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789265356.803633:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789265356.803640:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417517440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265356.803674:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417517440:12345-0@lo:400:kworker.0 Request processed in 35us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265356.803681:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:1.0:1789265356.803702:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265356.803703:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417516928 00000100:00100000:3.0:1789265356.803709:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417516928 00000100:00080000:1.0:1789265356.803709:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265356.803753:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789265356.803760:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417516928:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789265356.803761:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1789265356.803776:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265356.803830:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417516928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (1659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265356.803837:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789265356.803978:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265356.804046:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417517056:0@lo:400:kworker.0 00000100:00100000:1.0:1789265356.804051:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417518080 00000100:00100000:1.0:1789265356.804057:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417518080 00000100:00100000:2.0:1789265356.804062:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417517568:0@lo:400:kworker.0 00000100:00100000:1.0:1789265356.804227:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789265356.804236:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3641:x1876180417518080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265356.804460:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3641:x1876180417518080:12345-0@lo:400:kworker.0 Request processed in 224us (2097us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265356.804498:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265356.804525:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc913f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417518464:0@lo:400:kworker.0 00000100:00100000:3.0:1789265356.804559:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265356.804640:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417517312:0@lo:400:kworker.0 00010000:00080000:3.0:1789265356.804657:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc91421c00 x1876180417517824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265356.804680:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417517824:0@lo:400:kworker.0 00010000:00080000:3.0:1789265356.804695:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccb0a65c00 x1876180417518336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265356.804703:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417518336:0@lo:400:kworker.0 00000100:00100000:3.0:1789265356.804712:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1789265356.804716:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:3.0:1789265356.804732:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fcb838f5c00, transno 4294967302 00000004:00080000:3.0:1789265356.804747:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:3.0:1789265356.804758:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fccbf60a680, transno 4294967305 00000100:00100000:3.0:1789265356.804770:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb849cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417516928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265356.804795:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417517440:0@lo:400:kworker.0 00000100:00100000:2.0:1789265356.805397:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417518080:0@lo:400:kworker.0 00000100:00100000:2.0:1789265356.805699:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417517952 00000100:00100000:2.0:1789265356.805705:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417517952 00000001:00080000:3.0:1789265356.807608:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:3.0:1789265356.807644:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fcc913b7cc0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1789265356.807649:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fcb8218e500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fcc913b7540 00000020:00080000:3.0:1789265356.807653:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fcb8218ed00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fcb83de8000 00000020:00080000:3.0:1789265356.807667:0:6495:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000100:00100000:0.0:1789265356.809039:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417518464 00000100:00100000:0.0:1789265356.809054:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417518464 00000100:00100000:0.0:1789265356.809102:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789265356.809112:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb849ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417518464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265356.809207:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb849ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417518464:12345-0@lo:400:kworker.0 Request processed in 97us (4647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265356.809215:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789265356.809466:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc913f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417518464:0@lo:400:kworker.0 00000100:00100000:1.0:1789265356.809553:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00010000:3.0:1789265356.809654:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96f79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265356.809665:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96f79 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265356.809673:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96f79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265356.809693:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265356.809698:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96f79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265356.809705:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96f79 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265356.809721:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fcca9673c00) 00010000:00010000:3.0:1789265356.809724:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265356.809728:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96f79 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265356.809733:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a96f79 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789265356.810463:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:0.0:1789265356.810488:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1789265356.810544:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:2.0:1789265356.812977:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789265356.813001:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb849cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417517952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265356.813118:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb849cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417517952:12345-0@lo:400:kworker.0 Request processed in 130us (8621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265356.813127:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789265356.813352:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417517952:0@lo:400:kworker.0 00000001:00080000:0.0:1789265356.820651:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:0.0:1789265356.820668:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:0.0:1789265357.121275:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789265358.086916:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789265358.147319:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789265358.785336:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265358.785346:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265358.785366:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789265358.785376:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789265359.170739:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265359.362274:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417518592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265359.362352:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265359.362488:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417518592 00000100:00100000:1.0:1789265359.362496:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417518592 00000100:00100000:1.0:1789265359.362557:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789265359.362566:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417518592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265359.362599:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1789265359.362649:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417518592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265359.362657:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789265359.363056:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417518592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265359.369310:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265359.369333:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417518720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265359.369394:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265359.369500:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417518720 00000100:00100000:0.0:1789265359.369507:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417518720 00000100:00100000:0.0:1789265359.369553:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789265359.369562:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417518720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789265359.369599:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789265359.369639:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417518720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265359.369825:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789265359.371372:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417518720:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265359.876576:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265359.876599:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417518848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265359.876678:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265359.876742:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417518848 00000100:00100000:0.0:1789265359.876748:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417518848 00000100:00100000:0.0:1789265359.876822:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789265359.876833:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417518848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265359.876861:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789265359.876908:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417518848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265359.876916:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1789265359.876936:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265359.876965:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1789265359.876984:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fccbf60aa00, transno 4294967311 00000004:00080000:0.0:1789265359.877001:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1789265359.877061:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417518848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265359.878945:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417518976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265359.879004:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265359.881125:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417518976 00000100:00100000:3.0:1789265359.881139:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417518976 00000100:00100000:3.0:1789265359.881201:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789265359.881211:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417518976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789265359.881237:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789265359.881559:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417518976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 348us (2553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265359.881567:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:3.0:1789265359.881626:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265359.882314:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417518976:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789265360.197736:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265360.510655:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265360.510761:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399625984 00000100:00100000:3.0:1789265360.510776:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399625984 00000100:00100000:3.0:1789265360.510906:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 147 00000100:00100000:3.0:1789265360.510919:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+13:11077:x1876180399625984:12345-192.168.203.49@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789265360.511123:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+13:11077:x1876180399625984:12345-192.168.203.49@tcp:60:lhsmtool_posix.0 Request processed in 206us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265360.511132:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 147 00000100:00080000:0.0:1789265360.511607:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265360.525193:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265360.525308:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399626112 00000100:00100000:1.0:1789265360.525324:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399626112 00000100:00080000:0.0:1789265360.529000:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265360.529225:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 148 00000100:00100000:0.0:1789265360.529250:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb849cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:11077:x1876180399626112:12345-192.168.203.49@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789265360.529417:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb849cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:11077:x1876180399626112:12345-192.168.203.49@tcp:60:lhsmtool_posix.0 Request processed in 179us (4238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265360.529426:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 148 00000100:00100000:2.0:1789265360.544647:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265360.544754:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399626368 00000100:00100000:3.0:1789265360.544764:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399626368 00000100:00100000:3.0:1789265360.544886:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 35 00000100:00100000:3.0:1789265360.544898:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+13:11077:x1876180399626368:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789265360.545173:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+14:11077:x1876180399626368:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 Request processed in 276us (534us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1789265360.545183:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 35 00000100:00100000:2.0:1789265360.871809:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265360.871903:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399626496 00000100:00100000:0.0:1789265360.871917:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399626496 00000100:00100000:0.0:1789265360.872017:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 149 00000100:00100000:0.0:1789265360.872058:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:11883:x1876180399626496:12345-192.168.203.49@tcp:101:lsof.0 00010000:00010000:0.0:1789265360.872087:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265360.872113:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97005 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbf6b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265360.872197:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a9700c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265360.872214:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a9700c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265360.872255:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a9700c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265360.872540:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789265360.872543:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265360.872656:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a9700c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265360.872688:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97005 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf6b expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265360.872711:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a9700c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf6b expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265360.872721:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcca967b300) 00010000:00010000:0.0:1789265360.872725:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265360.872729:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da4c00, rc 0) 00000100:00080000:3.0:1789265360.872886:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265360.872931:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:11883:x1876180399626496:12345-192.168.203.49@tcp:101:lsof.0 Request processed in 875us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265360.872940:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 149 00010000:00010000:3.0:1789265361.217880:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265361.230088:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265361.230139:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265361.230179:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265361.230218:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265361.230238:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265361.230254:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265361.230282:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265361.230313:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399626752 00000100:00100000:0.0:1789265361.230354:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399626752 00000100:00100000:0.0:1789265361.230419:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399626880 00000100:00100000:0.0:1789265361.230423:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399626880 00000100:00100000:0.0:1789265361.230437:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399627392 00000100:00100000:0.0:1789265361.230439:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399627392 00000100:00100000:0.0:1789265361.230465:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 303 00000100:00100000:0.0:1789265361.230476:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+14:2396:x1876180399626752:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265361.230572:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+14:2396:x1876180399626752:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 98us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265361.230581:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 303 00000100:00100000:0.0:1789265361.230598:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399627264 00000100:00100000:0.0:1789265361.230601:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399627264 00000100:00100000:0.0:1789265361.230615:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 304 00000100:00100000:0.0:1789265361.230621:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399626880:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265361.230647:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399626880:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 26us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265361.230653:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 304 00000100:00100000:0.0:1789265361.230665:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 305 00000100:00100000:0.0:1789265361.230670:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2395:x1876180399627392:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265361.230694:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2395:x1876180399627392:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 24us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265361.230699:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 305 00000100:00100000:0.0:1789265361.230710:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 306 00000100:00100000:0.0:1789265361.230715:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:2396:x1876180399627264:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265361.230739:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:2396:x1876180399627264:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 24us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265361.230753:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 306 00000100:00100000:3.0:1789265361.230977:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399627008 00000100:00100000:3.0:1789265361.230982:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399627008 00000100:00100000:3.0:1789265361.231061:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399627136 00000100:00100000:3.0:1789265361.231065:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399627136 00000100:00100000:3.0:1789265361.231089:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 112 00000100:00100000:3.0:1789265361.231095:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+6:2396:x1876180399627008:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265361.231129:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+6:2396:x1876180399627008:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 34us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265361.231135:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 112 00000100:00100000:3.0:1789265361.231148:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 113 00000100:00100000:3.0:1789265361.231153:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399627136:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265361.231187:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399627136:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 34us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265361.231193:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 113 00000100:00080000:3.0:1789265361.231211:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265361.231216:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789265361.231218:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789265361.231629:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399626624 00000100:00100000:2.0:1789265361.231643:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399626624 00000100:00100000:2.0:1789265361.231686:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 385 00000100:00100000:2.0:1789265361.231694:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2395:x1876180399626624:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265361.231725:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2395:x1876180399626624:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 32us (1545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265361.231731:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 385 00000100:00100000:1.0:1789265361.411954:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb849cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417519104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265361.412090:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265361.412360:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417519104 00000100:00100000:3.0:1789265361.412370:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417519104 00000100:00100000:3.0:1789265361.412450:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789265361.412462:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84845500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417519104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789265361.412497:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265361.412559:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84845500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417519104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265361.412568:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789265361.412633:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb849cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417519104:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789265361.412883:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265361.926958:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf54b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417519360:0@lo:400:kworker.0 00000100:00100000:3.0:1789265361.927055:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417519616:0@lo:400:kworker.0 00000100:00100000:1.0:1789265361.927099:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265361.927109:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265361.927167:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417519616 00000100:00100000:1.0:1789265361.927172:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417519872:0@lo:400:kworker.0 00000100:00100000:2.0:1789265361.927178:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417519616 00000100:00100000:2.0:1789265361.927241:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789265361.927252:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb849cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417519616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265361.927322:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb849cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417519616:12345-0@lo:400:kworker.0 Request processed in 71us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265361.927334:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265361.927357:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb838f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417520384:0@lo:400:kworker.0 00000100:00100000:1.0:1789265361.927383:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265361.927400:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789265361.927419:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb838f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417520896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265361.927447:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417519360 00000100:00100000:2.0:1789265361.927454:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417519360 00000100:00100000:1.0:1789265361.927454:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265361.927480:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789265361.927489:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417519488:0@lo:400:kworker.0 00000100:00100000:2.0:1789265361.927492:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417519872 00000100:00100000:2.0:1789265361.927497:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417519872 00000100:00100000:1.0:1789265361.927518:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265361.927537:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417520384 00000100:00100000:2.0:1789265361.927541:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417520384 00000100:00100000:1.0:1789265361.927549:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417520000:0@lo:400:kworker.0 00000100:00100000:2.0:1789265361.927561:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789265361.927570:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417519360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265361.927579:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265361.927594:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb838f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417520512:0@lo:400:kworker.0 00000100:00100000:2.0:1789265361.927613:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417519360:12345-0@lo:400:kworker.0 Request processed in 42us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265361.927621:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789265361.927634:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417520000 00000100:00100000:2.0:1789265361.927638:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417520000 00000100:00100000:1.0:1789265361.927641:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265361.927661:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417520512 00000100:00100000:2.0:1789265361.927665:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417520512 00000100:00100000:2.0:1789265361.927703:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1789265361.927708:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417519872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265361.927741:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417519872:12345-0@lo:400:kworker.0 Request processed in 33us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265361.927747:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1789265361.927758:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789265361.927764:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417520384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265361.927802:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417520384:12345-0@lo:400:kworker.0 Request processed in 38us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265361.927808:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789265361.927820:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1789265361.927826:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417520000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265361.927857:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417520000:12345-0@lo:400:kworker.0 Request processed in 32us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265361.927864:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1789265361.927874:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1789265361.927880:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417520512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265361.927903:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417520512:12345-0@lo:400:kworker.0 Request processed in 24us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265361.927909:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1789265361.927945:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417520896 00000100:00100000:2.0:1789265361.927950:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417520896 00000100:00100000:1.0:1789265361.927976:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf54b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417519360:0@lo:400:kworker.0 00000100:00100000:2.0:1789265361.927983:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789265361.927992:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417520896:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265361.927997:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417519872:0@lo:400:kworker.0 00000100:00100000:1.0:1789265361.928010:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb838f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417520384:0@lo:400:kworker.0 00002000:00000024:2.0:1789265361.928013:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265361.928076:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417520896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265361.928089:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789265361.928115:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc812aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417519232:0@lo:400:kworker.0 00000100:00100000:2.0:1789265361.928151:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265361.928177:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417519744:0@lo:400:kworker.0 00000100:00100000:2.0:1789265361.928200:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265361.928219:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb838f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417520256:0@lo:400:kworker.0 00000100:00100000:2.0:1789265361.928247:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265361.928265:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb838f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417520768:0@lo:400:kworker.0 00000100:00100000:2.0:1789265361.928289:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789265361.928310:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83dd8380 x1876180417520000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265361.928324:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417520000:0@lo:400:kworker.0 00010000:00080000:1.0:1789265361.928337:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb838f6680 x1876180417520512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265361.928345:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb838f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417520512:0@lo:400:kworker.0 00000100:00100000:1.0:1789265361.928361:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb838f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417520896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265361.928388:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417519488 00000100:00100000:1.0:1789265361.928393:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417519488 00000100:00100000:1.0:1789265361.928424:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789265361.928432:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417519488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265361.928476:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417519488:12345-0@lo:400:kworker.0 Request processed in 46us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265361.928484:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789265361.928504:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417520256 00000100:00100000:1.0:1789265361.928507:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417520256 00000100:00100000:1.0:1789265361.928536:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417520768 00000100:00100000:1.0:1789265361.928539:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417520768 00000100:00100000:1.0:1789265361.928558:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789265361.928564:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417520256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265361.928804:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417520256:12345-0@lo:400:kworker.0 Request processed in 238us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265361.928812:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789265361.928826:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789265361.928833:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417520768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265361.928873:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417519744 00000100:00100000:1.0:1789265361.928876:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417520768:12345-0@lo:400:kworker.0 Request processed in 43us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265361.928879:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417519744 00000100:00100000:1.0:1789265361.928887:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789265361.928912:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1789265361.928920:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417519744:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789265361.928931:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265361.928937:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265361.928941:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265361.928945:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265361.928961:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417519744:12345-0@lo:400:kworker.0 Request processed in 41us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265361.928969:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1789265361.928976:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417519744:0@lo:400:kworker.0 00000100:00100000:1.0:1789265361.928991:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb838f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417520256:0@lo:400:kworker.0 00000100:00100000:2.0:1789265361.929016:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417519232 00000100:00100000:2.0:1789265361.929099:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417519232 00000100:00100000:2.0:1789265361.929131:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1789265361.929138:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417519232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265361.929172:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417519232:12345-0@lo:400:kworker.0 Request processed in 34us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265361.929180:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1789265361.929257:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb838f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417520768:0@lo:400:kworker.0 00000100:00100000:1.0:1789265361.929285:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc812aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417519232:0@lo:400:kworker.0 00000100:00100000:1.0:1789265361.929313:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417519488:0@lo:400:kworker.0 00000100:00100000:3.0:1789265361.933247:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417519616:0@lo:400:kworker.0 00000100:00100000:3.0:1789265361.933270:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417520128:0@lo:400:kworker.0 00000100:00100000:3.0:1789265361.934297:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265361.935711:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb838f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417520640:0@lo:400:kworker.0 00000100:00100000:3.0:1789265361.935809:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265361.941970:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417520128 00000100:00100000:0.0:1789265361.942291:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417520640 00000100:00100000:0.0:1789265361.942298:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417520640 00000100:00100000:0.0:1789265361.942408:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789265361.942422:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb849cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417520640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265361.942551:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb849cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417520640:12345-0@lo:400:kworker.0 Request processed in 132us (6742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265361.942559:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789265361.943086:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417520128 00000100:00100000:1.0:1789265361.943149:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789265361.943156:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb849cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417520128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265361.943205:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb849cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417520128:12345-0@lo:400:kworker.0 Request processed in 50us (9848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265361.943212:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:1.0:1789265361.943233:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265361.944627:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb838f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417520640:0@lo:400:kworker.0 00000100:00100000:3.0:1789265361.944682:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417520128:0@lo:400:kworker.0 00010000:00010000:2.0:1789265362.243121:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789265362.948676:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1789265362.948714:0:6495:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1789265362.948804:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1789265362.948818:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1789265363.265259:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265364.291309:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265364.482802:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265364.482824:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417521024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265364.482891:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265364.483069:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417521024 00000100:00100000:2.0:1789265364.483077:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417521024 00000100:00100000:2.0:1789265364.483120:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789265364.483130:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417521024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789265364.483158:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789265364.483203:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417521024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265364.483211:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789265364.483707:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265364.483720:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417521152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265364.483761:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265364.483815:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417521152 00000100:00100000:1.0:1789265364.483819:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417521152 00000100:00100000:1.0:1789265364.483852:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789265364.483860:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417521152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265364.483880:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1789265364.483915:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417521152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265364.483922:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789265364.483965:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417521152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265364.483999:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417521024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265364.993447:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417521280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265364.993526:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265364.993628:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417521280 00000100:00100000:2.0:1789265364.993637:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417521280 00000100:00100000:2.0:1789265364.993719:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789265364.993730:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417521280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265364.993777:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789265364.993832:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417521280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265364.993839:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789265364.993902:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417521280:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789265364.994448:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265364.995531:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265364.995554:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb849cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417521408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265364.995637:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265364.995712:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417521408 00000100:00100000:2.0:1789265364.995722:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417521408 00000100:00100000:2.0:1789265364.995794:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789265364.995803:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb849cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417521408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789265364.995824:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789265364.996016:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb849cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417521408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 213us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265364.996061:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1789265364.996743:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265364.999737:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb849cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417521408:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789265365.315045:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789265365.424556:0:14509:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 22:09:24 (1789265364) 00010000:00010000:0.0:1789265366.339229:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265366.342717:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265366.342784:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265366.342827:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265366.342857:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265366.342877:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265366.342901:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265366.343067:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399628032 00000100:00100000:0.0:1789265366.343081:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399628032 00000100:00100000:0.0:1789265366.343148:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399627904 00000100:00100000:0.0:1789265366.343152:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399627904 00000100:00100000:0.0:1789265366.343182:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 118 00000100:00100000:0.0:1789265366.343196:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399628032:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265366.343293:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399628032:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 99us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265366.343302:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 118 00000100:00100000:0.0:1789265366.343319:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 119 00000100:00100000:0.0:1789265366.343325:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+6:2396:x1876180399627904:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265366.343352:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+6:2396:x1876180399627904:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 27us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265366.343359:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 119 00000100:00100000:0.0:1789265366.343435:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399627776 00000100:00100000:0.0:1789265366.343440:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399627776 00000100:00100000:0.0:1789265366.343472:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399628288 00000100:00100000:0.0:1789265366.343476:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399628288 00000100:00100000:0.0:1789265366.343493:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399627648 00000100:00100000:0.0:1789265366.343496:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399627648 00000100:00100000:0.0:1789265366.343514:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 313 00000100:00100000:0.0:1789265366.343521:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399627776:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265366.343552:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399627776:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 33us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265366.343559:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 313 00000100:00100000:0.0:1789265366.343571:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 314 00000100:00100000:0.0:1789265366.343577:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2396:x1876180399628288:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265366.343600:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2396:x1876180399628288:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 23us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265366.343606:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 314 00000100:00100000:0.0:1789265366.343617:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 315 00000100:00100000:0.0:1789265366.343623:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+13:2396:x1876180399627648:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265366.343646:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+13:2396:x1876180399627648:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 24us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265366.343652:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 315 00000100:00080000:0.0:1789265366.343684:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265366.343689:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789265366.343691:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265366.343694:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265366.343802:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399627520 00000100:00100000:3.0:1789265366.343807:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399627520 00000100:00100000:3.0:1789265366.343852:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 387 00000100:00100000:3.0:1789265366.343860:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2396:x1876180399627520:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265366.343889:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2396:x1876180399627520:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 31us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265366.343896:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 387 00000100:00100000:2.0:1789265366.344219:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265366.344499:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399628160 00000100:00100000:3.0:1789265366.344506:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399628160 00000100:00100000:3.0:1789265366.344570:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 316 00000100:00100000:3.0:1789265366.344578:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:2396:x1876180399628160:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265366.344624:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:2396:x1876180399628160:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 47us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265366.344631:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 316 00000100:00080000:2.0:1789265366.346205:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265366.529529:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265366.529573:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb849cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417521536:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265366.529694:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265366.529882:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417521536 00000100:00100000:1.0:1789265366.529892:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417521536 00000100:00100000:1.0:1789265366.529968:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789265366.529979:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417521536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789265366.530065:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265366.530121:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417521536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 143us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265366.530128:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:0.0:1789265366.530401:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265366.530453:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb849cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417521536:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265366.994921:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265366.999504:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399628544 00000100:00100000:0.0:1789265366.999532:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399628544 00000100:00100000:0.0:1789265366.999659:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 150 00000100:00100000:0.0:1789265366.999673:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+13:12150:x1876180399628544:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265366.999705:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265366.999745:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97013 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbf72 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265366.999997:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a9701a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265367.000015:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a9701a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265367.000074:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a9701a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265367.000446:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a97021 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265367.000473:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a97021 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265367.000487:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a97021 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265367.000665:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a97028 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265367.000688:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a97028 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265367.000697:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a97028 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265367.000709:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789265367.000811:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a9701a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265367.000820:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a9701a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265367.000827:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a9701a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265367.000834:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265367.000838:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a9701a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265367.000845:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a9701a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265367.000858:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fcc9b3f5000) 00010000:00010000:0.0:1789265367.000861:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265367.000866:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a9701a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265367.000873:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a9701a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265367.000887:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a97021 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265367.000900:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a97021 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265367.000906:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a97021 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265367.000911:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265367.000914:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a97021 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265367.000921:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a97021 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265367.000929:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fcca9673300) 00010000:00010000:0.0:1789265367.000931:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265367.000934:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a97021 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265367.000939:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a97021 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265367.001405:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97013 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf72 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265367.001421:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a97028 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf72 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265367.001429:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fccbd2b4c00) 00010000:00010000:0.0:1789265367.001431:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265367.001440:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5200, rc 0) 00000100:00100000:0.0:1789265367.001758:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+15:12150:x1876180399628544:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 2078us (6842us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789265367.001767:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 150 00000100:00100000:2.0:1789265367.007963:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265367.008406:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399628672 00000100:00100000:1.0:1789265367.008417:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399628672 00000100:00100000:1.0:1789265367.008474:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 151 00000100:00100000:1.0:1789265367.008483:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+15:12150:x1876180399628672:12345-192.168.203.49@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789265367.008667:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+15:12150:x1876180399628672:12345-192.168.203.49@tcp:59:lhsmtool_posix.0 Request processed in 183us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265367.008691:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 151 00000100:00100000:2.0:1789265367.008969:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265367.009209:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399628800 00000100:00100000:0.0:1789265367.009215:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399628800 00000100:00100000:0.0:1789265367.009256:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 11 00000100:00100000:0.0:1789265367.009265:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+15:2394:x1876180399628800:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265367.009277:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265367.009308:0:7926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a97028 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf72 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265367.009327:0:7926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fccbd2b4c00) 00010000:00010000:0.0:1789265367.009332:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265367.009356:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+14:2394:x1876180399628800:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 93us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265367.009363:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 11 00000100:00100000:2.0:1789265367.022265:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265367.022418:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399628928 00000100:00100000:1.0:1789265367.022428:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399628928 00000100:00100000:1.0:1789265367.022496:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 152 00000100:00100000:1.0:1789265367.022508:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:12150:x1876180399628928:12345-192.168.203.49@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789265367.022644:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:12150:x1876180399628928:12345-192.168.203.49@tcp:59:lhsmtool_posix.0 Request processed in 137us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265367.022652:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 152 00000100:00100000:3.0:1789265367.041609:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417521792:0@lo:400:kworker.0 00000100:00100000:3.0:1789265367.041699:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265367.041767:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417522304:0@lo:400:kworker.0 00000100:00100000:3.0:1789265367.041793:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265367.041823:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180417522816:0@lo:400:kworker.0 00000100:00100000:3.0:1789265367.041846:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265367.041876:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1789265367.041882:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb849cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417521664:0@lo:400:kworker.0 00000100:00100000:3.0:1789265367.041910:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265367.041929:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb0a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417522176:0@lo:400:kworker.0 00000100:00100000:3.0:1789265367.041949:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265367.041967:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417522688:0@lo:400:kworker.0 00000100:00100000:3.0:1789265367.041991:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265367.042043:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417523200:0@lo:400:kworker.0 00000100:00100000:3.0:1789265367.042064:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265367.042090:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417522048:0@lo:400:kworker.0 00000100:00100000:3.0:1789265367.042114:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265367.042130:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417522560:0@lo:400:kworker.0 00000100:00100000:3.0:1789265367.042150:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265367.042163:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417523072:0@lo:400:kworker.0 00000100:00100000:0.0:1789265367.042411:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417522688 00000100:00100000:0.0:1789265367.042419:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417522688 00000100:00100000:0.0:1789265367.042469:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417523200 00000100:00100000:0.0:1789265367.042472:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417523200 00000100:00100000:0.0:1789265367.042485:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417522560 00000100:00100000:0.0:1789265367.042487:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417522560 00000100:00100000:0.0:1789265367.042503:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789265367.042511:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417522688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265367.042576:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417522688:12345-0@lo:400:kworker.0 Request processed in 66us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265367.042583:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789265367.042607:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789265367.042613:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417523200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265367.042643:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417523200:12345-0@lo:400:kworker.0 Request processed in 30us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265367.042649:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789265367.042661:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789265367.042666:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417522560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265367.042689:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417522560:12345-0@lo:400:kworker.0 Request processed in 24us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265367.042695:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:0.0:1789265367.042710:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265367.042713:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265367.042742:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417522688:0@lo:400:kworker.0 00000100:00100000:0.0:1789265367.042764:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417523200:0@lo:400:kworker.0 00000100:00100000:0.0:1789265367.042789:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417521792 00000100:00100000:0.0:1789265367.042792:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417521792 00000100:00100000:0.0:1789265367.042818:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417522304 00000100:00100000:0.0:1789265367.042820:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417522304 00000100:00100000:0.0:1789265367.042837:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417522816 00000100:00100000:0.0:1789265367.042840:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417522816 00000100:00100000:0.0:1789265367.042852:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417522176 00000100:00100000:0.0:1789265367.042854:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417522176 00000100:00100000:0.0:1789265367.042868:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1789265367.042873:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417521792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265367.042911:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417521792:12345-0@lo:400:kworker.0 Request processed in 37us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265367.042918:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1789265367.042937:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1789265367.042943:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417522304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265367.042982:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417522304:12345-0@lo:400:kworker.0 Request processed in 39us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265367.042988:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1789265367.043000:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1789265367.043005:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876180417522816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265367.043059:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876180417522816:12345-0@lo:400:kworker.0 Request processed in 53us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265367.043065:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1789265367.043077:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1789265367.043082:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417522176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265367.043108:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417522176:12345-0@lo:400:kworker.0 Request processed in 26us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265367.043113:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00080000:0.0:1789265367.043130:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265367.043147:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417522176:0@lo:400:kworker.0 00000100:00100000:0.0:1789265367.043158:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417521792:0@lo:400:kworker.0 00000100:00100000:0.0:1789265367.043167:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb0a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417522304:0@lo:400:kworker.0 00000100:00100000:0.0:1789265367.043178:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180417522816:0@lo:400:kworker.0 00000100:00100000:0.0:1789265367.043423:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417521920:0@lo:400:kworker.0 00000100:00100000:0.0:1789265367.043456:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265367.043476:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417522432:0@lo:400:kworker.0 00000100:00100000:0.0:1789265367.043510:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265367.043664:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417522944:0@lo:400:kworker.0 00000100:00100000:0.0:1789265367.043691:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265367.043722:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417522432 00000100:00100000:0.0:1789265367.043727:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417522432 00000100:00100000:0.0:1789265367.043767:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417522944 00000100:00100000:0.0:1789265367.043770:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417522944 00000100:00100000:0.0:1789265367.043785:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789265367.043791:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417522432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265367.043828:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417522432:12345-0@lo:400:kworker.0 Request processed in 37us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265367.043835:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789265367.043847:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1789265367.043854:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417522944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265367.043880:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417522944:12345-0@lo:400:kworker.0 Request processed in 27us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265367.043885:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00080000:0.0:1789265367.043899:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789265367.043925:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc91422a00 x1876180417522432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265367.043937:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417522432:0@lo:400:kworker.0 00010000:00080000:0.0:1789265367.043947:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc91423b80 x1876180417522944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265367.043954:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417522944:0@lo:400:kworker.0 00000100:00100000:3.0:1789265367.046053:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265367.046149:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417522560:0@lo:400:kworker.0 00000100:00100000:1.0:1789265367.046374:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417522048 00000100:00100000:1.0:1789265367.046381:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417522048 00000100:00100000:1.0:1789265367.046427:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417521920 00000100:00100000:1.0:1789265367.046431:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417521920 00000100:00100000:1.0:1789265367.046448:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789265367.046456:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417522048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265367.046577:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417521664 00000100:00100000:2.0:1789265367.046588:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417521664 00000100:00100000:2.0:1789265367.046620:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1789265367.046626:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417521664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265367.046670:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417521664:12345-0@lo:400:kworker.0 Request processed in 43us (4758us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265367.046678:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1789265367.046727:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb849cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417521664:0@lo:400:kworker.0 00000100:00100000:2.0:1789265367.046778:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417523072 00000100:00100000:2.0:1789265367.046782:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417523072 00000100:00100000:2.0:1789265367.046811:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789265367.046832:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417523072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265367.046923:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789265367.046931:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417521920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265367.046970:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417521920:12345-0@lo:400:kworker.0 Request processed in 41us (3513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265367.046977:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789265367.047051:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417521920:0@lo:400:kworker.0 00000100:00100000:0.0:1789265367.047278:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265367.047349:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417523328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265367.047388:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265367.047429:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417523328 00000100:00100000:0.0:1789265367.047433:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417523328 00000100:00100000:0.0:1789265367.047464:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789265367.047470:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417523328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265367.047484:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265367.047520:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417523328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265367.047527:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789265367.047559:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417523328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265367.054738:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417522048:12345-0@lo:400:kworker.0 Request processed in 8270us (12610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265367.054763:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789265367.058220:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417523072:12345-0@lo:400:kworker.0 Request processed in 11379us (16026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265367.058237:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789265367.060179:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417522048:0@lo:400:kworker.0 00000100:00100000:3.0:1789265367.060269:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417523072:0@lo:400:kworker.0 00000040:00080000:0.0:1789265367.298232:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789265367.365048:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789265368.004048:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265368.004059:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265368.004164:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1789265368.004172:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789265368.321722:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789265368.385415:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265369.413479:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265369.515964:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265369.516062:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399629056 00000100:00100000:2.0:1789265369.516071:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399629056 00000100:00100000:2.0:1789265369.516133:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 153 00000100:00100000:2.0:1789265369.516144:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+14:12192:x1876180399629056:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1789265369.516163:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265369.516183:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a97036 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbf79 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.516243:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a9703d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.516258:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a9703d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.516279:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a9703d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.516294:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a97044 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.516301:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a97044 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.516321:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a97044 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.516361:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a9703d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.516367:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a9703d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.516374:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a9703d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.516380:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520b800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265369.516384:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a9703d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.516391:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a9703d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.516402:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcca967b300) 00010000:00010000:2.0:1789265369.516404:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265369.516409:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a9703d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.516415:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a9703d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.516425:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a97044 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.516432:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a97044 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.516443:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a97044 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.516448:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520a800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265369.516451:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a97044 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.516457:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a97044 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.516464:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fcb83b84700) 00010000:00010000:2.0:1789265369.516466:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265369.516469:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a97044 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.516474:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a97044 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.516503:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a97036 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf79 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.516513:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcca967b300) 00010000:00010000:2.0:1789265369.516515:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265369.516518:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a97036 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf79 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.516526:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520a600, rc 0) 00000100:00100000:2.0:1789265369.516579:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+14:12192:x1876180399629056:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 438us (621us total) trans 0 rc 301/301 00000100:00100000:2.0:1789265369.516594:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 153 00000100:00080000:1.0:1789265369.516981:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265369.529789:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265369.531419:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399629312 00000100:00100000:1.0:1789265369.531433:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399629312 00000100:00100000:1.0:1789265369.531492:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 154 00000100:00100000:1.0:1789265369.531503:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+14:12192:x1876180399629312:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:1.0:1789265369.531561:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265369.531588:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a9698a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd9d expref: 14 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.531616:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcca967b300) 00010000:00010000:1.0:1789265369.531621:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265369.531690:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a9704b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.531713:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a9700c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf6b expref: 5 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.531722:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a9704b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.531774:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a9700c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf6b expref: 5 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.531789:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a9700c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf6b expref: 5 pid: 6518 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265369.531803:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc812aa300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876180417523456:192.168.203.49@tcp:104: 00000100:00100000:1.0:1789265369.531899:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccae7636c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265369.535263:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265369.535356:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399629440 00000100:00100000:3.0:1789265369.535366:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399629440 00010000:00010000:3.0:1789265369.535423:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a9700c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf6b expref: 6 pid: 6518 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265369.535459:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 80 00000100:00100000:3.0:1789265369.535469:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91422a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:2396:x1876180399629440:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265369.535483:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265369.535490:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a9700c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf6b expref: 6 pid: 6518 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265369.535504:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a9700c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf6b expref: 6 pid: 6518 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265369.535525:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcca967b300) 00010000:00010000:3.0:1789265369.535530:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a9704b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265369.535539:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a9704b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265369.535547:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a9704b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265369.535584:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265369.535627:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91422a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:2396:x1876180399629440:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 160us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265369.535635:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 80 00000100:00080000:0.0:1789265369.536486:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789265369.537489:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a9700c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf6b expref: 5 pid: 6518 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265369.537512:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc812aa300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876180417523456:192.168.203.49@tcp:104: 00010000:00010000:1.0:1789265369.537536:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a9704b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.537545:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a9704b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.537559:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a9704b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.537580:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97052 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.537591:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97052 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.537600:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97052 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.544472:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a97059 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.544496:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a97059 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.544507:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a97059 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265369.544525:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c53c26d reply state 0000000057195fd9 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a97059 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.544537:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a97059 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.544544:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:1.0:1789265369.544547:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789265369.544550:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789265369.544556:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789265369.544570:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a9704b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.544577:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a9704b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.544584:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a9704b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.544590:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fea00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265369.544594:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a9704b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.544602:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a9704b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.544613:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcca967b300) 00010000:00010000:1.0:1789265369.544615:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265369.544619:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a9704b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.544625:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a9704b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265369.544643:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c53c26d reply state 0000000057195fd9 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97052 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.544651:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97052 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.544656:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fccacd4e200) 00010000:00010000:1.0:1789265369.544659:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789265369.544666:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789265369.544784:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+15:12192:x1876180399629312:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 13279us (15000us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1789265369.544794:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 154 00000100:00100000:3.0:1789265369.603987:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265369.604012:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc812aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417523584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265369.604104:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265369.604193:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417523584 00000100:00100000:1.0:1789265369.604201:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417523584 00000100:00100000:1.0:1789265369.604244:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789265369.604253:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417523584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789265369.604286:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789265369.604336:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417523584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265369.604343:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789265369.604390:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc812aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417523584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265369.606176:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417523712:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265369.606236:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265369.610877:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417523712 00000100:00100000:1.0:1789265369.610892:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417523712 00000100:00100000:1.0:1789265369.611114:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789265369.611124:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417523712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265369.611165:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789265369.611262:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417523712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (5024us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265369.611269:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789265369.611321:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417523712:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265369.652717:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265369.652808:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399629568 00000100:00100000:1.0:1789265369.652817:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399629568 00000100:00100000:1.0:1789265369.652879:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 155 00000100:00100000:1.0:1789265369.652889:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+15:12200:x1876180399629568:12345-192.168.203.49@tcp:101:lctl.0 00010000:00010000:1.0:1789265369.652911:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265369.652933:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97060 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbf80 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.653071:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a97067 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.653086:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a97067 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.653099:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a97067 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265369.653140:0:8459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789265369.653145:0:8459:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789265369.653168:0:8459:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a97067 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.653193:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97060 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf80 expref: 17 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.653212:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a97067 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf80 expref: 16 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.653220:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fccacd4ed00) 00010000:00010000:1.0:1789265369.653223:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265369.653227:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fec00, rc 0) 00000100:00100000:1.0:1789265369.653279:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+16:12200:x1876180399629568:12345-192.168.203.49@tcp:101:lctl.0 Request processed in 391us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265369.653286:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 155 00000100:00100000:0.0:1789265369.714667:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265369.714771:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399629696 00000100:00100000:2.0:1789265369.714781:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399629696 00000100:00100000:2.0:1789265369.714843:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 156 00000100:00100000:2.0:1789265369.714853:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+16:12206:x1876180399629696:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1789265369.714873:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265369.714895:0:8460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a9706e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbf87 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.714960:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a97075 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.714974:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a97075 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.714985:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a97075 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.715006:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9707c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.715013:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9707c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.715060:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9707c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.715145:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a97083 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.715172:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a97083 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.715179:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a97083 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265369.715213:0:8460:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789265369.715217:0:8460:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265369.715237:0:8460:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a97083 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.715249:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a97075 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.715255:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a97075 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.715262:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a97075 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.715268:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520b800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265369.715284:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a97075 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.715292:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a97075 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.715304:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fccacd4ed00) 00010000:00010000:2.0:1789265369.715308:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265369.715313:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a97075 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.715328:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a97075 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.715344:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9707c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.715349:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9707c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.715355:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9707c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.715360:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520bc00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265369.715363:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9707c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.715369:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9707c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.715377:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fccacd4e200) 00010000:00010000:2.0:1789265369.715380:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265369.715383:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9707c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.715389:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9707c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.715414:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a9706e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf87 expref: 18 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.715428:0:8460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a97083 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf87 expref: 17 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265369.715443:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:2.0:1789265369.715446:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789265369.715449:0:8460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520a600, rc 0) 00000100:00100000:2.0:1789265369.715508:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+17:12206:x1876180399629696:12345-192.168.203.49@tcp:101:bash.0 Request processed in 656us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265369.715514:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 156 00000100:00100000:0.0:1789265369.719866:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265369.719997:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399629952 00000100:00100000:1.0:1789265369.720007:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399629952 00000100:00100000:1.0:1789265369.720118:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 157 00000100:00100000:1.0:1789265369.720127:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+17:12206:x1876180399629952:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1789265369.720150:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265369.720172:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a9708a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbf8e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.720290:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97091 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.720306:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97091 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.720316:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97091 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.720375:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a97098 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.720383:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a97098 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.720389:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a97098 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789265369.720943:0:6518:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1789265369.722534:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a9709f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265369.722558:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a9709f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265369.722569:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a9709f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265369.722687:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97091 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265369.722694:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97091 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265369.722701:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97091 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265369.722707:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fe800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265369.722712:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97091 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265369.722719:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97091 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265369.722743:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:0.0:1789265369.722746:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265369.722751:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97091 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265369.722757:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97091 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789265369.722770:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a8ce60c reply state 0000000048270e43 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a97098 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265369.722780:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a97098 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265369.722786:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fccacd4e600) 00010000:00010000:0.0:1789265369.722794:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789265369.722797:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789265369.722831:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a9708a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf8e expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265369.722844:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a9709f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf8e expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265369.722851:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:0.0:1789265369.722853:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265369.722856:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5800, rc 0) 00000100:00100000:0.0:1789265369.722996:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+20:12206:x1876180399629952:12345-192.168.203.49@tcp:101:bash.0 Request processed in 2860us (3130us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1789265369.723005:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 157 00000100:00100000:1.0:1789265369.728762:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265369.728854:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399630080 00000100:00100000:3.0:1789265369.728864:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399630080 00000100:00100000:3.0:1789265369.728966:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 55 00000100:00100000:3.0:1789265369.728976:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc812aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399630080:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1789265369.729002:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265369.729057:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022b654d4/0x9272d942b4a970ad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbf95 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265369.729084:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265369.729105:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1789265369.729110:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265369.729121:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022b654d4/0x9272d942b4a970ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf95 expref: 6 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265369.729143:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000022b654d4/0x9272d942b4a970ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf95 expref: 6 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265369.729179:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81490000, rc 0) 00000100:00100000:3.0:1789265369.729239:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc812aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+6:2396:x1876180399630080:12345-192.168.203.49@tcp:101:bash.0 Request processed in 264us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265369.729246:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 55 00000100:00100000:3.0:1789265369.732148:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265369.732299:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399630208 00000100:00100000:1.0:1789265369.732308:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399630208 00000100:00100000:1.0:1789265369.732364:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 56 00000100:00100000:1.0:1789265369.732373:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+6:12206:x1876180399630208:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1789265369.732405:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265369.732422:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002aaf63a7/0x9272d942b4a970b4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbf9c expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.732453:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000022b654d4/0x9272d942b4a970ad lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf95 expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.732462:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265369.732466:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265369.732470:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002aaf63a7/0x9272d942b4a970b4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf9c expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.732504:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000022b654d4/0x9272d942b4a970ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf95 expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.732517:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000022b654d4/0x9272d942b4a970ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf95 expref: 7 pid: 8434 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265369.732531:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb838f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8435:1876180417523840:192.168.203.49@tcp:104: 00000100:00100000:1.0:1789265369.732607:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccae763900 going to sleep for 11 seconds 00000100:00080000:0.0:1789265369.733629:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265369.735795:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265369.735875:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399630336 00000100:00100000:0.0:1789265369.735884:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399630336 00010000:00010000:0.0:1789265369.735923:0:7926:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000022b654d4/0x9272d942b4a970ad lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf95 expref: 8 pid: 8434 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265369.735964:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 81 00000100:00100000:0.0:1789265369.735973:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+8:2395:x1876180399630336:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265369.735987:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265369.736009:0:7926:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000022b654d4/0x9272d942b4a970ad lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf95 expref: 8 pid: 8434 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265369.736053:0:7926:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000022b654d4/0x9272d942b4a970ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf95 expref: 8 pid: 8434 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265369.736094:0:7926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265369.736099:0:7926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265369.736107:0:7926:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002aaf63a7/0x9272d942b4a970b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf9c expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265369.736117:0:7926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002aaf63a7/0x9272d942b4a970b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf9c expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265369.736169:0:7926:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002aaf63a7/0x9272d942b4a970b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf9c expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265369.736185:0:7926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7926:1876180417523968:192.168.203.49@tcp:105: 00000100:00100000:0.0:1789265369.736261:0:7926:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cb4780 going to sleep for 11 seconds 00010000:00010000:1.0:1789265369.736749:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022b654d4/0x9272d942b4a970ad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf95 expref: 8 pid: 8434 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265369.736767:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb838f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8435:1876180417523840:192.168.203.49@tcp:104: 00010000:00010000:1.0:1789265369.736794:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002aaf63a7/0x9272d942b4a970b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf9c expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265369.736813:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fe000, rc 0) 00000100:00100000:1.0:1789265369.736860:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+7:12206:x1876180399630208:12345-192.168.203.49@tcp:101:bash.0 Request processed in 4488us (4722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265369.736868:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 56 00000100:00100000:2.0:1789265369.741674:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265369.741797:0:7926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7926:1876180417523968:192.168.203.49@tcp:105: 00010000:00010000:0.0:1789265369.741823:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265369.741878:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399630336:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 5905us (6091us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265369.741888:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 81 00000100:00100000:3.0:1789265369.741968:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399630592 00000100:00100000:3.0:1789265369.741975:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399630592 00000100:00100000:3.0:1789265369.742051:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 36 00000100:00100000:3.0:1789265369.742060:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+20:12206:x1876180399630592:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:3.0:1789265369.742503:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+21:12206:x1876180399630592:12345-192.168.203.49@tcp:35:bash.0 Request processed in 443us (838us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1789265369.742510:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 36 00000100:00100000:2.0:1789265369.881578:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265369.881865:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399630848 00000100:00100000:0.0:1789265369.881875:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399630848 00000100:00100000:0.0:1789265369.881931:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 158 00000100:00100000:0.0:1789265369.881940:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+21:12216:x1876180399630848:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:0.0:1789265369.881965:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265369.881987:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a970bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbfa3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265369.882504:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789265369.882595:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a970bb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfa3 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265369.882611:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fccacd4ed00) 00010000:00010000:3.0:1789265369.882614:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265369.882619:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a970bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfa3 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265369.882633:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5e00, rc 0) 00000100:00100000:3.0:1789265369.882690:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+22:12216:x1876180399630848:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 751us (1120us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1789265369.882720:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 158 00000100:00100000:2.0:1789265369.898714:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265369.898812:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399631104 00000100:00100000:1.0:1789265369.898821:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399631104 00000100:00100000:1.0:1789265369.898876:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 37 00000100:00100000:1.0:1789265369.898885:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+22:12216:x1876180399631104:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:1.0:1789265369.899133:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+23:12216:x1876180399631104:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 248us (438us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1789265369.899142:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 37 00000100:00100000:2.0:1789265370.030454:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265370.031055:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399631232 00000100:00100000:0.0:1789265370.031066:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399631232 00000100:00100000:0.0:1789265370.031131:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 159 00000100:00100000:0.0:1789265370.031141:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83daaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+23:12223:x1876180399631232:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:0.0:1789265370.031162:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265370.031182:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a970c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbfaa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.031243:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a970d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.031258:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a970d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.031391:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a970d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265370.031432:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789265370.031436:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265370.031453:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a970d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.031488:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a970c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfaa expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.031508:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a970d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfaa expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.031535:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:0.0:1789265370.031538:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265370.031542:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5000, rc 0) 00000100:00100000:0.0:1789265370.031603:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83daaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+24:12223:x1876180399631232:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 463us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265370.031611:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 159 00000100:00100000:2.0:1789265370.041290:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265370.041422:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399631488 00000100:00100000:0.0:1789265370.041432:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399631488 00000100:00100000:0.0:1789265370.041497:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 160 00000100:00100000:0.0:1789265370.041508:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+24:12223:x1876180399631488:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:0.0:1789265370.041529:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265370.041549:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a970d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbfb1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.041648:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a970de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.041663:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a970de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.041686:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a970de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265370.041696:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789265370.041814:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a970d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfb1 expref: 27 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.041850:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a970de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfb1 expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.041860:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:0.0:1789265370.041863:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265370.041867:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5600, rc 0) 00000100:00100000:0.0:1789265370.042003:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+26:12223:x1876180399631488:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 496us (721us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1789265370.042012:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 160 00000100:00100000:2.0:1789265370.058736:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265370.058828:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399631616 00000100:00100000:3.0:1789265370.058838:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399631616 00000100:00100000:3.0:1789265370.058937:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 12 00000100:00100000:3.0:1789265370.058948:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+26:2396:x1876180399631616:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265370.058963:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265370.058987:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a970de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfb1 expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265370.059006:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:3.0:1789265370.059011:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265370.059099:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+25:2396:x1876180399631616:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 153us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265370.059108:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 12 00000100:00100000:2.0:1789265370.068308:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265370.068490:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399631872 00000100:00100000:3.0:1789265370.068500:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399631872 00000100:00100000:3.0:1789265370.068565:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 161 00000100:00100000:3.0:1789265370.068574:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+25:12223:x1876180399631872:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1789265370.068596:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265370.068617:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a970ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbfb8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265370.068725:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a970f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265370.068748:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a970f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265370.068775:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a970f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265370.068790:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789265370.068895:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a970ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfb8 expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265370.068915:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a970f3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfb8 expref: 27 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265370.068924:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:3.0:1789265370.068927:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789265370.068930:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81491600, rc 0) 00000100:00100000:3.0:1789265370.068986:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+27:12223:x1876180399631872:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 413us (688us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1789265370.068993:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 161 00000100:00100000:2.0:1789265370.090114:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265370.090290:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399632000 00000100:00100000:3.0:1789265370.090300:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399632000 00000100:00100000:3.0:1789265370.090362:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 57 00000100:00100000:3.0:1789265370.090372:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83daad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+6:2393:x1876180399632000:12345-192.168.203.49@tcp:1:lfs.0 00010000:00010000:0.0:1789265370.090523:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97101 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.090546:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002aaf63a7/0x9272d942b4a970b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf9c expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.090555:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789265370.090560:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265370.090565:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97101 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.090599:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002aaf63a7/0x9272d942b4a970b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf9c expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.090614:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002aaf63a7/0x9272d942b4a970b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf9c expref: 6 pid: 8435 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265370.090648:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8434:1876180417524096:192.168.203.49@tcp:104: 00000100:00100000:0.0:1789265370.090745:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cb4780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265370.096565:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8434:1876180417524096:192.168.203.49@tcp:104: 00010000:00010000:0.0:1789265370.096597:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97101 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265370.100979:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265370.101163:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399632128 00000100:00100000:3.0:1789265370.101173:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399632128 00002000:00100000:3.0:1789265370.101232:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9fcb83da9c00 x1876180399632128/t0(0) o4->5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp:696/0 lens 504/0 e 0 to 0 dl 1789265381 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265370.101243:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fcb83da9c00 with x1876180399632128 ext(0->12) 00010000:00010000:3.0:1789265370.101252:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002aaf63a7/0x9272d942b4a970b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf9c expref: 7 pid: 8435 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265370.101288:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002aaf63a7/0x9272d942b4a970b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf9c expref: 7 pid: 8435 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265370.101297:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fcb83da9c00 00000100:00100000:3.0:1789265370.101333:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 2 00000100:00100000:3.0:1789265370.101343:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5b43750b-84cf-4d62-9028-e016267b6509+7:2394:x1876180399632128:12345-192.168.203.49@tcp:4:lfs.0 00000100:00100000:3.0:1789265370.102653:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5b43750b-84cf-4d62-9028-e016267b6509+9:2394:x1876180399632128:12345-192.168.203.49@tcp:4:lfs.0 Request processed in 1304us (1678us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789265370.102666:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 2 00002000:00100000:3.0:1789265370.102676:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9fcb83da9c00 x1876180399632128/t4294967306(0) o4->5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp:696/0 lens 504/448 e 0 to 0 dl 1789265381 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265370.102686:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fcb83da9c00 with x1876180399632128 ext(0->12) 00010000:00010000:3.0:1789265370.102695:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002aaf63a7/0x9272d942b4a970b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf9c expref: 9 pid: 8435 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265370.102713:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002aaf63a7/0x9272d942b4a970b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf9c expref: 9 pid: 8435 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265370.102719:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fcb83da9c00 00000100:00100000:2.0:1789265370.109247:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265370.109470:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399632256 00000100:00100000:3.0:1789265370.109481:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399632256 00010000:00010000:3.0:1789265370.109524:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002aaf63a7/0x9272d942b4a970b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf9c expref: 9 pid: 8435 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265370.109591:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 82 00000100:00100000:3.0:1789265370.109602:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+9:2393:x1876180399632256:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265370.109631:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789265370.109650:0:6502:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789265370.109653:0:6502:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789265370 00002000:00010000:3.0:1789265370.109656:0:6502:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789265370 00002000:00010000:3.0:1789265370.109658:0:6502:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789265370 00002000:00010000:3.0:1789265370.109660:0:6502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789265370.109667:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002aaf63a7/0x9272d942b4a970b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf9c expref: 9 pid: 8435 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265370.109682:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002aaf63a7/0x9272d942b4a970b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf9c expref: 9 pid: 8435 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265370.109707:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002aaf63a7/0x9272d942b4a970b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf9c expref: 9 pid: 8435 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265370.109724:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265370.109741:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265370.109747:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97101 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265370.109757:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97101 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265370.109809:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265370.109867:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+8:2393:x1876180399632256:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 266us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265370.109875:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 82 00010000:00010000:1.0:1789265370.109951:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97101 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.109961:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97101 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.109982:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97101 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.109990:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97101 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.109998:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97101 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.110013:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4c00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265370.110017:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97101 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.110064:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97101 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.110090:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97101 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.110098:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97101 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265370.110147:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83daad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+7:2393:x1876180399632000:12345-192.168.203.49@tcp:1:lfs.0 Request processed in 19776us (20042us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265370.110166:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 57 00000100:00100000:2.0:1789265370.115635:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417524224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265370.115710:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265370.115943:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417524224 00000100:00100000:0.0:1789265370.115951:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417524224 00000100:00100000:0.0:1789265370.116047:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789265370.116057:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417524224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265370.116098:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789265370.116516:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417524224:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789265370.116595:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265370.116619:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417524224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265370.116626:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789265370.119652:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265370.119735:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399632512 00000100:00100000:0.0:1789265370.119745:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399632512 00000100:00100000:0.0:1789265370.119801:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 38 00000100:00100000:0.0:1789265370.119812:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdcc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+27:12223:x1876180399632512:12345-192.168.203.49@tcp:35:lfs.0 00000004:00010000:0.0:1789265370.119878:0:6520:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a970f3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfb8 expref: 27 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789265370.120115:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1789265370.120463:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1789265370.120791:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1789265370.120844:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a97108 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.120861:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a9709f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf8e expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.120871:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a97108 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.120905:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a9709f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf8e expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.120934:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a9709f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf8e expref: 31 pid: 6518 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265370.120950:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6520:1876180417524352:192.168.203.49@tcp:104: 00000100:00100000:0.0:1789265370.121379:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cb4300 going to sleep for 11 seconds 00000100:00100000:1.0:1789265370.121706:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265370.121721:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb838f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417524480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265370.121779:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265370.121819:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417524480 00000100:00100000:1.0:1789265370.121825:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417524480 00000100:00100000:1.0:1789265370.121872:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789265370.121881:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417524480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789265370.121899:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789265370.121952:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417524480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265370.121960:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:1.0:1789265370.121997:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265370.122050:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb838f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417524480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265370.129518:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6520:1876180417524352:192.168.203.49@tcp:104: 00010000:00010000:0.0:1789265370.129548:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a97108 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265370.130378:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265370.130604:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399632640 00000100:00100000:0.0:1789265370.130612:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399632640 00010000:00010000:0.0:1789265370.130649:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a9709f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf8e expref: 32 pid: 6518 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265370.130682:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 83 00000100:00100000:0.0:1789265370.130690:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83daa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+32:2396:x1876180399632640:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265370.130720:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265370.130738:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a9709f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf8e expref: 32 pid: 6518 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.130750:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a9709f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf8e expref: 32 pid: 6518 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.130771:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a9709f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf8e expref: 32 pid: 6518 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.130786:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:0.0:1789265370.130791:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a97108 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.130800:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a97108 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.130807:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a97108 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.130839:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265370.130890:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83daa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+31:2396:x1876180399632640:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 200us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265370.130897:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 83 00010000:00010000:1.0:1789265370.132267:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a97108 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.132290:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a97108 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265370.132506:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1789265370.132626:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1789265370.132737:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb838f4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1876180417524608:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789265370.132795:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265370.132828:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccae763b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265370.132972:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417524608 00000100:00100000:0.0:1789265370.132979:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417524608 00000100:00100000:0.0:1789265370.133135:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789265370.133146:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6520:x1876180417524608:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789265370.134424:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6520:x1876180417524608:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1275us (1623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265370.134445:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:1.0:1789265370.134696:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265370.134770:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb838f4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1876180417524608:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789265370.134901:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1789265370.134962:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8492ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1876180417524736:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789265370.135010:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265370.135059:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c48600 going to sleep for 11 seconds 00000100:00100000:1.0:1789265370.137610:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417524736 00000100:00100000:1.0:1789265370.137624:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417524736 00000100:00100000:1.0:1789265370.137690:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789265370.137700:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1876180417524736:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789265370.137904:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6520:x1876180417524736:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 204us (2892us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789265370.137912:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789265370.138289:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8492ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1876180417524736:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789265370.138358:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1789265370.138404:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a97108 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.138414:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a97108 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.138421:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a97108 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.138427:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265370.138432:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a97108 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.138439:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a97108 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.138455:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:0.0:1789265370.138457:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789265370.138462:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a97108 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.138467:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a97108 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789265370.138567:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789265370.138629:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1789265370.138640:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 421368616800ns, next at 422368614257ns, rc = 0 00000001:00080000:0.0:1789265370.138660:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1789265370.138684:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:0.0:1789265370.138687:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789265370.138694:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a970f3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfb8 expref: 35 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265370.138805:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdcc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+34:12223:x1876180399632512:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 18994us (19162us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1789265370.138814:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 38 00000020:00080000:0.0:1789265370.138818:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789265370.152863:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265370.152948:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399632768 00000100:00100000:0.0:1789265370.152958:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399632768 00000100:00100000:0.0:1789265370.153050:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 162 00000100:00100000:0.0:1789265370.153061:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83daa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+34:12223:x1876180399632768:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:0.0:1789265370.153092:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265370.153112:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a9710f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbfbf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.153180:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a9710f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfbf expref: 35 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.153195:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a9710f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfbf expref: 35 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.153212:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:0.0:1789265370.153215:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265370.153218:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da4400, rc 0) 00000100:00100000:0.0:1789265370.153290:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83daa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+35:12223:x1876180399632768:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 230us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265370.153312:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 162 00000100:00100000:1.0:1789265370.160536:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265370.160656:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399633024 00000100:00100000:3.0:1789265370.160665:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399633024 00000100:00100000:3.0:1789265370.160723:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 39 00000100:00100000:3.0:1789265370.160742:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+35:12223:x1876180399633024:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:3.0:1789265370.160979:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+36:12223:x1876180399633024:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 237us (455us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1789265370.160998:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 39 00000100:00100000:3.0:1789265370.276492:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265370.276975:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399633280 00000100:00100000:0.0:1789265370.276995:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399633280 00000100:00100000:0.0:1789265370.277127:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 163 00000100:00100000:0.0:1789265370.277137:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+36:12233:x1876180399633280:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:0.0:1789265370.277160:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265370.277180:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a97116 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbfc6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265370.277285:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789265370.277383:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a97116 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfc6 expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.277397:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fccacd4ed00) 00010000:00010000:0.0:1789265370.277400:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265370.277403:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a97116 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfc6 expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.277417:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5800, rc 0) 00000100:00100000:0.0:1789265370.277469:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+37:12233:x1876180399633280:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 334us (987us total) trans 4294967435 rc 301/301 00000100:00100000:0.0:1789265370.277476:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 163 00000100:00100000:2.0:1789265370.290179:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265370.290285:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399633408 00000100:00100000:1.0:1789265370.290294:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399633408 00000100:00100000:1.0:1789265370.290356:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 164 00000100:00100000:1.0:1789265370.290366:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+37:12233:x1876180399633408:12345-192.168.203.49@tcp:34:lfs.0 00010000:00010000:1.0:1789265370.290465:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97124 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290483:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97124 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290495:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97124 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290506:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a9712b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290514:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a9712b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290521:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a9712b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290594:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97132 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290603:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97132 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290611:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97132 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265370.290657:0:8459:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97132 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290669:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97124 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290685:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97124 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290692:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97124 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290697:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fea00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265370.290701:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97124 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290709:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97124 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290719:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:1.0:1789265370.290722:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265370.290736:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97124 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290742:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97124 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290756:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a9712b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290762:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a9712b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290767:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a9712b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290772:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fe800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265370.290780:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a9712b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290786:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a9712b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290795:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fccacd4e600) 00010000:00010000:1.0:1789265370.290797:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265370.290801:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a9712b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290806:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a9712b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290816:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97132 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290821:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97132 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290825:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97132 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290829:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265370.290832:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97132 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290837:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97132 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290842:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:1.0:1789265370.290844:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265370.290853:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97132 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265370.290863:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97132 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265370.290942:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+37:12233:x1876180399633408:12345-192.168.203.49@tcp:34:lfs.0 Request processed in 577us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265370.290951:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 164 00000100:00100000:1.0:1789265370.298137:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265370.298864:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399633664 00000100:00100000:3.0:1789265370.298877:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399633664 00000100:00100000:3.0:1789265370.298943:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 40 00000100:00100000:3.0:1789265370.298953:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+37:12233:x1876180399633664:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:3.0:1789265370.299209:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+38:12233:x1876180399633664:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 257us (1084us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1789265370.299218:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 40 00000100:00100000:3.0:1789265370.380094:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265370.380197:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399633920 00000100:00100000:2.0:1789265370.380221:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399633920 00000100:00100000:2.0:1789265370.380289:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 165 00000100:00100000:2.0:1789265370.380299:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+38:12236:x1876180399633920:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1789265370.380321:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265370.380341:0:8460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a97139 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbfcd expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.380417:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a97140 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.380432:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a97140 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.380442:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a97140 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.380453:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a97147 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.380459:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a97147 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.380466:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a97147 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.380578:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a9714e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.380587:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a9714e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.380594:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a9714e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265370.380612:0:8460:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789265370.380687:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a97140 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.380695:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a97140 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.380702:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a97140 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.380708:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520b600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265370.380713:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a97140 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.380721:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a97140 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.380747:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:2.0:1789265370.380750:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265370.380754:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a97140 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.380760:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a97140 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.380773:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a97147 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.380779:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a97147 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.380796:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a97147 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.380802:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520aa00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265370.380805:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a97147 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.380812:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a97147 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.380821:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fccacd4e600) 00010000:00010000:2.0:1789265370.380823:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265370.380826:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a97147 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.380832:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a97147 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.380867:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a97139 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfcd expref: 41 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.380881:0:8460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a9714e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfcd expref: 40 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.380888:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:2.0:1789265370.380890:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265370.380892:0:8460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520b800, rc 0) 00000100:00100000:2.0:1789265370.380956:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+40:12236:x1876180399633920:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 659us (873us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1789265370.380973:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 165 00000100:00100000:0.0:1789265370.389472:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265370.389655:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399634048 00000100:00100000:3.0:1789265370.389664:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399634048 00000100:00100000:3.0:1789265370.389715:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 166 00000100:00100000:3.0:1789265370.389723:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+40:12236:x1876180399634048:12345-192.168.203.49@tcp:54:lfs.0 00010000:00010000:3.0:1789265370.389792:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a9715c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265370.389809:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a9715c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265370.389822:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a9715c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265370.389856:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a9715c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265370.389862:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a9715c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265370.389869:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a9715c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265370.389875:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265370.389879:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a9715c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265370.389886:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a9715c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265370.389896:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:3.0:1789265370.389899:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265370.389916:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a9715c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265370.389922:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a9715c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265370.392888:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+40:12236:x1876180399634048:12345-192.168.203.49@tcp:54:lfs.0 Request processed in 3151us (3410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265370.392903:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 166 00000100:00100000:1.0:1789265370.398200:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265370.398366:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399634304 00000100:00100000:3.0:1789265370.398377:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399634304 00000100:00100000:3.0:1789265370.398436:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 41 00000100:00100000:3.0:1789265370.398447:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+40:12236:x1876180399634304:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:3.0:1789265370.398677:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+41:12236:x1876180399634304:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 232us (487us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789265370.398685:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 41 00010000:00010000:3.0:1789265370.433555:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265370.809120:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265370.809217:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399634560 00000100:00100000:0.0:1789265370.809227:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399634560 00000100:00100000:0.0:1789265370.809298:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 167 00000100:00100000:0.0:1789265370.809310:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+41:12267:x1876180399634560:12345-192.168.203.49@tcp:101:cat.0 00010000:00010000:0.0:1789265370.809347:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265370.809368:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a97163 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbfd4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.809470:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a9716a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.809484:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a9716a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.809498:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a9716a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265370.809509:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789265370.809628:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a97163 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfd4 expref: 44 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.809646:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a9716a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfd4 expref: 43 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.809655:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:0.0:1789265370.809657:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265370.809661:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5400, rc 0) 00000100:00100000:0.0:1789265370.809735:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+43:12267:x1876180399634560:12345-192.168.203.49@tcp:101:cat.0 Request processed in 428us (627us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1789265370.809743:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 167 00000100:00100000:0.0:1789265370.816702:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265370.816782:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265370.816864:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399634944 00000100:00100000:3.0:1789265370.816874:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399634816 00000100:00100000:2.0:1789265370.816874:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399634944 00000100:00100000:3.0:1789265370.816877:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399634816 00000100:00100000:3.0:1789265370.816931:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 42 00000100:00100000:2.0:1789265370.816931:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 13 00000100:00100000:2.0:1789265370.816941:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+44:2393:x1876180399634944:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265370.816956:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265370.816993:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a9716a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfd4 expref: 44 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.817012:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:2.0:1789265370.817016:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265370.817106:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+43:2393:x1876180399634944:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 166us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265370.817114:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 13 00000100:00100000:3.0:1789265370.817514:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+42:12267:x1876180399634816:12345-192.168.203.49@tcp:35:cat.0 00000100:00100000:3.0:1789265370.817751:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+43:12267:x1876180399634816:12345-192.168.203.49@tcp:35:cat.0 Request processed in 810us (1059us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1789265370.817758:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 42 00000100:00100000:0.0:1789265370.892646:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265370.892852:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399635200 00000100:00100000:2.0:1789265370.892863:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399635200 00000100:00100000:2.0:1789265370.892931:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 168 00000100:00100000:2.0:1789265370.892941:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+43:12273:x1876180399635200:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:2.0:1789265370.892965:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265370.892969:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789265370.893008:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a970d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfaa expref: 43 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.893057:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:2.0:1789265370.893061:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265370.893082:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a97178 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbfdb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.893185:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a9717f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.893199:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a9714e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfcd expref: 43 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.893206:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a9717f lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.893236:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a9714e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfcd expref: 43 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.893250:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a9714e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfcd expref: 43 pid: 8460 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265370.893275:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876180417524864:192.168.203.49@tcp:104: 00000100:00100000:2.0:1789265370.893361:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b296c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265370.896838:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265370.896924:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399635328 00000100:00100000:0.0:1789265370.896933:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399635328 00010000:00010000:0.0:1789265370.896971:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a9714e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfcd expref: 44 pid: 8460 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265370.897020:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 84 00000100:00100000:0.0:1789265370.897061:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+44:2395:x1876180399635328:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265370.897074:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265370.897081:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a9714e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfcd expref: 44 pid: 8460 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.897092:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a9714e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfcd expref: 44 pid: 8460 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.897113:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:0.0:1789265370.897117:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a9717f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.897125:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a9717f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.897132:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a9717f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265370.897149:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265370.897197:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+44:2395:x1876180399635328:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 138us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265370.897204:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 84 00010000:00010000:2.0:1789265370.897437:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a9714e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfcd expref: 43 pid: 8460 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265370.897455:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876180417524864:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265370.897477:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a9717f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.897486:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a9717f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.897512:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a9717f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265370.897531:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789265370.897651:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a97178 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfdb expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.897665:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a9717f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfdb expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.897673:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:2.0:1789265370.897676:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789265370.897679:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520aa00, rc 0) 00000100:00100000:2.0:1789265370.897705:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+43:12273:x1876180399635200:12345-192.168.203.49@tcp:101:dd.0 Request processed in 4766us (5070us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1789265370.897712:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 168 00000100:00100000:3.0:1789265370.900610:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265370.900696:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399635456 00000100:00100000:2.0:1789265370.900705:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399635456 00000100:00100000:2.0:1789265370.900777:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 169 00000100:00100000:2.0:1789265370.900787:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+43:12273:x1876180399635456:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:2.0:1789265370.900808:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265370.900829:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a9718d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbfe2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.900859:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a97194 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.900890:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a97194 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.900902:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a97194 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.901039:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a9718d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfe2 expref: 45 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.901058:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a97194 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfe2 expref: 44 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.901066:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:2.0:1789265370.901069:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789265370.901072:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb520a800, rc 0) 00000100:00100000:2.0:1789265370.901179:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+44:12273:x1876180399635456:12345-192.168.203.49@tcp:101:dd.0 Request processed in 392us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265370.901186:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 169 00000100:00100000:1.0:1789265370.905738:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265370.905840:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399635712 00000100:00100000:2.0:1789265370.905850:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399635712 00000100:00100000:2.0:1789265370.905944:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 170 00000100:00100000:2.0:1789265370.905956:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+44:12273:x1876180399635712:12345-192.168.203.49@tcp:36:dd.0 00010000:00010000:2.0:1789265370.906217:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9719b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.906234:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9719b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.906266:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9719b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265370.906374:0:8460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1789265370.906396:0:8460:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d30bfe3 reply state 00000000c265f503 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9719b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.906409:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9719b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265370.906417:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:2.0:1789265370.906419:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789265370.906422:0:8460:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265370.906510:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+47:12273:x1876180399635712:12345-192.168.203.49@tcp:36:dd.0 Request processed in 557us (790us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1789265370.906518:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 170 00000020:00080000:2.0:1789265370.906522:0:8460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789265371.342059:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265371.343675:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399635840 00000100:00100000:2.0:1789265371.343689:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399635840 00000100:00100000:2.0:1789265371.343785:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 171 00000100:00100000:2.0:1789265371.343801:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+47:12287:x1876180399635840:12345-192.168.203.49@tcp:101:stat.0 00010000:00010000:2.0:1789265371.343827:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265371.343850:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a971a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbfe9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.343918:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a971a9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.343933:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a971a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.343961:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a971a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.343974:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a971b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.343982:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a971b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.343989:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a971b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.344105:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e400/0x9272d942b4a971b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.344117:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a9717f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfdb expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.344125:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e400/0x9272d942b4a971b7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.344171:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a9717f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfdb expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.344185:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a9717f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfdb expref: 48 pid: 6518 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265371.344198:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876180417524992:192.168.203.49@tcp:104: 00000100:00080000:1.0:1789265371.344448:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265371.344520:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b296c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265371.355328:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265371.355730:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399636096 00000100:00100000:1.0:1789265371.355741:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399636096 00000100:00100000:1.0:1789265371.355801:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 43 00000100:00100000:1.0:1789265371.355811:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+49:6161:x1876180399636096:12345-192.168.203.49@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789265371.356161:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+50:6161:x1876180399636096:12345-192.168.203.49@tcp:35:ldlm_bl.0 Request processed in 343us (835us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1789265371.356177:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 43 00000100:00100000:2.0:1789265371.357300:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876180417524992:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265371.357326:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e400/0x9272d942b4a971b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265371.363588:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265371.363680:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399636224 00000100:00100000:2.0:1789265371.363690:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399636224 00010000:00010000:2.0:1789265371.363741:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a9717f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfdb expref: 50 pid: 6518 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265371.363784:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 85 00000100:00100000:2.0:1789265371.363794:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+50:2393:x1876180399636224:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265371.363808:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265371.363814:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a9717f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfdb expref: 50 pid: 6518 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.363829:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a9717f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfdb expref: 50 pid: 6518 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.363851:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520aa00/0x9272d942b4a9717f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfdb expref: 50 pid: 6518 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.363868:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:2.0:1789265371.363873:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e400/0x9272d942b4a971b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.363883:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e400/0x9272d942b4a971b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.363891:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e400/0x9272d942b4a971b7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.363948:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265371.364007:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+49:2393:x1876180399636224:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 214us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265371.364016:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 85 00010000:00010000:3.0:1789265371.364828:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e400/0x9272d942b4a971b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.364852:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e400/0x9272d942b4a971b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265371.364904:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789265371.364908:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265371.364934:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e400/0x9272d942b4a971b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.364948:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e400/0x9272d942b4a971b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.364957:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a971a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.364964:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a971a9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.364971:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a971a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.364977:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520ac00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265371.364980:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a971a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.364987:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a971a9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.364998:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:3.0:1789265371.365002:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265371.365006:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a971a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.365136:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520ac00/0x9272d942b4a971a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.365426:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a971b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.365435:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a971b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.365441:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a971b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.365446:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520b800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265371.365449:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a971b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.365456:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a971b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.365466:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fccacd4e600) 00010000:00010000:3.0:1789265371.365469:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265371.365472:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a971b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.365477:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b800/0x9272d942b4a971b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.365511:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520b600/0x9272d942b4a971a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfe9 expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.365523:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e400/0x9272d942b4a971b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfe9 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.365538:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:3.0:1789265371.365541:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265371.365544:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2e400, rc 0) 00000100:00100000:3.0:1789265371.365642:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+48:12287:x1876180399635840:12345-192.168.203.49@tcp:101:stat.0 Request processed in 21845us (23623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265371.365650:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 171 00010000:00010000:3.0:1789265371.457743:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265371.465870:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265371.465906:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265371.465937:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265371.465989:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265371.466011:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265371.466074:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265371.466104:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399636608 00000100:00100000:1.0:1789265371.466113:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399636608 00000100:00100000:1.0:1789265371.466344:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399636736 00000100:00100000:1.0:1789265371.466348:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399636736 00000100:00100000:1.0:1789265371.466374:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 124 00000100:00100000:1.0:1789265371.466384:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399636608:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265371.466454:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399636608:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 71us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265371.466463:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 124 00000100:00100000:1.0:1789265371.466480:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 125 00000100:00100000:1.0:1789265371.466487:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+7:2395:x1876180399636736:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265371.466511:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+7:2395:x1876180399636736:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 25us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265371.466517:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 125 00000100:00100000:0.0:1789265371.466685:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399636864 00000100:00100000:0.0:1789265371.466698:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399636864 00000100:00100000:0.0:1789265371.466741:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399636480 00000100:00100000:0.0:1789265371.466745:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399636480 00000100:00100000:0.0:1789265371.466761:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399636992 00000100:00100000:0.0:1789265371.466763:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399636992 00000100:00100000:0.0:1789265371.466779:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 323 00000100:00100000:0.0:1789265371.466786:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2395:x1876180399636864:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265371.466818:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2395:x1876180399636864:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 33us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265371.466825:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 323 00000100:00100000:0.0:1789265371.466852:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 324 00000100:00100000:0.0:1789265371.466858:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399636480:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265371.466882:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399636480:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 24us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265371.466887:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 324 00000100:00100000:0.0:1789265371.466898:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 325 00000100:00100000:0.0:1789265371.466903:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2395:x1876180399636992:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265371.466922:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2395:x1876180399636992:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 19us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265371.466927:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 325 00000100:00100000:3.0:1789265371.467010:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399636352 00000100:00100000:3.0:1789265371.467014:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399636352 00000100:00100000:3.0:1789265371.467061:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 389 00000100:00100000:3.0:1789265371.467069:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2395:x1876180399636352:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265371.467097:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2395:x1876180399636352:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 30us (1236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265371.467104:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 389 00000100:00080000:2.0:1789265371.473226:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789265371.473237:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265371.473240:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265371.473243:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265371.497683:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265371.502673:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399637248 00000100:00100000:2.0:1789265371.502689:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399637248 00000100:00100000:2.0:1789265371.502771:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 172 00000100:00100000:2.0:1789265371.502782:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+48:12293:x1876180399637248:12345-192.168.203.49@tcp:36:truncate.0 00010000:00010000:2.0:1789265371.502909:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265371.502937:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e400/0x9272d942b4a971b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfe9 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.503046:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:2.0:1789265371.503052:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265371.503215:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f000/0x9272d942b4a971be lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.503229:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f000/0x9272d942b4a971be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.503239:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f000/0x9272d942b4a971be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265371.503280:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1789265371.503316:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f1e4896 reply state 000000006e3cc0f5 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f000/0x9272d942b4a971be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.503327:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f000/0x9272d942b4a971be lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.503334:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:2.0:1789265371.503336:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789265371.503339:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265371.503508:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+50:12293:x1876180399637248:12345-192.168.203.49@tcp:36:truncate.0 Request processed in 726us (5833us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1789265371.503516:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 172 00000020:00080000:2.0:1789265371.503521:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789265371.649348:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265371.649372:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417525120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265371.649440:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265371.650732:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417525120 00000100:00100000:0.0:1789265371.650743:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417525120 00000100:00080000:2.0:1789265371.650870:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265371.651232:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789265371.651244:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417525120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789265371.651276:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265371.651360:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417525120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (1919us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265371.651367:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789265371.651440:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417525120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265371.659261:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265371.659382:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399637376 00000100:00100000:3.0:1789265371.659398:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399637376 00000100:00100000:3.0:1789265371.659471:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 173 00000100:00100000:3.0:1789265371.659481:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+50:12307:x1876180399637376:12345-192.168.203.49@tcp:101:stat.0 00010000:00010000:3.0:1789265371.659510:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265371.659535:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a971c5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbff0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.659613:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a971cc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.659629:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a971cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.659660:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a971cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.659677:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a971d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.659685:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a971d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.659692:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a971d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.659806:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a971da lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.659815:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a971da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.659821:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a971da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265371.659873:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1789265371.659879:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265371.659905:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a971da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.659918:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a971da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.659928:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a971cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.659948:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a971cc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.659954:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a971cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.659961:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265371.659966:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a971cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.659974:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a971cc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.660151:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:3.0:1789265371.660154:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265371.660160:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a971cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.660166:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a971cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.660184:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a971d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.660189:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a971d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.660195:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a971d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.660199:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81491600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265371.660208:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a971d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.660215:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a971d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.660221:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fccacd4e600) 00010000:00010000:3.0:1789265371.660223:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265371.660226:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a971d3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.660231:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a971d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.660337:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a971c5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbff0 expref: 52 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.660356:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a971da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbff0 expref: 51 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.660365:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:3.0:1789265371.660368:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265371.660371:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81490000, rc 0) 00000100:00100000:3.0:1789265371.660476:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+51:12307:x1876180399637376:12345-192.168.203.49@tcp:101:stat.0 Request processed in 996us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265371.660484:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 173 00000100:00100000:1.0:1789265371.763698:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265371.763896:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399637632 00000100:00100000:2.0:1789265371.763910:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399637632 00000100:00100000:2.0:1789265371.763998:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 174 00000100:00100000:2.0:1789265371.764010:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+51:12317:x1876180399637632:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1789265371.764078:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265371.764107:0:8460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e400/0x9272d942b4a971e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbff7 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265371.764277:0:8460:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789265371.764423:0:8460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e400/0x9272d942b4a971e1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbff7 expref: 53 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.764441:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fccacd4ed00) 00010000:00010000:2.0:1789265371.764445:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265371.764458:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e400/0x9272d942b4a971e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbff7 expref: 53 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.764477:0:8460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2e400, rc 0) 00000100:00100000:2.0:1789265371.764555:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+52:12317:x1876180399637632:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 547us (871us total) trans 4294967447 rc 301/301 00000100:00100000:2.0:1789265371.764563:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 174 00000100:00100000:0.0:1789265371.769203:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265371.769533:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399637888 00000100:00100000:1.0:1789265371.769546:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399637888 00000100:00100000:1.0:1789265371.769629:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 44 00000100:00100000:1.0:1789265371.769641:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdc9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+52:12317:x1876180399637888:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:1.0:1789265371.769958:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdc9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+53:12317:x1876180399637888:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 319us (768us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1789265371.769966:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 44 00000100:00100000:1.0:1789265371.857127:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265371.857564:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399638144 00000100:00100000:3.0:1789265371.857665:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399638144 00000100:00100000:3.0:1789265371.857844:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 175 00000100:00100000:3.0:1789265371.857856:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+53:12323:x1876180399638144:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1789265371.857904:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265371.857928:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a971ef lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cbffe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.858104:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a971f6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.858122:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a971da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbff0 expref: 54 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.858131:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a971f6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.858896:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a971da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbff0 expref: 54 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.858916:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a971da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbff0 expref: 54 pid: 6518 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265371.858934:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd336680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876180417525248:192.168.203.49@tcp:104: 00000100:00100000:3.0:1789265371.859275:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c48000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265371.866836:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265371.867013:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd336680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876180417525248:192.168.203.49@tcp:104: 00010000:00010000:3.0:1789265371.867084:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a971f6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265371.867440:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399638272 00000100:00100000:1.0:1789265371.867450:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399638272 00010000:00010000:1.0:1789265371.867503:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a971da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbff0 expref: 55 pid: 6518 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265371.867547:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 86 00000100:00100000:1.0:1789265371.867558:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+55:2396:x1876180399638272:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265371.867727:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265371.867737:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a971da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbff0 expref: 55 pid: 6518 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265371.867751:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a971da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbff0 expref: 55 pid: 6518 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265371.867782:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a971da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbff0 expref: 55 pid: 6518 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265371.867802:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:1.0:1789265371.867808:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a971f6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265371.867826:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a971f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265371.867835:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a971f6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265371.867902:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265371.868055:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a971f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.868063:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a971f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265371.868096:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1789265371.868279:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a971ef lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbffe expref: 56 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.868298:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a971f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbffe expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.868306:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:3.0:1789265371.868309:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789265371.868311:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81491600, rc 0) 00000100:00100000:1.0:1789265371.868497:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+55:2396:x1876180399638272:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 938us (1673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265371.868507:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 86 00000100:00100000:3.0:1789265371.868906:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+54:12323:x1876180399638144:12345-192.168.203.49@tcp:101:bash.0 Request processed in 11051us (11792us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1789265371.868916:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 175 00000100:00100000:2.0:1789265371.874279:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265371.874394:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399638528 00000100:00100000:3.0:1789265371.874407:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399638528 00000100:00100000:3.0:1789265371.874488:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 176 00000100:00100000:3.0:1789265371.874501:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+54:12323:x1876180399638528:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:3.0:1789265371.874848:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97204 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.874874:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97204 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.874888:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97204 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789265371.874940:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:3.0:1789265371.874982:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025f7037d reply state 0000000082972f82 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97204 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.874996:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97204 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.875005:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:3.0:1789265371.875009:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789265371.875012:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265371.875159:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+57:12323:x1876180399638528:12345-192.168.203.49@tcp:36:bash.0 Request processed in 660us (893us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1789265371.875168:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 176 00000020:00080000:3.0:1789265371.875175:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789265371.882649:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265371.882820:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399638656 00000100:00100000:2.0:1789265371.882834:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399638656 00000100:00100000:2.0:1789265371.882917:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 177 00000100:00100000:2.0:1789265371.882928:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+57:12323:x1876180399638656:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1789265371.882962:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265371.882991:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e400/0x9272d942b4a9720b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc005 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.883161:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a97212 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.883181:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a971f6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbffe expref: 58 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.883191:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a97212 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.883235:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a971f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbffe expref: 58 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.883528:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a971f6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbffe expref: 58 pid: 6516 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265371.883545:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dab100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876180417525376:192.168.203.49@tcp:104: 00000100:00100000:2.0:1789265371.883651:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b29e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265371.888906:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dab100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876180417525376:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265371.888951:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a97212 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265371.890299:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265371.890728:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399638784 00000100:00100000:3.0:1789265371.890743:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399638784 00010000:00010000:3.0:1789265371.890798:0:7926:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a971f6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbffe expref: 59 pid: 6516 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265371.890911:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 87 00000100:00100000:3.0:1789265371.890924:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+59:2396:x1876180399638784:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265371.890945:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265371.890953:0:7926:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a971f6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbffe expref: 59 pid: 6516 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.890969:0:7926:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a971f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbffe expref: 59 pid: 6516 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.891008:0:7926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a971f6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbffe expref: 59 pid: 6516 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.891090:0:7926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:3.0:1789265371.891097:0:7926:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a97212 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.891110:0:7926:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a97212 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.891119:0:7926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a97212 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.891151:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265371.891227:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+58:2396:x1876180399638784:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 304us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265371.891235:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 87 00010000:00010000:0.0:1789265371.891313:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a97212 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265371.891322:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a97212 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265371.891409:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789265371.891415:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265371.891445:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a97212 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265371.891488:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e400/0x9272d942b4a9720b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc005 expref: 58 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265371.891504:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a97212 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc005 expref: 57 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265371.891512:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:0.0:1789265371.891514:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265371.891517:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2ee00, rc 0) 00000100:00100000:0.0:1789265371.891560:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+57:12323:x1876180399638656:12345-192.168.203.49@tcp:101:bash.0 Request processed in 8623us (8915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265371.891568:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 177 00000100:00100000:1.0:1789265371.898674:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265371.898767:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399639040 00000100:00100000:0.0:1789265371.898780:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399639040 00000100:00100000:0.0:1789265371.898850:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 45 00000100:00100000:0.0:1789265371.898861:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+57:12323:x1876180399639040:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:0.0:1789265371.899200:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+58:12323:x1876180399639040:12345-192.168.203.49@tcp:35:bash.0 Request processed in 340us (539us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1789265371.899209:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 45 00000100:00100000:1.0:1789265371.979205:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265371.979363:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399639296 00000100:00100000:3.0:1789265371.979388:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399639296 00000100:00100000:3.0:1789265371.979468:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 178 00000100:00100000:3.0:1789265371.979480:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+58:12333:x1876180399639296:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1789265371.979512:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265371.979537:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a97219 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc00c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265371.979701:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789265371.979836:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a97219 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc00c expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.979854:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fccacd4ed00) 00010000:00010000:3.0:1789265371.979863:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265371.979870:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a97219 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc00c expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265371.979889:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81491600, rc 0) 00000100:00100000:3.0:1789265371.980202:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+59:12333:x1876180399639296:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 722us (1010us total) trans 4294967453 rc 301/301 00000100:00100000:3.0:1789265371.980212:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 178 00000100:00100000:1.0:1789265371.987094:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265371.987178:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399639424 00000100:00100000:2.0:1789265371.987191:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399639424 00000100:00100000:2.0:1789265371.987270:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 179 00000100:00100000:2.0:1789265371.987282:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+59:12333:x1876180399639424:12345-192.168.203.49@tcp:34:lfs.0 00010000:00010000:2.0:1789265371.987411:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97227 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987435:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97227 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987449:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97227 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987463:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9722e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987472:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9722e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987504:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9722e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987617:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a97235 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987628:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a97235 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987635:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a97235 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265371.987693:0:8460:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a97235 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987707:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97227 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987724:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97227 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987733:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97227 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987741:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265371.987746:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97227 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987754:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97227 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987768:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:2.0:1789265371.987778:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265371.987784:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97227 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987792:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97227 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987810:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9722e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987817:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9722e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987824:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9722e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987831:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265371.987834:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9722e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987840:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9722e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987849:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fccacd4e600) 00010000:00010000:2.0:1789265371.987851:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265371.987854:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9722e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987861:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9722e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987871:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a97235 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987883:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a97235 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987889:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a97235 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987895:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265371.987898:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a97235 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987903:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a97235 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987911:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:2.0:1789265371.987913:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265371.987917:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a97235 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265371.987922:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a97235 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265371.988087:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+59:12333:x1876180399639424:12345-192.168.203.49@tcp:34:lfs.0 Request processed in 805us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265371.988098:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 179 00000100:00100000:1.0:1789265371.999774:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265371.999884:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399639680 00000100:00100000:0.0:1789265371.999898:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399639680 00000100:00100000:0.0:1789265371.999981:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 46 00000100:00100000:0.0:1789265371.999994:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+59:12333:x1876180399639680:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:0.0:1789265372.001067:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+60:12333:x1876180399639680:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 1065us (1297us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1789265372.001080:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 46 00000001:00080000:2.0:1789265372.005920:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000004:00080000:2.0:1789265372.005991:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:3.0:1789265372.005998:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97052 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789265372.006015:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fcb83c483c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789265372.006053:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fcb82b7d300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fcb83c48900 00000020:00080000:2.0:1789265372.006057:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fcb82b7d600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fccadb3fc00 00000100:00100000:0.0:1789265372.006173:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265372.006200:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417525504:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789265372.006283:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1789265372.006642:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1789265372.006711:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1789265372.006740:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417525504 00000100:00100000:1.0:1789265372.006750:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417525504 00000100:00100000:1.0:1789265372.006833:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789265372.006844:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1876180417525504:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789265372.006874:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:1.0:1789265372.006911:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa605da, atime: 0x6aa605da, ctime: 0x6aa605da, blocks: 0x8 00010000:00010000:1.0:1789265372.006920:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a43304be/0x9272d942b4a9723c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265372.006937:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=423s v=(0 0) 00010000:00010000:1.0:1789265372.006942:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265372.006948:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a43304be/0x9272d942b4a9723c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265372.006964:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a43304be/0x9272d942b4a9723c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265372.006974:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a43304be/0x9272d942b4a9723c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265372.006991:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a43304be/0x9272d942b4a9723c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265372.007012:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265372.008137:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97052 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008147:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97052 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008154:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ffe00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265372.008160:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97052 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008170:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97052 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008191:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fccacd4e200) 00010000:00010000:3.0:1789265372.008194:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265372.008200:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97052 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008208:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97052 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008258:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a97059 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008265:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a97059 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008272:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a97059 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008277:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265372.008280:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a97059 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008287:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a97059 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008296:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:3.0:1789265372.008298:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265372.008301:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a97059 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008307:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a97059 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008340:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a97098 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008347:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a97098 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008353:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a97098 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008374:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265372.008378:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a97098 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008384:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a97098 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008393:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fccacd4e600) 00010000:00010000:3.0:1789265372.008395:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265372.008398:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a97098 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008404:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a97098 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008421:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9719b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008427:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9719b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008432:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9719b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008436:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520bc00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265372.008439:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9719b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008445:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9719b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008465:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:3.0:1789265372.008467:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265372.008470:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9719b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008475:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520bc00/0x9272d942b4a9719b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008487:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f000/0x9272d942b4a971be lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008493:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f000/0x9272d942b4a971be lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008499:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f000/0x9272d942b4a971be lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008505:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265372.008508:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f000/0x9272d942b4a971be lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008514:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f000/0x9272d942b4a971be lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008520:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:3.0:1789265372.008523:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265372.008526:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f000/0x9272d942b4a971be lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008531:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f000/0x9272d942b4a971be lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008553:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97204 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008559:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97204 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008564:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97204 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008569:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265372.008572:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97204 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008579:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97204 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008780:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:3.0:1789265372.008782:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265372.008785:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97204 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.008791:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97204 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265372.009532:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3643:x1876180417525504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2683us (3241us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789265372.009546:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:1.0:1789265372.009592:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265372.009601:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a43304be/0x9272d942b4a9723c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265372.009612:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fe800 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265372.009617:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a43304be/0x9272d942b4a9723c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265372.009628:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a43304be/0x9272d942b4a9723c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265372.009648:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a43304be/0x9272d942b4a9723c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265372.009655:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a43304be/0x9272d942b4a9723c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265372.009676:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265372.009694:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265372.009696:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789265372.010678:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789265372.011678:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fcb8495e680/2, rc 0, transno 4294967308 00000100:00100000:0.0:1789265372.011698:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417525504:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789265372.051826:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265372.052050:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399639936 00000100:00100000:0.0:1789265372.052060:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399639936 00000100:00100000:0.0:1789265372.052123:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 180 00000100:00100000:0.0:1789265372.052133:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+17:12336:x1876180399639936:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:0.0:1789265372.052155:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265372.052182:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a97243 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc013 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265372.052573:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9724a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265372.052589:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9724a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265372.052600:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9724a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265372.052615:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97251 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265372.052622:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97251 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265372.052629:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97251 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265372.052748:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a97258 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265372.052758:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a97258 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265372.052766:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a97258 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265372.052775:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789265372.052853:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9724a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265372.052861:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9724a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265372.052876:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9724a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265372.052882:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265372.052887:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9724a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265372.052894:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9724a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265372.052906:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:0.0:1789265372.052910:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265372.052914:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9724a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265372.052921:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9724a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265372.052935:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97251 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265372.052942:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97251 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265372.052948:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97251 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265372.052953:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265372.052956:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97251 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265372.052973:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97251 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265372.052982:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fcca9673100) 00010000:00010000:0.0:1789265372.052984:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265372.052986:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97251 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265372.052992:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97251 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265372.054076:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a97243 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc013 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265372.054103:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a97258 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc013 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265372.054111:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:0.0:1789265372.054114:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265372.054116:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5800, rc 0) 00000100:00100000:2.0:1789265372.054346:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+19:12336:x1876180399639936:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 2212us (2526us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789265372.054355:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 180 00000100:00100000:1.0:1789265372.059871:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265372.059993:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399640064 00000100:00100000:3.0:1789265372.060002:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399640064 00000100:00100000:3.0:1789265372.060094:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 14 00000100:00100000:3.0:1789265372.060105:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+19:2393:x1876180399640064:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265372.060119:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265372.060142:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a97258 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc013 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.060179:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:3.0:1789265372.060184:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265372.060244:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+18:2393:x1876180399640064:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 141us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265372.060252:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 14 00000100:00100000:0.0:1789265372.061057:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265372.061113:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399640192 00000100:00100000:3.0:1789265372.061129:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399640192 00000100:00100000:3.0:1789265372.062923:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 181 00000100:00100000:3.0:1789265372.062952:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+18:12336:x1876180399640192:12345-192.168.203.49@tcp:54:lfs.0 00010000:00010000:3.0:1789265372.063070:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97266 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.063092:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97266 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.063106:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97266 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.063153:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97266 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.063160:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97266 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.063167:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97266 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.063174:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265372.063180:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97266 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.063204:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97266 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.063219:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:3.0:1789265372.063222:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265372.063227:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97266 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.063233:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97266 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265372.063343:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+18:12336:x1876180399640192:12345-192.168.203.49@tcp:54:lfs.0 Request processed in 403us (2290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265372.063352:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 181 00000100:00100000:0.0:1789265372.070384:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265372.070494:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399640448 00000100:00100000:1.0:1789265372.070507:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399640448 00000100:00100000:1.0:1789265372.070618:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 47 00000100:00100000:1.0:1789265372.070631:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+18:12336:x1876180399640448:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:1.0:1789265372.070989:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+19:12336:x1876180399640448:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 358us (617us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1789265372.070997:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 47 00000100:00100000:1.0:1789265372.163768:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417525632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265372.163874:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265372.164231:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417525632 00000100:00100000:0.0:1789265372.164241:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417525632 00000100:00100000:0.0:1789265372.164312:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789265372.164324:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1876180417525632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265372.164367:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789265372.164425:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1876180417525632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265372.164445:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789265372.165660:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417525632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265372.166507:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83daa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417526016:0@lo:400:kworker.0 00000100:00100000:2.0:1789265372.166604:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265372.166639:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417526528:0@lo:400:kworker.0 00000100:00100000:2.0:1789265372.166667:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265372.166685:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180417527040:0@lo:400:kworker.0 00000100:00100000:2.0:1789265372.166706:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265372.166750:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789265372.166757:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417525888:0@lo:400:kworker.0 00000100:00100000:2.0:1789265372.166784:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265372.166802:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180417526400:0@lo:400:kworker.0 00000100:00100000:2.0:1789265372.166824:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265372.166841:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91421500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180417526912:0@lo:400:kworker.0 00000100:00100000:2.0:1789265372.166864:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265372.166901:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417526528 00000100:00100000:2.0:1789265372.166909:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417526528 00000100:00100000:2.0:1789265372.166965:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417527040 00000100:00100000:2.0:1789265372.166969:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417527040 00000100:00100000:2.0:1789265372.167001:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417525888 00000100:00100000:2.0:1789265372.167004:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417525888 00000100:00100000:2.0:1789265372.167016:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417526400 00000100:00100000:2.0:1789265372.167018:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417526400 00000100:00100000:2.0:1789265372.167069:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417526912 00000100:00100000:2.0:1789265372.167073:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417526912 00000100:00100000:2.0:1789265372.167115:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789265372.167124:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb849cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417526528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265372.167188:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb849cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417526528:12345-0@lo:400:kworker.0 Request processed in 64us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265372.167196:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789265372.167216:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1789265372.167222:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb849cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180417527040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265372.167252:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb849cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180417527040:12345-0@lo:400:kworker.0 Request processed in 30us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265372.167258:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1789265372.167271:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789265372.167277:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417525888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265372.167306:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417525888:12345-0@lo:400:kworker.0 Request processed in 30us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265372.167313:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789265372.167324:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789265372.167330:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180417526400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265372.167358:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180417526400:12345-0@lo:400:kworker.0 Request processed in 29us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265372.167365:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789265372.167377:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789265372.167383:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180417526912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265372.167410:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180417526912:12345-0@lo:400:kworker.0 Request processed in 28us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265372.167416:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00080000:2.0:1789265372.167461:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265372.167466:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789265372.167502:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417525888:0@lo:400:kworker.0 00000100:00100000:2.0:1789265372.167514:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180417526400:0@lo:400:kworker.0 00000100:00100000:2.0:1789265372.167522:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91421500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180417526912:0@lo:400:kworker.0 00010000:00080000:2.0:1789265372.167536:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc91420e00 x1876180417526528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265372.167547:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417526528:0@lo:400:kworker.0 00010000:00080000:2.0:1789265372.167557:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc91420700 x1876180417527040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265372.167565:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180417527040:0@lo:400:kworker.0 00000100:00100000:1.0:1789265372.168805:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417525760:0@lo:400:kworker.0 00000100:00100000:1.0:1789265372.168894:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265372.168953:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417526272:0@lo:400:kworker.0 00000100:00100000:1.0:1789265372.169000:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265372.169067:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417526784:0@lo:400:kworker.0 00000100:00100000:1.0:1789265372.169099:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265372.169128:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789265372.169136:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417526144:0@lo:400:kworker.0 00000100:00100000:1.0:1789265372.169165:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265372.169186:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417526656:0@lo:400:kworker.0 00000100:00100000:1.0:1789265372.169208:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265372.169245:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417527168:0@lo:400:kworker.0 00000100:00100000:1.0:1789265372.169271:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265372.169311:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417526016 00000100:00100000:1.0:1789265372.169320:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417526016 00000100:00100000:1.0:1789265372.169369:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417526144 00000100:00100000:1.0:1789265372.169372:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417526144 00000100:00100000:1.0:1789265372.169387:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789265372.169396:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb849cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417526016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265372.169465:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb849cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417526016:12345-0@lo:400:kworker.0 Request processed in 69us (2860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265372.169473:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789265372.169492:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789265372.169499:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417526144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265372.169531:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417526144:12345-0@lo:400:kworker.0 Request processed in 33us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265372.169537:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789265372.169596:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417526144:0@lo:400:kworker.0 00000100:00100000:1.0:1789265372.169638:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83daa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417526016:0@lo:400:kworker.0 00000100:00100000:1.0:1789265372.169659:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417526272 00000100:00100000:1.0:1789265372.169663:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417526272 00000100:00100000:1.0:1789265372.169694:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1789265372.169700:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417526272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265372.169746:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417526272:12345-0@lo:400:kworker.0 Request processed in 46us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265372.169753:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1789265372.169779:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417526272:0@lo:400:kworker.0 00000100:00100000:1.0:1789265372.169813:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417526784 00000100:00100000:1.0:1789265372.169817:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417526784 00000100:00080000:1.0:1789265372.169842:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265372.169869:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417526656 00000100:00100000:1.0:1789265372.169873:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417526656 00000100:00100000:1.0:1789265372.169891:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417527168 00000100:00100000:1.0:1789265372.169894:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417527168 00000100:00100000:1.0:1789265372.169909:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789265372.169915:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417526784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265372.169953:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417526784:12345-0@lo:400:kworker.0 Request processed in 38us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265372.169960:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789265372.169970:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789265372.169976:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417526656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265372.169999:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417526656:12345-0@lo:400:kworker.0 Request processed in 24us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265372.170005:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789265372.170014:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789265372.170019:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417527168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265372.170072:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417527168:12345-0@lo:400:kworker.0 Request processed in 52us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265372.170078:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:1.0:1789265372.170090:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265372.170109:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417526656:0@lo:400:kworker.0 00000100:00100000:1.0:1789265372.170120:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417527168:0@lo:400:kworker.0 00000100:00100000:1.0:1789265372.170130:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417526784:0@lo:400:kworker.0 00000100:00100000:2.0:1789265372.171108:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417525760 00000100:00100000:2.0:1789265372.171120:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417525760 00000100:00100000:2.0:1789265372.171184:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1789265372.171194:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417525760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265372.171275:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417525760:12345-0@lo:400:kworker.0 Request processed in 82us (2380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265372.171282:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1789265372.171338:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417525760:0@lo:400:kworker.0 00000100:00100000:1.0:1789265372.263360:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265372.263531:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399640704 00000100:00100000:2.0:1789265372.263545:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399640704 00000100:00100000:2.0:1789265372.263641:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 182 00000100:00100000:2.0:1789265372.263654:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+19:12354:x1876180399640704:12345-192.168.203.49@tcp:101:cat.0 00010000:00010000:2.0:1789265372.263687:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265372.263741:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a9726d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc01a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.263887:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ea00/0x9272d942b4a97274 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.263906:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ea00/0x9272d942b4a97274 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.263922:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ea00/0x9272d942b4a97274 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265372.263935:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789265372.264544:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a9726d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc01a expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.264569:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ea00/0x9272d942b4a97274 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc01a expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.264592:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:2.0:1789265372.264596:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789265372.264600:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2ea00, rc 0) 00000100:00100000:2.0:1789265372.264735:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+21:12354:x1876180399640704:12345-192.168.203.49@tcp:101:cat.0 Request processed in 1083us (1388us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1789265372.264744:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 182 00000100:00100000:2.0:1789265372.292181:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265372.292983:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399640832 00000100:00100000:3.0:1789265372.292998:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399640832 00000100:00100000:3.0:1789265372.293113:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 183 00000100:00100000:3.0:1789265372.293126:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+21:12355:x1876180399640832:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1789265372.293158:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265372.293186:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97282 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc021 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.293272:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a97289 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.293290:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a97289 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.293302:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a97289 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265372.293371:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789265372.293375:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265372.293396:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a97289 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.293426:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97282 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc021 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.293447:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a97289 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc021 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265372.293456:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:3.0:1789265372.293460:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265372.293463:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81491600, rc 0) 00000100:00100000:3.0:1789265372.293547:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+22:12355:x1876180399640832:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 423us (1381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265372.293554:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 183 00000100:00100000:0.0:1789265372.302545:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265372.303219:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399641216 00000100:00100000:3.0:1789265372.303234:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399641216 00000100:00100000:2.0:1789265372.303495:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 48 00000100:00100000:2.0:1789265372.303507:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+22:12355:x1876180399641216:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:2.0:1789265372.303951:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+23:12355:x1876180399641216:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 444us (1415us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1789265372.303978:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 48 00000100:00100000:0.0:1789265372.310960:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265372.311084:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399641344 00000100:00100000:2.0:1789265372.311100:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399641344 00000100:00100000:2.0:1789265372.311196:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 15 00000100:00100000:2.0:1789265372.311209:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+23:12355:x1876180399641344:12345-192.168.203.49@tcp:103:lfs.0 00010000:00010000:2.0:1789265372.311231:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789265372.311290:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a97212 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc005 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.311326:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ea00/0x9272d942b4a97274 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc01a expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.311341:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a9710f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfbf expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.311354:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:2.0:1789265372.311360:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265372.311447:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+20:12355:x1876180399641344:12345-192.168.203.49@tcp:103:lfs.0 Request processed in 240us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265372.311457:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 15 00000100:00100000:3.0:1789265372.314776:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265372.314949:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399641472 00000100:00100000:1.0:1789265372.314962:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399641472 00000100:00100000:1.0:1789265372.315130:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 184 00000100:00100000:1.0:1789265372.315144:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+20:12355:x1876180399641472:12345-192.168.203.49@tcp:58:lfs.0 00010000:00010000:1.0:1789265372.315420:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a97290 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265372.315441:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a97290 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265372.315456:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a97290 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265372.315751:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1789265372.316260:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+20:12355:x1876180399641472:12345-192.168.203.49@tcp:58:lfs.0 Request processed in 1115us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265372.316274:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 184 00000100:00100000:0.0:1789265372.330978:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265372.331884:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399641600 00000100:00100000:2.0:1789265372.331899:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399641600 00000100:00100000:2.0:1789265372.331977:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 185 00000100:00100000:2.0:1789265372.331989:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+20:12357:x1876180399641600:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1789265372.332016:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265372.332217:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ea00/0x9272d942b4a97297 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc028 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332317:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a9729e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332334:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a9729e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332348:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a9729e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332363:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a972a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332369:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a972a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332376:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a972a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332459:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a972ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332467:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a972ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332474:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a972ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265372.332591:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789265372.332597:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265372.332619:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a972ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332643:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a972ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332652:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a9729e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332658:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a9729e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332665:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a9729e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332670:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2ee00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265372.332675:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a9729e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332681:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a9729e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332694:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:2.0:1789265372.332697:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265372.332701:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a9729e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332708:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a9729e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332733:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a972a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332739:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a972a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332750:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a972a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332755:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265372.332758:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a972a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332764:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a972a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332772:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fcb83b86a00) 00010000:00010000:2.0:1789265372.332775:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265372.332778:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a972a5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332784:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a972a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332819:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ea00/0x9272d942b4a97297 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc028 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332831:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a972ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc028 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265372.332839:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:2.0:1789265372.332842:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265372.332844:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2ec00, rc 0) 00000100:00100000:2.0:1789265372.333000:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+21:12357:x1876180399641600:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 1012us (2035us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265372.333017:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 185 00010000:00010000:2.0:1789265372.486854:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789265373.121328:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789265373.121338:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789265373.121392:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789265373.121402:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789265373.121543:0:13799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd336a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1876180417527296:192.168.203.49@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789265373.121649:0:13799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c48840 going to sleep for 11 seconds 00000100:00100000:3.0:1789265373.130317:0:13799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd336a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1876180417527296:192.168.203.49@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789265373.139174:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265373.139318:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399641728 00000100:00100000:2.0:1789265373.139329:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399641728 00000100:00100000:2.0:1789265373.139404:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 186 00000100:00100000:2.0:1789265373.139415:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+21:12368:x1876180399641728:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789265373.139451:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789265373.139574:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+21:12368:x1876180399641728:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 Request processed in 161us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265373.139582:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 186 00000100:00080000:1.0:1789265373.141692:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265373.151116:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265373.151352:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399641856 00000100:00100000:1.0:1789265373.151363:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399641856 00000100:00100000:1.0:1789265373.151424:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 187 00000100:00100000:1.0:1789265373.151434:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+21:12368:x1876180399641856:12345-192.168.203.49@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789265373.151526:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a972b3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151545:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a972b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151559:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a972b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151592:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a972ba lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151600:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a972ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151606:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a972ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151637:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a972c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151646:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a972c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151652:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a972c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265373.151719:0:8460:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789265373.151723:0:8460:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789265373.151737:0:8460:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a972c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151748:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a972b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151754:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a972b3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151761:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a972b3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151777:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265373.151781:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a972b3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151789:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a972b3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151801:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fccbd2b4c00) 00010000:00010000:1.0:1789265373.151804:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265373.151809:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a972b3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151815:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a972b3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151828:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a972ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151834:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a972ba lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151840:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a972ba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151846:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265373.151848:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a972ba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151854:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a972ba lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151872:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9fccacd4e500) 00010000:00010000:1.0:1789265373.151875:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265373.151878:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a972ba lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151884:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a972ba lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151898:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a972c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151904:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a972c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151910:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a972c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151915:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ffe00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265373.151918:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a972c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151924:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a972c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151932:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:1.0:1789265373.151934:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265373.151937:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a972c1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.151942:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a972c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265373.152314:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+21:12368:x1876180399641856:12345-192.168.203.49@tcp:34:lhsmtool_posix.0 Request processed in 879us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265373.152323:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 187 00000100:00100000:0.0:1789265373.160465:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265373.160562:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399642112 00000100:00100000:2.0:1789265373.160573:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399642112 00000100:00100000:2.0:1789265373.160639:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 188 00000100:00100000:2.0:1789265373.160650:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+21:12368:x1876180399642112:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265373.160681:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265373.160715:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a972c8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc02f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.160829:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a972cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.160843:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a972cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.160854:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a972cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265373.160864:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789265373.160959:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a972cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.160966:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a972cf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.160972:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a972cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.160978:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2ee00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265373.160982:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a972cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.160989:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a972cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.161002:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:2.0:1789265373.161005:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265373.161010:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a972cf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.161016:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a972cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.161325:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a972c8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc02f expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.161336:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fccbd2b4c00) 00010000:00010000:2.0:1789265373.161338:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265373.161342:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a972c8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc02f expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.161361:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2e600, rc 0) 00000100:00100000:2.0:1789265373.161422:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+22:12368:x1876180399642112:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 773us (967us total) trans 4294967459 rc 301/301 00000100:00100000:2.0:1789265373.161430:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 188 00000100:00100000:0.0:1789265373.164610:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265373.165198:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399642240 00000100:00100000:2.0:1789265373.165208:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399642240 00000100:00100000:2.0:1789265373.165282:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 189 00000100:00100000:2.0:1789265373.165293:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+22:12368:x1876180399642240:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789265373.165330:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789265373.165597:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+22:12368:x1876180399642240:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 Request processed in 305us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265373.165605:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 189 00000100:00100000:1.0:1789265373.187986:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265373.188225:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399642496 00000100:00100000:3.0:1789265373.188236:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399642496 00000100:00100000:3.0:1789265373.188300:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 190 00000100:00100000:3.0:1789265373.188309:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+22:12368:x1876180399642496:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265373.188328:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265373.188331:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789265373.188357:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a97289 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc021 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.188375:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:3.0:1789265373.188380:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265373.188393:0:8460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a972dd lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc036 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789265373.188760:0:8460:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1789265373.188903:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a972e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.188916:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a972e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.188926:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a972e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.188978:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a972dd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc036 expref: 24 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.188993:0:8460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a972e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc036 expref: 23 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.189011:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fcca9674400) 00010000:00010000:3.0:1789265373.189014:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265373.189016:0:8460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81491000, rc 0) 00000100:00100000:3.0:1789265373.189098:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+23:12368:x1876180399642496:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 789us (1121us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1789265373.189105:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 190 00000100:00100000:0.0:1789265373.206334:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265373.206375:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399642752 00000100:00100000:0.0:1789265373.206386:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399642752 00000100:00100000:0.0:1789265373.206445:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 191 00000100:00100000:0.0:1789265373.206456:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+23:12368:x1876180399642752:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789265373.206514:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265373.206541:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a972e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc036 expref: 23 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.206561:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fcca9674400) 00010000:00010000:0.0:1789265373.206571:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265373.206594:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a972f2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.206607:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a972f2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.206620:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a972f2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.206635:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a972f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x7de6fd0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.206649:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a972f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x7de6fd0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.206657:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a972f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x7de6fd0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.206821:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a972f2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.206830:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a972f2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.206837:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a972f2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.206843:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265373.206847:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a972f2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.206855:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a972f2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.206864:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:0.0:1789265373.206868:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265373.206871:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a972f2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.206878:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a972f2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.206888:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a972f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x7de6fd0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.206901:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a972f9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7de6fd0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.206907:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a972f9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7de6fd0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.206912:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265373.206915:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a972f9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7de6fd0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.206920:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a972f9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7de6fd0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.206927:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x7de6fd0d (ffff9fcca9673100) 00010000:00010000:0.0:1789265373.206929:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265373.206931:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a972f9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x7de6fd0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.206936:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a972f9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x7de6fd0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265373.207020:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+22:12368:x1876180399642752:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 Request processed in 565us (696us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789265373.207144:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 191 00000100:00100000:3.0:1789265373.213278:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265373.213349:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399642880 00000100:00100000:2.0:1789265373.213361:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399642880 00000100:00100000:2.0:1789265373.213420:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 192 00000100:00100000:2.0:1789265373.213431:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+22:12368:x1876180399642880:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265373.213452:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265373.213475:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97300 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc03d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.213509:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a97307 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.213523:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a97307 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.213614:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a97307 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.213740:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97300 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc03d expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.213758:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a97307 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc03d expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.213767:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fcb83b86300) 00010000:00010000:2.0:1789265373.213770:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789265373.213774:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2ee00, rc 0) 00000100:00100000:2.0:1789265373.213941:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+23:12368:x1876180399642880:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 510us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265373.213948:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 192 00000100:00100000:1.0:1789265373.217302:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265373.217405:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399643136 00000100:00100000:3.0:1789265373.217415:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399643136 00000100:00100000:3.0:1789265373.217479:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 193 00000100:00100000:3.0:1789265373.217491:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+23:12368:x1876180399643136:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789265373.217589:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a9730e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.217605:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a9730e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.217617:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a9730e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265373.217929:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1789265373.217941:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 424447917566ns, next at 425447914652ns, rc = 0 00000004:00010000:3.0:1789265373.217991:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3a4c732 reply state 00000000a665c5f8 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a9730e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.218005:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a9730e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.218194:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fcb83b86300) 00010000:00010000:3.0:1789265373.218198:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789265373.218202:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265373.218366:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+25:12368:x1876180399643136:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 Request processed in 876us (1069us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1789265373.218375:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 193 00000100:00100000:1.0:1789265373.230564:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265373.231353:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399643264 00000100:00100000:0.0:1789265373.231365:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399643264 00000100:00100000:0.0:1789265373.231422:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 194 00000100:00100000:0.0:1789265373.231433:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+25:12368:x1876180399643264:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265373.231454:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265373.231481:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a97315 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc044 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.231613:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a97315 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc044 expref: 26 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.231629:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a97315 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc044 expref: 26 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.231649:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fcb83b86300) 00010000:00010000:0.0:1789265373.231652:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265373.231656:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5800, rc 0) 00000100:00100000:0.0:1789265373.232375:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+26:12368:x1876180399643264:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 277us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265373.232384:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 194 00000100:00100000:1.0:1789265373.237137:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265373.237184:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399643392 00000100:00100000:3.0:1789265373.237195:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399643392 00000100:00100000:3.0:1789265373.237279:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 59 00000100:00100000:3.0:1789265373.237290:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+6:2393:x1876180399643392:12345-192.168.203.49@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789265373.237515:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+7:2393:x1876180399643392:12345-192.168.203.49@tcp:2:lhsmtool_posix.0 Request processed in 226us (385us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789265373.237524:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 59 00000100:00080000:1.0:1789265373.237639:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265373.245348:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265373.245477:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399643648 00000100:00100000:2.0:1789265373.245487:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399643648 00000100:00100000:2.0:1789265373.245559:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 49 00000100:00100000:2.0:1789265373.245570:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+26:12368:x1876180399643648:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789265373.245989:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+27:12368:x1876180399643648:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 Request processed in 419us (649us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1789265373.245997:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 49 00000100:00100000:0.0:1789265373.249067:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265373.249150:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399643904 00000100:00100000:2.0:1789265373.249160:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399643904 00000100:00100000:2.0:1789265373.249221:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 195 00000100:00100000:2.0:1789265373.249230:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+27:12368:x1876180399643904:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789265373.249353:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+27:12368:x1876180399643904:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 Request processed in 124us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265373.249361:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 195 00000100:00100000:3.0:1789265373.253281:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265373.253386:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399644032 00000100:00100000:0.0:1789265373.253396:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399644032 00000100:00100000:0.0:1789265373.253453:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 196 00000100:00100000:0.0:1789265373.253464:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+27:12368:x1876180399644032:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265373.253487:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265373.253508:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a9731c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc04b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.253593:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a97323 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.253609:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a97323 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.253630:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a97323 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265373.253677:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265373.253697:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a97323 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.253740:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a9731c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc04b expref: 29 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.253757:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a97323 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc04b expref: 28 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.253766:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fcb83b86300) 00010000:00010000:0.0:1789265373.253769:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789265373.253772:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5200, rc 0) 00000100:00100000:0.0:1789265373.253829:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+28:12368:x1876180399644032:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 367us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265373.253836:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 196 00000100:00100000:3.0:1789265373.259365:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265373.264841:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399644160 00000100:00100000:2.0:1789265373.264854:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399644160 00000100:00100000:2.0:1789265373.264922:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 60 00000100:00100000:2.0:1789265373.264934:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd335180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+7:2396:x1876180399644160:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265373.264952:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265373.264977:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a9732a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc052 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265373.265003:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa605dd, blocks: 0x0 00010000:00010000:2.0:1789265373.265123:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=424s v=(0 0) 00010000:00010000:2.0:1789265373.265129:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265373.265139:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a9732a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc052 expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.265162:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a9732a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc052 expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.265176:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2e600, rc 0) 00000100:00100000:2.0:1789265373.265290:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd335180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+8:2396:x1876180399644160:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 358us (5934us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265373.265298:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 60 00000100:00100000:0.0:1789265373.276132:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265373.276638:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399644416 00000100:00100000:3.0:1789265373.276648:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399644416 00000100:00100000:3.0:1789265373.276724:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 197 00000100:00100000:3.0:1789265373.276734:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+28:12368:x1876180399644416:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789265373.276838:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+28:12368:x1876180399644416:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 Request processed in 105us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265373.276847:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 197 00000100:00100000:3.0:1789265373.287117:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265373.287153:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399644544 00000100:00100000:3.0:1789265373.287161:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399644544 00000100:00100000:3.0:1789265373.287221:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 61 00000100:00100000:3.0:1789265373.287232:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+8:12368:x1876180399644544:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265373.288065:0:8914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265373.288089:0:8914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053508460/0x9272d942b4a97331 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc059 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.288125:0:8914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a9732a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc052 expref: 9 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.288135:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265373.288140:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265373.288145:0:8914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053508460/0x9272d942b4a97331 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc059 expref: 9 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.288182:0:8914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a9732a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc052 expref: 9 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.288199:0:8914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a9732a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc052 expref: 9 pid: 8434 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265373.288212:0:8914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83eff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8914:1876180417527424:192.168.203.49@tcp:104: 00000100:00100000:3.0:1789265373.290236:0:8914:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c48f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265373.297657:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265373.297734:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399644672 00000100:00100000:1.0:1789265373.297744:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399644672 00010000:00010000:1.0:1789265373.297786:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a9732a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc052 expref: 10 pid: 8434 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265373.297832:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 88 00000100:00100000:1.0:1789265373.297841:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83e38850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+10:2395:x1876180399644672:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265373.297857:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265373.297878:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a9732a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc052 expref: 10 pid: 8434 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.297891:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a9732a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc052 expref: 10 pid: 8434 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.297923:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265373.297928:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265373.297947:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000053508460/0x9272d942b4a97331 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc059 expref: 10 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.297957:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053508460/0x9272d942b4a97331 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc059 expref: 10 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.298007:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000053508460/0x9272d942b4a97331 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc059 expref: 10 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265373.298045:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb838f6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6501:1876180417527552:192.168.203.49@tcp:105: 00000100:00100000:1.0:1789265373.298119:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcca9528600 going to sleep for 11 seconds 00010000:00010000:3.0:1789265373.300574:0:8914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a9732a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc052 expref: 10 pid: 8434 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265373.300610:0:8914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83eff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8914:1876180417527424:192.168.203.49@tcp:104: 00010000:00010000:3.0:1789265373.300657:0:8914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000053508460/0x9272d942b4a97331 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc059 expref: 9 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.300674:0:8914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81491600, rc 0) 00000100:00100000:3.0:1789265373.300747:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+9:12368:x1876180399644544:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 13517us (13637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265373.300757:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 61 00000100:00100000:3.0:1789265373.303766:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb838f6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6501:1876180417527552:192.168.203.49@tcp:105: 00010000:00010000:3.0:1789265373.303796:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265373.303874:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83e38850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+8:2395:x1876180399644672:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 6033us (6336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265373.303884:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 88 00000100:00100000:0.0:1789265373.304975:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265373.305810:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399644800 00000100:00100000:3.0:1789265373.305821:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399644800 00002000:00100000:3.0:1789265373.305869:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9fcb82868a80 x1876180399644800/t0(0) o4->5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp:699/0 lens 504/0 e 0 to 0 dl 1789265384 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265373.305879:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fcb82868a80 with x1876180399644800 ext(0->8) 00002000:00010000:3.0:1789265373.305885:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fcb82868a80 00000100:00100000:3.0:1789265373.305914:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 4 00000100:00100000:3.0:1789265373.305924:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5b43750b-84cf-4d62-9028-e016267b6509+8:2394:x1876180399644800:12345-192.168.203.49@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789265373.308885:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5b43750b-84cf-4d62-9028-e016267b6509+10:2394:x1876180399644800:12345-192.168.203.49@tcp:4:lhsmtool_posix.0 Request processed in 2951us (3916us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789265373.308904:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 4 00002000:00100000:0.0:1789265373.308916:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9fcb82868a80 x1876180399644800/t4294967315(0) o4->5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp:699/0 lens 504/448 e 0 to 0 dl 1789265384 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789265373.308940:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fcb82868a80 with x1876180399644800 ext(0->8) 00002000:00010000:0.0:1789265373.308946:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fcb82868a80 00000100:00100000:3.0:1789265373.316463:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265373.316501:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399644928 00000100:00100000:3.0:1789265373.316510:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399644928 00000100:00100000:2.0:1789265373.318823:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 198 00000100:00100000:2.0:1789265373.318850:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+28:12368:x1876180399644928:12345-192.168.203.49@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789265373.321238:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:0.0:1789265373.321264:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1789265373.321295:0:6495:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:0.0:1789265373.321394:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1789265373.321404:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1789265373.321526:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+20:12368:x1876180399644928:12345-192.168.203.49@tcp:44:lhsmtool_posix.0 Request processed in 2678us (5067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265373.321546:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 198 00010000:00010000:3.0:1789265373.321827:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a9730e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.321853:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a9730e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.321861:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a9730e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.321867:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265373.321871:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a9730e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.321878:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a9730e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.321896:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fcb83b86300) 00010000:00010000:3.0:1789265373.321899:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789265373.321903:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a9730e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.321909:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a9730e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265373.326739:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417527680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789265373.326829:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265373.326976:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417527680 00000100:00100000:1.0:1789265373.326985:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417527680 00000100:00100000:1.0:1789265373.327066:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789265373.327075:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417527680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789265373.327225:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789265373.327229:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789265374 00002000:00010000:1.0:1789265373.327231:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789265373.327233:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789265373 -> 1789265374 00002000:00010000:1.0:1789265373.327236:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1789265373.327518:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180417527680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 443us (689us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789265373.327526:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:0.0:1789265373.327887:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fcb8286b480/2, rc 0, transno 4294967316 00000100:00100000:0.0:1789265373.327894:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417527680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789265373.328410:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265373.328634:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399645056 00000100:00100000:3.0:1789265373.328642:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399645056 00000100:00100000:3.0:1789265373.328691:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 63 00000100:00100000:3.0:1789265373.328700:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+10:2395:x1876180399645056:12345-192.168.203.49@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789265373.341079:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:2.0:1789265373.341095:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1789265373.342014:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+7:2395:x1876180399645056:12345-192.168.203.49@tcp:16:lhsmtool_posix.0 Request processed in 13306us (13598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265373.342066:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 63 00000040:00080000:0.0:1789265373.344581:0:14656:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265373.344590:0:14656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265373.344615:0:14656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789265373.345090:0:14656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789265373.355765:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265373.355834:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399645312 00000100:00100000:3.0:1789265373.355853:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399645312 00000100:00100000:3.0:1789265373.355937:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 199 00000100:00100000:3.0:1789265373.355947:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+19:12368:x1876180399645312:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789265373.356386:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265373.356414:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a97323 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc04b expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.356433:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fcb83b86300) 00010000:00010000:0.0:1789265373.356438:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265373.356488:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a97338 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.356501:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a97338 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.356512:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a97338 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789265373.356645:0:8460:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099589212 reply state 0000000050268a0b transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a97338 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.356657:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a97338 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.356664:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fcb83b86300) 00010000:00010000:0.0:1789265373.356667:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789265373.356669:0:8460:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789265373.356878:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+20:12368:x1876180399645312:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 Request processed in 932us (1122us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1789265373.356887:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 199 00000100:00100000:2.0:1789265373.366764:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265373.366958:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399645440 00000100:00100000:1.0:1789265373.366979:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399645440 00000100:00100000:1.0:1789265373.367054:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 64 00000100:00100000:1.0:1789265373.367065:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+7:2396:x1876180399645440:12345-192.168.203.49@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789265373.367226:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789265373.367230:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789265374 -> 1789265372 00002000:00010000:1.0:1789265373.367232:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789265370 00002000:00010000:1.0:1789265373.367234:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789265374 -> 1789265372 00002000:00010000:1.0:1789265373.367236:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789265373.367528:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+8:2396:x1876180399645440:12345-192.168.203.49@tcp:2:lhsmtool_posix.0 Request processed in 464us (772us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789265373.367537:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 64 00000100:00100000:2.0:1789265373.391881:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265373.397357:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399645696 00000100:00100000:0.0:1789265373.397372:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399645696 00000100:00100000:0.0:1789265373.397435:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 200 00000100:00100000:0.0:1789265373.397446:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+20:12368:x1876180399645696:12345-192.168.203.49@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789265373.397525:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9733f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.397542:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a97307 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc03d expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.397570:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9733f lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.397610:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a97307 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc03d expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.397622:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a97307 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc03d expref: 20 pid: 6516 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265373.397637:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876180417527808:192.168.203.49@tcp:104: 00000100:00100000:0.0:1789265373.397743:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c27780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265373.405085:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876180417527808:192.168.203.49@tcp:104: 00010000:00010000:0.0:1789265373.405117:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9733f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265373.414342:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265373.414570:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399645824 00000100:00100000:3.0:1789265373.414581:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399645824 00010000:00010000:3.0:1789265373.414625:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a97307 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc03d expref: 21 pid: 6516 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265373.414678:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 89 00000100:00100000:3.0:1789265373.414688:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91420700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+21:2395:x1876180399645824:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265373.414702:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265373.414721:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a97307 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc03d expref: 21 pid: 6516 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.414734:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a97307 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc03d expref: 21 pid: 6516 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.414756:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a97307 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc03d expref: 21 pid: 6516 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.414769:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fcb83b86300) 00010000:00010000:3.0:1789265373.414775:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9733f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.414784:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9733f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.414792:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9733f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.414831:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265373.414886:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91420700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+20:2395:x1876180399645824:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 199us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265373.414894:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 89 00010000:00010000:3.0:1789265373.415007:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9733f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.415015:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9733f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.415073:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9733f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.415080:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9733f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.415087:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9733f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.415093:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265373.415097:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9733f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.415160:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9733f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.415173:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fcb83b86300) 00010000:00010000:3.0:1789265373.415176:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789265373.415180:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9733f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.415198:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9733f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265373.415255:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+19:12368:x1876180399645696:12345-192.168.203.49@tcp:55:lhsmtool_posix.0 Request processed in 17810us (23380us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789265373.415264:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 200 00000100:00100000:2.0:1789265373.425407:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265373.425486:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399645952 00000100:00100000:0.0:1789265373.425496:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399645952 00000100:00100000:0.0:1789265373.425555:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 65 00000100:00100000:0.0:1789265373.425564:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+8:2394:x1876180399645952:12345-192.168.203.49@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789265373.425619:0:8914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007c082110/0x9272d942b4a97346 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.425641:0:8914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000053508460/0x9272d942b4a97331 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc059 expref: 8 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.425650:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265373.425664:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265373.425669:0:8914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c082110/0x9272d942b4a97346 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.425715:0:8914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000053508460/0x9272d942b4a97331 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc059 expref: 8 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.425729:0:8914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000053508460/0x9272d942b4a97331 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc059 expref: 8 pid: 8914 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265373.425743:0:8914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8914:1876180417527936:192.168.203.49@tcp:104: 00000100:00100000:0.0:1789265373.425836:0:8914:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c27780 going to sleep for 11 seconds 00000100:00100000:1.0:1789265373.434754:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265373.434822:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399646080 00000100:00100000:2.0:1789265373.434834:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399646080 00010000:00010000:2.0:1789265373.434873:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000053508460/0x9272d942b4a97331 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc059 expref: 9 pid: 8914 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265373.434912:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 90 00000100:00100000:2.0:1789265373.434920:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+9:2396:x1876180399646080:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265373.434933:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265373.434953:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000053508460/0x9272d942b4a97331 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc059 expref: 9 pid: 8914 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.434972:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000053508460/0x9272d942b4a97331 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc059 expref: 9 pid: 8914 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.434997:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265373.435001:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265373.435006:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007c082110/0x9272d942b4a97346 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.435052:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c082110/0x9272d942b4a97346 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.435074:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265373.435125:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+9:2396:x1876180399646080:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 205us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265373.435135:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 90 00010000:00010000:3.0:1789265373.435588:0:8914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053508460/0x9272d942b4a97331 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc059 expref: 8 pid: 8914 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265373.435606:0:8914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8914:1876180417527936:192.168.203.49@tcp:104: 00010000:00010000:3.0:1789265373.435627:0:8914:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007c082110/0x9272d942b4a97346 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.435637:0:8914:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007c082110/0x9272d942b4a97346 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.435644:0:8914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c082110/0x9272d942b4a97346 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.435665:0:8914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007c082110/0x9272d942b4a97346 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.435673:0:8914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c082110/0x9272d942b4a97346 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.435696:0:8914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c082110/0x9272d942b4a97346 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.435713:0:8914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4400 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265373.435718:0:8914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c082110/0x9272d942b4a97346 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.435726:0:8914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c082110/0x9272d942b4a97346 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.435740:0:8914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c082110/0x9272d942b4a97346 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.435748:0:8914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c082110/0x9272d942b4a97346 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265373.435813:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+7:2394:x1876180399645952:12345-192.168.203.49@tcp:1:lhsmtool_posix.0 Request processed in 10250us (10415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265373.435821:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 65 00000100:00100000:1.0:1789265373.440392:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265373.440481:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399646336 00000100:00100000:2.0:1789265373.440491:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399646336 00000100:00100000:2.0:1789265373.440825:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 201 00000100:00100000:2.0:1789265373.440837:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+19:12368:x1876180399646336:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789265373.440913:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a9734d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.440929:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a97194 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfe2 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.440939:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a9734d lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.440972:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a97194 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfe2 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.440985:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a97194 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfe2 expref: 19 pid: 6516 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265373.440998:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91421500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876180417528064:192.168.203.49@tcp:104: 00000100:00100000:2.0:1789265373.441244:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0a7d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265373.444829:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91421500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876180417528064:192.168.203.49@tcp:104: 00010000:00010000:0.0:1789265373.444861:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a9734d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265373.445925:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265373.446179:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399646464 00000100:00100000:3.0:1789265373.446188:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399646464 00010000:00010000:3.0:1789265373.446221:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a97194 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfe2 expref: 20 pid: 6516 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265373.446266:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 91 00000100:00100000:3.0:1789265373.446282:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+20:2396:x1876180399646464:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265373.446295:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265373.446303:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a97194 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfe2 expref: 20 pid: 6516 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.446315:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a97194 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfe2 expref: 20 pid: 6516 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.446336:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a800/0x9272d942b4a97194 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbfe2 expref: 20 pid: 6516 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.446351:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:3.0:1789265373.446356:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a9734d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.446366:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a9734d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.446374:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a9734d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.446400:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265373.446452:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+19:2396:x1876180399646464:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 171us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265373.446460:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 91 00010000:00010000:1.0:1789265373.446956:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a9734d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.446966:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a9734d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.447159:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97354 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.447171:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a97315 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc044 expref: 19 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.447178:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97354 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.447210:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a97315 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc044 expref: 19 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.447234:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a97315 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc044 expref: 19 pid: 8459 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265373.447259:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e99c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876180417528192:192.168.203.49@tcp:104: 00000100:00100000:1.0:1789265373.447329:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcca9528600 going to sleep for 11 seconds 00000100:00100000:0.0:1789265373.450787:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e99c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876180417528192:192.168.203.49@tcp:104: 00010000:00010000:0.0:1789265373.450819:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97354 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265373.453060:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265373.453126:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399646592 00000100:00100000:0.0:1789265373.453136:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399646592 00010000:00010000:0.0:1789265373.453244:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a97315 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc044 expref: 20 pid: 8459 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265373.453288:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 92 00000100:00100000:0.0:1789265373.453297:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83effb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+20:2395:x1876180399646592:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265373.453323:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265373.453331:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a97315 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc044 expref: 20 pid: 8459 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.453344:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a97315 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc044 expref: 20 pid: 8459 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.453368:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a97315 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc044 expref: 20 pid: 8459 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.453383:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fcb83b86300) 00010000:00010000:0.0:1789265373.453388:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97354 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.453399:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97354 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.453406:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97354 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.453440:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265373.453496:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83effb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+19:2395:x1876180399646592:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 200us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265373.453504:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 92 00010000:00010000:3.0:1789265373.453563:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97354 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.453591:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97354 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789265373.453720:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1789265373.453841:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1789265373.453877:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1789265373.453958:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6517:1876180417528320:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789265373.454019:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265373.454064:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cb4300 going to sleep for 11 seconds 00000100:00100000:1.0:1789265373.454087:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417528320 00000100:00100000:1.0:1789265373.454093:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417528320 00000100:00100000:1.0:1789265373.454136:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789265373.454145:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6517:x1876180417528320:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789265373.454347:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6517:x1876180417528320:12345-0@lo:1000:mdt00_001.0 Request processed in 203us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265373.454354:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789265373.454393:0:6517:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1789265373.454401:0:6517:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fcb8286b480, transno 4294967316 00000100:00100000:3.0:1789265373.454423:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6517:1876180417528320:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789265373.454531:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1789265373.454569:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6517:1876180417528448:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789265373.454596:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265373.454620:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c48a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265373.454787:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417528448 00000100:00100000:1.0:1789265373.454793:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417528448 00000100:00100000:1.0:1789265373.454828:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789265373.454835:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6517:x1876180417528448:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789265373.454922:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6517:x1876180417528448:12345-0@lo:1000:mdt00_001.0 Request processed in 88us (325us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789265373.454928:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789265373.455377:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6517:1876180417528448:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789265373.455412:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97354 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.455421:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97354 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.455427:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97354 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.455432:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265373.455437:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97354 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.455449:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97354 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.455463:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fcb83b86300) 00010000:00010000:3.0:1789265373.455466:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789265373.455470:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97354 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.455476:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97354 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.455498:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a97290 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.455503:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a97290 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.455509:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a97290 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.455514:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fe000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265373.455517:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a97290 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.455523:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a97290 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.455530:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:3.0:1789265373.455532:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789265373.455534:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a97290 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.455550:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a97290 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.455572:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a9735b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.455597:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a972ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc028 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.455605:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a9735b lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.455632:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a972ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc028 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.455647:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a972ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc028 expref: 22 pid: 6517 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265373.455658:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876180417528576:192.168.203.49@tcp:104: 00000100:00100000:3.0:1789265373.455740:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c48a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265373.461931:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1876180417528576:192.168.203.49@tcp:104: 00010000:00010000:0.0:1789265373.461959:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a9735b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265373.462675:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265373.462779:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399646720 00000100:00100000:2.0:1789265373.462786:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399646720 00010000:00010000:2.0:1789265373.462819:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a972ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc028 expref: 23 pid: 6517 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265373.462857:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 93 00000100:00100000:2.0:1789265373.462866:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+23:2393:x1876180399646720:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265373.462879:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265373.462885:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a972ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc028 expref: 23 pid: 6517 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.462895:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a972ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc028 expref: 23 pid: 6517 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.463400:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a972ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc028 expref: 23 pid: 6517 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.463416:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:2.0:1789265373.463421:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a9735b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.463430:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a9735b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.463436:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a9735b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265373.463466:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265373.463480:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a9735b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.463487:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a9735b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.463498:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a9735b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.463512:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a9735b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.463518:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a9735b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265373.463522:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+22:2393:x1876180399646720:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 657us (849us total) trans 0 rc 0/0 00010000:00010000:3.0:1789265373.463525:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81491600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265373.463529:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a9735b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265373.463530:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 93 00010000:00010000:3.0:1789265373.463536:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a9735b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.463545:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:3.0:1789265373.463548:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265373.463551:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a9735b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.463556:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a9735b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.463568:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a9734d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.463574:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a9734d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.463589:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a9734d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.463594:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2fe00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265373.463603:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a9734d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.463608:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a9734d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.463616:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9673800) 00010000:00010000:3.0:1789265373.463618:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789265373.463620:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a9734d lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265373.463626:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a9734d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265373.463767:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+21:12368:x1876180399646336:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 Request processed in 22932us (23384us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1789265373.463776:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 201 00000020:00080000:3.0:1789265373.463780:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789265373.463929:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265373.463934:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265373.465336:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1789265373.465352:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789265373.466129:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265373.466687:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399646976 00000100:00100000:1.0:1789265373.466698:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399646976 00000100:00100000:1.0:1789265373.466837:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 50 00000100:00100000:1.0:1789265373.466848:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdc8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+21:12368:x1876180399646976:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789265373.467130:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789265373.467173:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:1.0:1789265373.467206:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97362 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.467222:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97362 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.467235:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97362 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.467244:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97362 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.467261:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97362 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.467267:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97362 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265373.467286:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789265373.467373:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdc8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+23:12368:x1876180399646976:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 Request processed in 526us (1250us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1789265373.467381:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 50 00000020:00080000:1.0:1789265373.467386:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789265373.467466:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265373.467478:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97362 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.467484:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ffe00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265373.467488:0:7473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97362 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.467496:0:7473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97362 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.467509:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fcb83b86300) 00010000:00010000:0.0:1789265373.467512:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789265373.467518:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97362 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.467523:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97362 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265373.467535:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265373.467536:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265373.467538:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265373.505374:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265374.529189:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265374.721437:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417528832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265374.721511:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265374.721576:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265374.721583:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91421500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417528704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265374.721613:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265374.724498:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417528832 00000100:00100000:1.0:1789265374.724513:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417528832 00000100:00100000:1.0:1789265374.724623:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417528704 00000100:00100000:1.0:1789265374.724627:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417528704 00000100:00100000:3.0:1789265374.727853:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789265374.727878:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417528832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789265374.727923:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789265374.729509:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417528832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1636us (7990us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265374.729542:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789265374.729579:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789265374.729589:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417528704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265374.729619:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789265374.729669:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417528704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (8056us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265374.729675:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789265374.731179:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417528832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265374.731213:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91421500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417528704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265375.234159:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265375.234181:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417528960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265375.234249:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265375.234312:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417528960 00000100:00100000:3.0:1789265375.234320:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417528960 00000100:00100000:3.0:1789265375.234376:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789265375.234385:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417528960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789265375.234415:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789265375.234459:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417528960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265375.234466:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1789265375.234486:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265375.234536:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417528960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265375.236920:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265375.236945:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417529088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265375.237012:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265375.237243:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417529088 00000100:00100000:3.0:1789265375.237251:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417529088 00000100:00100000:3.0:1789265375.237310:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789265375.237319:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1876180417529088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265375.237341:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789265375.237396:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1876180417529088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265375.237404:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789265375.237445:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417529088:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789265375.237612:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1789265375.271515:0:14707:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265375.271525:0:14707:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789265375.271549:0:14707:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789265375.271558:0:14707:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789265375.418414:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265375.426663:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399647232 00000100:00100000:0.0:1789265375.426677:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399647232 00000100:00100000:1.0:1789265375.430588:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 202 00000100:00100000:1.0:1789265375.430602:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+23:12387:x1876180399647232:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1789265375.430628:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265375.430649:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a97369 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc060 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.430768:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a97370 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.430783:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a97370 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.430796:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a97370 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265375.430807:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789265375.430904:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a97369 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc060 expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.430921:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a97370 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc060 expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.430930:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:1.0:1789265375.430933:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789265375.430945:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2ff200, rc 0) 00000100:00100000:1.0:1789265375.432056:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+25:12387:x1876180399647232:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 1450us (13650us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1789265375.432066:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 202 00000100:00080000:3.0:1789265375.436886:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265375.439868:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265375.439949:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399647360 00000100:00100000:3.0:1789265375.439970:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399647360 00000100:00100000:1.0:1789265375.440136:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 203 00000100:00100000:1.0:1789265375.440149:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+25:12387:x1876180399647360:12345-192.168.203.49@tcp:34:lfs.0 00010000:00010000:1.0:1789265375.440241:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a9737e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440259:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a9737e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440271:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a9737e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440289:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97385 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440297:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97385 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440304:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97385 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440381:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a9738c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440388:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a9738c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440395:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a9738c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265375.440449:0:8459:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a9738c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440472:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a9737e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440478:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a9737e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440485:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a9737e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440491:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ffe00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265375.440495:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a9737e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440676:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a9737e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440700:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:1.0:1789265375.440703:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265375.440708:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a9737e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440714:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a9737e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440727:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97385 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440732:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97385 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440745:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97385 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440750:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fea00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265375.440753:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97385 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440759:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97385 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440767:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fccacd4e500) 00010000:00010000:1.0:1789265375.440770:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265375.440773:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97385 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440778:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97385 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440792:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a9738c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440798:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a9738c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440803:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a9738c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440808:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fe000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265375.440811:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a9738c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440827:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a9738c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440836:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fccacd4e700) 00010000:00010000:1.0:1789265375.440838:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265375.440841:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a9738c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.440846:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a9738c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265375.440929:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+25:12387:x1876180399647360:12345-192.168.203.49@tcp:34:lfs.0 Request processed in 783us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265375.440938:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 203 00000100:00100000:3.0:1789265375.533606:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265375.533779:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399647616 00000100:00100000:0.0:1789265375.533790:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399647616 00000100:00100000:0.0:1789265375.533845:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 204 00000100:00100000:0.0:1789265375.533852:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+25:12390:x1876180399647616:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:0.0:1789265375.533881:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265375.533917:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a97393 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc067 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.533998:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9739a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.534012:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9739a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.534054:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9739a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.534071:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a973a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.534078:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a973a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.534083:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a973a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.534198:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a973a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.534206:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a973a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.534213:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a973a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265375.534221:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789265375.534370:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9739a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.534387:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9739a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.534394:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9739a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.534400:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265375.534405:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9739a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.534413:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9739a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.534427:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:0.0:1789265375.534430:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265375.534435:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9739a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.534440:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9739a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.534452:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a973a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.534457:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a973a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.534464:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a973a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.534468:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265375.534477:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a973a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.534483:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a973a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.534490:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fcca9677200) 00010000:00010000:0.0:1789265375.534493:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265375.534495:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a973a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.534838:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a973a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.534899:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a97393 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc067 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.534913:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a973a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc067 expref: 27 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.534919:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9677d00) 00010000:00010000:0.0:1789265375.534922:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265375.534924:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da4200, rc 0) 00000100:00100000:0.0:1789265375.535073:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+27:12390:x1876180399647616:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 1219us (1477us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1789265375.535081:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 204 00000100:00100000:3.0:1789265375.542465:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265375.542545:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399647744 00000100:00100000:1.0:1789265375.542563:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399647744 00000100:00100000:1.0:1789265375.542637:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 205 00000100:00100000:1.0:1789265375.542647:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+27:12390:x1876180399647744:12345-192.168.203.49@tcp:54:lfs.0 00010000:00010000:1.0:1789265375.542726:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a973b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.542742:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a973b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.542754:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a973b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.542789:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a973b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.542816:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a973b6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.542823:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a973b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.542829:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fe000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265375.542833:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a973b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.542840:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a973b6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.542853:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9677d00) 00010000:00010000:1.0:1789265375.542865:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789265375.542882:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a973b6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.542889:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a973b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265375.542962:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+27:12390:x1876180399647744:12345-192.168.203.49@tcp:54:lfs.0 Request processed in 315us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265375.542977:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 205 00000100:00100000:2.0:1789265375.545708:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265375.545781:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399648000 00000100:00100000:3.0:1789265375.545790:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399648000 00000100:00100000:3.0:1789265375.545844:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 51 00000100:00100000:3.0:1789265375.545855:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+27:12390:x1876180399648000:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:2.0:1789265375.546229:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+28:12390:x1876180399648000:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 374us (539us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1789265375.546239:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 51 00010000:00010000:0.0:1789265375.553618:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265375.589732:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265375.591004:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399648256 00000100:00100000:0.0:1789265375.591039:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399648256 00000100:00100000:0.0:1789265375.591114:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 206 00000100:00100000:0.0:1789265375.591139:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+28:11914:x1876180399648256:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1789265375.591585:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265375.591611:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a973bd lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc06e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.592946:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a973c4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.592974:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a973a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc067 expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.592984:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a973c4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.593115:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a973a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc067 expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.593133:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a973a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc067 expref: 29 pid: 6517 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265375.593176:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84a3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876180417529216:192.168.203.49@tcp:104: 00000100:00100000:1.0:1789265375.593815:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcca9528e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265375.597171:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265375.597706:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399648384 00000100:00100000:0.0:1789265375.597716:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399648384 00000100:00100000:1.0:1789265375.597944:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84a3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876180417529216:192.168.203.49@tcp:104: 00010000:00010000:1.0:1789265375.597969:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a973c4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.598076:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a973a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc067 expref: 30 pid: 6517 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265375.598110:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 94 00000100:00100000:0.0:1789265375.598119:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+30:2395:x1876180399648384:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265375.598136:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265375.598143:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a973a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc067 expref: 30 pid: 6517 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.598156:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a973a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc067 expref: 30 pid: 6517 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.598201:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a973a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc067 expref: 30 pid: 6517 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.598215:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9677d00) 00010000:00010000:0.0:1789265375.598219:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a973c4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.598229:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a973c4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.598236:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a973c4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.598263:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265375.598832:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a973c4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265375.598920:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a973c4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265375.598941:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789265375.599088:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a973bd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc06e expref: 31 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265375.599105:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a973c4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc06e expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265375.599113:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9677d00) 00010000:00010000:3.0:1789265375.599124:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789265375.599127:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5400, rc 0) 00000100:00100000:3.0:1789265375.599202:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+30:11914:x1876180399648256:12345-192.168.203.49@tcp:101:bash.0 Request processed in 8064us (9479us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1789265375.599210:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 206 00000100:00100000:0.0:1789265375.600114:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+29:2395:x1876180399648384:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 1991us (2959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265375.600124:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 94 00000100:00100000:2.0:1789265375.606556:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265375.606771:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399648512 00000100:00100000:1.0:1789265375.606780:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399648512 00000100:00100000:1.0:1789265375.606844:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 207 00000100:00100000:1.0:1789265375.606853:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+29:11914:x1876180399648512:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1789265375.606875:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265375.606895:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a973d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc075 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.606928:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a973d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.606941:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a973d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.606953:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a973d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.607579:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a973d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc075 expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.607599:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a973d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc075 expref: 30 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.607617:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9677d00) 00010000:00010000:1.0:1789265375.607619:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789265375.607623:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fea00, rc 0) 00000100:00100000:1.0:1789265375.607686:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+30:11914:x1876180399648512:12345-192.168.203.49@tcp:101:bash.0 Request processed in 833us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265375.607701:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 207 00000100:00100000:2.0:1789265375.615688:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265375.615879:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399648768 00000100:00100000:1.0:1789265375.615888:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399648768 00000100:00100000:1.0:1789265375.616101:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 208 00000100:00100000:1.0:1789265375.616115:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+30:11914:x1876180399648768:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:1.0:1789265375.616352:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a973e0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.616370:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a973e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.616395:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a973e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265375.616435:0:8459:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:1.0:1789265375.616456:0:8459:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002bb1d6dc reply state 0000000013a4bdc6 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a973e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.616468:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a973e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.616475:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9677d00) 00010000:00010000:1.0:1789265375.616477:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789265375.616495:0:8459:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789265375.616531:0:8459:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:1.0:1789265375.616617:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+34:11914:x1876180399648768:12345-192.168.203.49@tcp:36:bash.0 Request processed in 504us (937us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1789265375.623309:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 208 00000020:00080000:1.0:1789265375.623322:0:8459:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789265375.626206:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265375.626526:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399648896 00000100:00100000:1.0:1789265375.626537:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399648896 00000100:00100000:1.0:1789265375.626599:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 209 00000100:00100000:1.0:1789265375.626610:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+34:11914:x1876180399648896:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1789265375.626632:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265375.626652:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a973e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc07c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.626718:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a973e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc07c expref: 35 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.626734:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a973e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc07c expref: 35 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.626753:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9677d00) 00010000:00010000:1.0:1789265375.626757:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265375.626761:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2ffe00, rc 0) 00000100:00100000:1.0:1789265375.626826:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+35:11914:x1876180399648896:12345-192.168.203.49@tcp:101:bash.0 Request processed in 218us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265375.626833:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 209 00000100:00100000:2.0:1789265375.634503:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265375.634676:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399649024 00000100:00100000:3.0:1789265375.634685:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399649024 00000100:00100000:3.0:1789265375.634823:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 66 00000100:00100000:3.0:1789265375.634833:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+7:11914:x1876180399649024:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1789265375.634851:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265375.634872:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053508460/0x9272d942b4a973ee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc083 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265375.634899:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa605dc, atime: 0x6aa605da, ctime: 0x6aa605dc, blocks: 0x8 00010000:00010000:3.0:1789265375.634921:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1789265375.634925:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265375.634934:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053508460/0x9272d942b4a973ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc083 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265375.634949:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000053508460/0x9272d942b4a973ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc083 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265375.634975:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81491600, rc 0) 00000100:00100000:3.0:1789265375.635065:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+8:11914:x1876180399649024:12345-192.168.203.49@tcp:101:bash.0 Request processed in 232us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265375.635089:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 66 00000100:00080000:1.0:1789265375.636420:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265375.642246:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265375.643004:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399649152 00000100:00100000:1.0:1789265375.643016:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399649152 00002000:00010000:1.0:1789265375.643111:0:8440:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1789265375.643115:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fcc913f0700 with x1876180399649152 ext(0->18446744073709551615) 00002000:00010000:1.0:1789265375.643127:0:8440:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fcc913f0700. 00000100:00100000:1.0:1789265375.643170:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5 00000100:00100000:1.0:1789265375.643180:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc913f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5b43750b-84cf-4d62-9028-e016267b6509+8:2396:x1876180399649152:12345-192.168.203.49@tcp:10:bash.0 00002000:00010000:1.0:1789265375.643961:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789265375.643967:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789265372 -> 1789265376 00002000:00010000:1.0:1789265375.643970:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1789265370 -> 1789265370 00002000:00010000:1.0:1789265375.643973:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789265372 -> 1789265376 00002000:00010000:1.0:1789265375.643975:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1789265375.644063:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc913f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5b43750b-84cf-4d62-9028-e016267b6509+9:2396:x1876180399649152:12345-192.168.203.49@tcp:10:bash.0 Request processed in 882us (1832us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1789265375.644072:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5 00002000:00010000:1.0:1789265375.644076:0:8440:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1789265375.644078:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fcc913f0700 with x1876180399649152 ext(0->18446744073709551615) 00002000:00010000:1.0:1789265375.644084:0:8440:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fcc913f0700. 00000100:00100000:2.0:1789265375.735139:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265375.736670:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399649280 00000100:00100000:1.0:1789265375.736683:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399649280 00000100:00100000:1.0:1789265375.736758:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 210 00000100:00100000:1.0:1789265375.736767:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83daa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+35:12404:x1876180399649280:12345-192.168.203.49@tcp:34:lfs.0 00010000:00010000:1.0:1789265375.736833:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a973f5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.736858:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a973f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.736870:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a973f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.736899:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a973fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.736907:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a973fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.736914:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a973fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.736980:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97403 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.736988:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97403 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.736995:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97403 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265375.737073:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97403 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.737083:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a973f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.737090:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a973f5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.737097:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a973f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.737103:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265375.737107:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a973f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.737120:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a973f5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.737132:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:1.0:1789265375.737135:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265375.737139:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a973f5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.737145:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a973f5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.737157:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a973fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.737163:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a973fc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.737168:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a973fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.737173:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265375.737176:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a973fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.737182:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a973fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.737187:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fccacd4e700) 00010000:00010000:1.0:1789265375.737189:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265375.737192:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a973fc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.737206:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a973fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.737219:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97403 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.737224:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97403 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.737230:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97403 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.737235:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fe800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265375.737238:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97403 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.737244:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97403 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.737250:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9677d00) 00010000:00010000:1.0:1789265375.737252:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265375.737255:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97403 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.737260:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97403 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265375.737329:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83daa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+35:12404:x1876180399649280:12345-192.168.203.49@tcp:34:lfs.0 Request processed in 563us (2199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265375.737337:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 210 00000001:00080000:0.0:1789265375.749326:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:0.0:1789265375.749346:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:2.0:1789265375.791077:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265375.791357:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399649536 00000100:00100000:1.0:1789265375.791367:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399649536 00000100:00100000:1.0:1789265375.791478:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 211 00000100:00100000:1.0:1789265375.791489:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+35:12407:x1876180399649536:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1789265375.791511:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265375.791533:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a9740a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc08a expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.791609:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97411 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.791624:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97411 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.791638:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97411 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.791652:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a97418 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.791659:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a97418 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.791665:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a97418 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.791785:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a9741f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.791795:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a9741f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.791823:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a9741f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265375.791834:0:8459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789265375.791933:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97411 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.791940:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97411 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.791947:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97411 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.791952:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265375.791957:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97411 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.791964:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97411 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.791989:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:1.0:1789265375.791992:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265375.791997:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97411 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.792002:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97411 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.792015:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a97418 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.792069:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a97418 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.792084:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a97418 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.792089:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265375.792092:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a97418 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.792098:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a97418 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.792106:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fccacd4e700) 00010000:00010000:1.0:1789265375.792109:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265375.792112:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a97418 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.792116:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a97418 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.792171:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a9740a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc08a expref: 38 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.792185:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a9741f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc08a expref: 37 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.792193:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9677d00) 00010000:00010000:1.0:1789265375.792195:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789265375.792197:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2ffa00, rc 0) 00000100:00100000:1.0:1789265375.792453:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+37:12407:x1876180399649536:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 965us (1492us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1789265375.792470:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 211 00000100:00100000:3.0:1789265375.796535:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265375.796645:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399649664 00000100:00100000:2.0:1789265375.796654:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399649664 00000100:00100000:2.0:1789265375.796727:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 212 00000100:00100000:2.0:1789265375.796738:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+37:12407:x1876180399649664:12345-192.168.203.49@tcp:54:lfs.0 00010000:00010000:2.0:1789265375.796804:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9742d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265375.796819:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a973c4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc06e expref: 37 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265375.796858:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9742d lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265375.796891:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a973c4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc06e expref: 37 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265375.796905:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a973c4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc06e expref: 37 pid: 6516 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265375.796920:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8460:1876180417529344:192.168.203.49@tcp:104: 00000100:00100000:2.0:1789265375.797046:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc906d4840 going to sleep for 11 seconds 00000100:00100000:2.0:1789265375.812578:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265375.814081:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8460:1876180417529344:192.168.203.49@tcp:104: 00010000:00010000:1.0:1789265375.814112:0:8460:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9742d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265375.814437:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399649920 00000100:00100000:3.0:1789265375.814445:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399649920 00000100:00100000:3.0:1789265375.814549:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 52 00000100:00100000:3.0:1789265375.814559:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+38:6160:x1876180399649920:12345-192.168.203.49@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789265375.814866:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+39:6160:x1876180399649920:12345-192.168.203.49@tcp:35:ldlm_bl.0 Request processed in 307us (2297us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1789265375.814875:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 52 00000100:00100000:3.0:1789265375.817609:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265375.817870:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399650048 00000100:00100000:0.0:1789265375.817881:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399650048 00010000:00010000:0.0:1789265375.817921:0:7926:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a973c4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc06e expref: 39 pid: 6516 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265375.818020:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 95 00000100:00100000:0.0:1789265375.818072:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+39:2396:x1876180399650048:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265375.818089:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265375.818110:0:7926:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a973c4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc06e expref: 39 pid: 6516 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.818124:0:7926:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a973c4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc06e expref: 39 pid: 6516 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.818492:0:7926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a973c4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc06e expref: 39 pid: 6516 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.818512:0:7926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9677d00) 00010000:00010000:0.0:1789265375.818517:0:7926:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9742d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.818526:0:7926:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9742d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.818534:0:7926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9742d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.818561:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265375.818626:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+38:2396:x1876180399650048:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 556us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265375.818635:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 95 00010000:00010000:1.0:1789265375.818741:0:8460:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9742d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.818750:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9742d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.818788:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9742d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.818795:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9742d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.818802:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9742d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.818808:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265375.818812:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9742d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.818820:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9742d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.818830:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9677d00) 00010000:00010000:1.0:1789265375.818833:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789265375.818837:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9742d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.818852:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9742d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265375.818894:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+37:12407:x1876180399649664:12345-192.168.203.49@tcp:54:lfs.0 Request processed in 22159us (22369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265375.818902:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 212 00000100:00100000:3.0:1789265375.824591:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265375.824730:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399650304 00000100:00100000:1.0:1789265375.824740:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399650304 00000100:00100000:1.0:1789265375.824785:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 53 00000100:00100000:1.0:1789265375.824795:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+37:12407:x1876180399650304:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:1.0:1789265375.825000:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+38:12407:x1876180399650304:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 205us (419us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1789265375.825009:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 53 00000100:00100000:3.0:1789265375.944488:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265375.944600:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399650560 00000100:00100000:0.0:1789265375.944615:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399650560 00000100:00100000:0.0:1789265375.944708:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 213 00000100:00100000:0.0:1789265375.944719:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+38:12418:x1876180399650560:12345-192.168.203.49@tcp:101:cat.0 00010000:00010000:0.0:1789265375.944744:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265375.944766:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97434 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc091 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.944855:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9743b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.944870:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9743b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.944881:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9743b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.944896:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97442 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.944903:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97442 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.944910:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97442 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.945016:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a97449 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.945076:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a97449 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.945084:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a97449 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265375.945094:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1789265375.945379:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9743b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.945388:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9743b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.945402:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9743b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.945408:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265375.945412:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9743b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.945420:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9743b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.945433:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:0.0:1789265375.945436:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265375.945440:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9743b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.945446:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a9743b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.945460:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97442 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.945466:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97442 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.945472:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97442 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.945477:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4a00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265375.945480:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97442 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.945497:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97442 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.945505:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fcca9677200) 00010000:00010000:0.0:1789265375.945507:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265375.945510:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97442 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.945515:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97442 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.945748:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97434 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc091 expref: 41 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.945762:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a97449 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc091 expref: 40 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.945769:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9677d00) 00010000:00010000:0.0:1789265375.945772:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265375.945774:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da4c00, rc 0) 00000100:00100000:0.0:1789265375.945884:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+40:12418:x1876180399650560:12345-192.168.203.49@tcp:101:cat.0 Request processed in 1166us (1410us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1789265375.945894:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 213 00000100:00100000:3.0:1789265375.952778:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265375.953265:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399650816 00000100:00100000:1.0:1789265375.953286:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399650816 00000100:00100000:1.0:1789265375.953348:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 54 00000100:00100000:1.0:1789265375.953359:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+40:12418:x1876180399650816:12345-192.168.203.49@tcp:35:cat.0 00000100:00100000:1.0:1789265375.953638:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+41:12418:x1876180399650816:12345-192.168.203.49@tcp:35:cat.0 Request processed in 280us (869us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1789265375.953646:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 54 00000100:00100000:3.0:1789265375.980146:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265375.980311:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399651072 00000100:00100000:1.0:1789265375.980321:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399651072 00000100:00100000:1.0:1789265375.980383:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 214 00000100:00100000:1.0:1789265375.980393:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+41:12419:x1876180399651072:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:1.0:1789265375.980451:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1789265375.980502:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a973e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc07c expref: 41 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.980524:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a97449 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc091 expref: 40 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.980537:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a9741f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc08a expref: 39 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.980549:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a973d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc075 expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.980559:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9677d00) 00010000:00010000:1.0:1789265375.980563:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265375.980583:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97457 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.980595:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97457 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.980604:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97457 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.980619:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a9745e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.980627:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a9745e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.980634:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a9745e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.980731:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97465 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.980741:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97465 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.980748:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97465 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265375.980943:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1789265375.980954:0:8459:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 427210930431ns, next at 428210927549ns, rc = 0 00010000:00010000:1.0:1789265375.981010:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a9746c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.981019:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a9746c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.981054:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a9746c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.981062:0:8459:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a9746c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.981069:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a9746c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.981074:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a9746c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.981101:0:8459:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265375.981119:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97465 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.981133:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97465 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.981149:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97465 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.981155:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265375.981159:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97465 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.981166:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97465 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.981175:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9677d00) 00010000:00010000:1.0:1789265375.981178:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789265375.981182:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97465 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.981188:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97465 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.981204:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97457 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.981209:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97457 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.981215:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97457 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.981220:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fe800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265375.981230:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97457 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.981236:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97457 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.981244:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:1.0:1789265375.981247:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265375.981250:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97457 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.981256:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97457 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265375.981266:0:8459:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005e66cc82 reply state 0000000065759f31 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a9745e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.981276:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a9745e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265375.981282:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fccacd4e700) 00010000:00010000:1.0:1789265375.981284:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789265375.981286:0:8459:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789265375.981352:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+39:12419:x1876180399651072:12345-192.168.203.49@tcp:36:rm.0 Request processed in 959us (1223us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1789265375.981360:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 214 00010000:00010000:0.0:1789265375.981576:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265375.981582:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a9746c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.981588:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f53e00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265375.981597:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a9746c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.981603:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a9746c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.981612:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9677d00) 00010000:00010000:0.0:1789265375.981614:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789265375.981616:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a9746c lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.981621:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a9746c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265375.981631:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265375.981633:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265375.981634:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265376.031894:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265376.032061:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399651328 00000100:00100000:1.0:1789265376.032076:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399651328 00000100:00100000:1.0:1789265376.032144:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 215 00000100:00100000:1.0:1789265376.032154:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+39:12425:x1876180399651328:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1789265376.032184:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265376.032236:0:8460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52200/0x9272d942b4a97473 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc098 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.032368:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52400/0x9272d942b4a9747a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.032386:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52400/0x9272d942b4a9747a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.032399:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52400/0x9272d942b4a9747a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.032409:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53000/0x9272d942b4a97481 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.032416:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53000/0x9272d942b4a97481 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.032422:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53000/0x9272d942b4a97481 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789265376.032838:0:8460:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1789265376.033020:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52000/0x9272d942b4a97488 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.033067:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52000/0x9272d942b4a97488 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.033075:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52000/0x9272d942b4a97488 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.033117:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52400/0x9272d942b4a9747a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.033139:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52400/0x9272d942b4a9747a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.033147:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52400/0x9272d942b4a9747a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.033154:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f52400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265376.033160:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52400/0x9272d942b4a9747a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.033167:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52400/0x9272d942b4a9747a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.033182:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:1.0:1789265376.033185:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265376.033190:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52400/0x9272d942b4a9747a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.033197:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52400/0x9272d942b4a9747a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265376.033215:0:8460:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008cf32223 reply state 0000000097c9d5c1 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53000/0x9272d942b4a97481 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.033227:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53000/0x9272d942b4a97481 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.033233:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fccacd4e700) 00010000:00010000:1.0:1789265376.033235:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789265376.033239:0:8460:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789265376.033273:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52200/0x9272d942b4a97473 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc098 expref: 42 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.033294:0:8460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52000/0x9272d942b4a97488 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc098 expref: 41 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.033301:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fccacd4e500) 00010000:00010000:1.0:1789265376.033303:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265376.033305:0:8460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f52000, rc 0) 00000100:00100000:1.0:1789265376.033390:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+42:12425:x1876180399651328:12345-192.168.203.49@tcp:101:bash.0 Request processed in 1237us (1510us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1789265376.033399:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 215 00000100:00100000:3.0:1789265376.036458:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265376.037412:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399651456 00000100:00100000:0.0:1789265376.037426:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399651456 00000100:00100000:0.0:1789265376.037554:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 67 00000100:00100000:0.0:1789265376.037569:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399651456:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1789265376.037611:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265376.037641:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2022800/0x9272d942b4a97496 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc09f expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789265376.037676:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265376.037717:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=427s v=(0 0) 00010000:00010000:0.0:1789265376.037722:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265376.037735:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2022800/0x9272d942b4a97496 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc09f expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.037789:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d2022800/0x9272d942b4a97496 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc09f expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.037807:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da4a00, rc 0) 00000100:00100000:0.0:1789265376.037893:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+6:2396:x1876180399651456:12345-192.168.203.49@tcp:101:bash.0 Request processed in 328us (1450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265376.037901:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 67 00000100:00100000:0.0:1789265376.041543:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265376.041921:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399651584 00000100:00100000:3.0:1789265376.041936:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399651584 00000100:00100000:3.0:1789265376.042062:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 68 00000100:00100000:3.0:1789265376.042076:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+6:12425:x1876180399651584:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1789265376.042101:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265376.042127:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb74d500/0x9272d942b4a9749d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc0a6 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.042173:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2022800/0x9272d942b4a97496 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc09f expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.042205:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265376.042211:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265376.042217:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb74d500/0x9272d942b4a9749d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0a6 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.042402:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d2022800/0x9272d942b4a97496 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc09f expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.042419:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d2022800/0x9272d942b4a97496 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc09f expref: 7 pid: 8435 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265376.042438:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8434:1876180417529472:192.168.203.49@tcp:104: 00000100:00100000:3.0:1789265376.042556:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c48a80 going to sleep for 11 seconds 00000100:00080000:1.0:1789265376.045756:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265376.046096:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8434:1876180417529472:192.168.203.49@tcp:104: 00010000:00010000:0.0:1789265376.046147:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eb74d500/0x9272d942b4a9749d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0a6 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.046174:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81490400, rc 0) 00000100:00100000:0.0:1789265376.046259:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+7:12425:x1876180399651584:12345-192.168.203.49@tcp:101:bash.0 Request processed in 4185us (4729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265376.046268:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 68 00000100:00100000:2.0:1789265376.047798:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265376.047963:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399651712 00000100:00100000:1.0:1789265376.047975:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399651712 00010000:00010000:1.0:1789265376.048057:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d2022800/0x9272d942b4a97496 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc09f expref: 7 pid: 8435 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265376.048097:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 96 00000100:00100000:1.0:1789265376.048108:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+7:2395:x1876180399651712:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265376.048129:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265376.048155:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d2022800/0x9272d942b4a97496 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc09f expref: 7 pid: 8435 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.048170:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d2022800/0x9272d942b4a97496 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc09f expref: 7 pid: 8435 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.048200:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2022800/0x9272d942b4a97496 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc09f expref: 7 pid: 8435 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.048249:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265376.048254:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265376.048264:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb74d500/0x9272d942b4a9749d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0a6 expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.048276:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb74d500/0x9272d942b4a9749d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0a6 expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.048321:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000eb74d500/0x9272d942b4a9749d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0a6 expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265376.048337:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84a3f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6501:1876180417529600:192.168.203.49@tcp:105: 00000100:00100000:1.0:1789265376.048430:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcca9528b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265376.051903:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265376.052064:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399651968 00000100:00100000:2.0:1789265376.052077:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399651968 00000100:00100000:2.0:1789265376.052153:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 55 00000100:00100000:2.0:1789265376.052166:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+42:12425:x1876180399651968:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:2.0:1789265376.052568:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+43:12425:x1876180399651968:12345-192.168.203.49@tcp:35:bash.0 Request processed in 402us (676us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1789265376.052577:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 55 00000100:00100000:3.0:1789265376.055524:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84a3f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6501:1876180417529600:192.168.203.49@tcp:105: 00010000:00010000:3.0:1789265376.055564:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265376.055698:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+6:2395:x1876180399651712:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 7582us (7902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265376.055712:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 96 00000100:00100000:1.0:1789265376.220855:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265376.220983:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399652096 00000100:00100000:0.0:1789265376.220997:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399652096 00000100:00100000:0.0:1789265376.221111:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 216 00000100:00100000:0.0:1789265376.221123:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+43:12441:x1876180399652096:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:0.0:1789265376.221157:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265376.221185:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a974a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc0ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.221305:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a974ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.221323:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a974ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.221337:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a974ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265376.221394:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789265376.221398:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265376.221433:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a974ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.221461:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a974a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0ad expref: 45 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.221482:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a974ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0ad expref: 44 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.221491:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:0.0:1789265376.221494:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265376.221499:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da4a00, rc 0) 00000100:00100000:0.0:1789265376.221593:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+44:12441:x1876180399652096:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 471us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265376.221602:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 216 00000100:00100000:2.0:1789265376.227220:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265376.227577:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399652352 00000100:00100000:1.0:1789265376.227746:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399652352 00000100:00100000:1.0:1789265376.227867:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 217 00000100:00100000:1.0:1789265376.227879:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+44:12441:x1876180399652352:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1789265376.227911:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265376.227940:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52e00/0x9272d942b4a974b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc0b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.228142:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52600/0x9272d942b4a974b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.228177:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52600/0x9272d942b4a974b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.228190:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52600/0x9272d942b4a974b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265376.228205:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789265376.228346:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52e00/0x9272d942b4a974b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0b4 expref: 47 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.228367:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52600/0x9272d942b4a974b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0b4 expref: 46 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.228378:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fccacd4e500) 00010000:00010000:1.0:1789265376.228381:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265376.228385:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f52600, rc 0) 00000100:00100000:1.0:1789265376.228471:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+46:12441:x1876180399652352:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 594us (1266us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1789265376.228479:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 217 00000100:00100000:2.0:1789265376.232253:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265376.232384:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399652608 00000100:00100000:3.0:1789265376.232397:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399652608 00000100:00100000:3.0:1789265376.232536:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 218 00000100:00100000:3.0:1789265376.232550:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+46:12441:x1876180399652608:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1789265376.232581:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265376.232609:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a974c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc0bb expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.232768:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a974ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.232785:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a974ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.232799:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a974ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265376.232814:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789265376.232936:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a974c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0bb expref: 49 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.232956:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a974ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0bb expref: 48 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.232965:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fccacd4e500) 00010000:00010000:3.0:1789265376.232968:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789265376.232972:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81491e00, rc 0) 00000100:00100000:3.0:1789265376.233090:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+48:12441:x1876180399652608:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 542us (861us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1789265376.233098:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 218 00000100:00100000:3.0:1789265376.234767:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265376.234921:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399652736 00000100:00100000:2.0:1789265376.234932:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399652736 00000100:00100000:2.0:1789265376.235066:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 16 00000100:00100000:2.0:1789265376.235093:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84844700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+48:2395:x1876180399652736:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265376.235110:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265376.235137:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52600/0x9272d942b4a974b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0b4 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.235159:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fccacd4e500) 00010000:00010000:2.0:1789265376.235164:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265376.235219:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84844700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+47:2395:x1876180399652736:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 128us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265376.235238:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 16 00000100:00100000:2.0:1789265376.238389:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265376.239224:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399652864 00000100:00100000:0.0:1789265376.239309:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399652864 00000100:00100000:0.0:1789265376.239450:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 69 00000100:00100000:0.0:1789265376.239462:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+6:2396:x1876180399652864:12345-192.168.203.49@tcp:1:lfs.0 00010000:00010000:0.0:1789265376.239521:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a974dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.239548:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb74d500/0x9272d942b4a9749d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0a6 expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.239558:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265376.239562:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265376.239567:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a974dc lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.239613:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eb74d500/0x9272d942b4a9749d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0a6 expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.239631:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eb74d500/0x9272d942b4a9749d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0a6 expref: 6 pid: 8434 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265376.239651:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf4fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8435:1876180417529728:192.168.203.49@tcp:104: 00000100:00100000:0.0:1789265376.239787:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c27c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265376.243067:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265376.243147:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399652992 00000100:00100000:3.0:1789265376.243158:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399652992 00002000:00100000:3.0:1789265376.243224:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9fcb838f4380 x1876180399652992/t0(0) o4->5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp:702/0 lens 504/0 e 0 to 0 dl 1789265387 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265376.243273:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fcb838f4380 with x1876180399652992 ext(0->8) 00010000:00010000:3.0:1789265376.243286:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000eb74d500/0x9272d942b4a9749d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0a6 expref: 7 pid: 8434 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.243305:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000eb74d500/0x9272d942b4a9749d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0a6 expref: 7 pid: 8434 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265376.243315:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fcb838f4380 00000100:00100000:3.0:1789265376.243354:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 3 00000100:00100000:3.0:1789265376.243365:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5b43750b-84cf-4d62-9028-e016267b6509+7:2395:x1876180399652992:12345-192.168.203.49@tcp:4:lfs.0 00000100:00100000:0.0:1789265376.244168:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf4fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8435:1876180417529728:192.168.203.49@tcp:104: 00010000:00010000:0.0:1789265376.244202:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a974dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265376.244493:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5b43750b-84cf-4d62-9028-e016267b6509+9:2395:x1876180399652992:12345-192.168.203.49@tcp:4:lfs.0 Request processed in 1128us (1470us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789265376.244504:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 3 00002000:00100000:3.0:1789265376.244514:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9fcb838f4380 x1876180399652992/t4294967309(0) o4->5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp:702/0 lens 504/448 e 0 to 0 dl 1789265387 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265376.244524:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fcb838f4380 with x1876180399652992 ext(0->8) 00010000:00010000:3.0:1789265376.244532:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000eb74d500/0x9272d942b4a9749d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0a6 expref: 9 pid: 8434 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.244545:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000eb74d500/0x9272d942b4a9749d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0a6 expref: 9 pid: 8434 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265376.244552:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fcb838f4380 00000100:00100000:1.0:1789265376.247782:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265376.247930:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399653120 00000100:00100000:0.0:1789265376.247975:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399653120 00010000:00010000:0.0:1789265376.248063:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eb74d500/0x9272d942b4a9749d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0a6 expref: 9 pid: 8434 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265376.248110:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 97 00000100:00100000:0.0:1789265376.248121:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+9:2393:x1876180399653120:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265376.248142:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789265376.248164:0:6503:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789265376.248167:0:6503:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789265376 00002000:00010000:0.0:1789265376.248169:0:6503:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789265376 00002000:00010000:0.0:1789265376.248171:0:6503:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789265376 00002000:00010000:0.0:1789265376.248174:0:6503:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789265376.248180:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eb74d500/0x9272d942b4a9749d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0a6 expref: 9 pid: 8434 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.248195:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eb74d500/0x9272d942b4a9749d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0a6 expref: 9 pid: 8434 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.248222:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb74d500/0x9272d942b4a9749d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0a6 expref: 9 pid: 8434 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.248410:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265376.248415:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265376.248422:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a974dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.248434:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a974dc lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.248479:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265376.248548:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+8:2393:x1876180399653120:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 429us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265376.248556:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 97 00010000:00010000:3.0:1789265376.248988:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a974dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.249007:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a974dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.249066:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a974dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.249076:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a974dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.249085:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a974dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.249094:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5400 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265376.249099:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a974dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.249109:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a974dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.249126:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a974dc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.249133:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a974dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265376.249240:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+7:2396:x1876180399652864:12345-192.168.203.49@tcp:1:lfs.0 Request processed in 9779us (10863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265376.249249:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 69 00000100:00100000:1.0:1789265376.253913:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265376.254014:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399653376 00000100:00100000:2.0:1789265376.254067:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399653376 00000100:00100000:2.0:1789265376.254138:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 56 00000100:00100000:2.0:1789265376.254150:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdcbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+47:12441:x1876180399653376:12345-192.168.203.49@tcp:35:lfs.0 00000004:00010000:2.0:1789265376.254246:0:6520:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a974ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0bb expref: 47 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265376.254495:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1789265376.254531:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1789265376.254930:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1789265376.254978:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a974e3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.254996:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52000/0x9272d942b4a97488 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc098 expref: 51 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.255007:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a974e3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.255101:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52000/0x9272d942b4a97488 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc098 expref: 51 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.255120:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52000/0x9272d942b4a97488 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc098 expref: 51 pid: 8460 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265376.255138:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6520:1876180417529856:192.168.203.49@tcp:104: 00000100:00100000:2.0:1789265376.255246:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc906d4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265376.258676:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6520:1876180417529856:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265376.258731:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a974e3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265376.259261:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265376.259548:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399653504 00000100:00100000:3.0:1789265376.259558:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399653504 00010000:00010000:3.0:1789265376.259608:0:7926:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52000/0x9272d942b4a97488 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc098 expref: 52 pid: 8460 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265376.259657:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 98 00000100:00100000:3.0:1789265376.259667:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+52:2396:x1876180399653504:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265376.259693:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265376.259701:0:7926:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52000/0x9272d942b4a97488 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc098 expref: 52 pid: 8460 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.259715:0:7926:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52000/0x9272d942b4a97488 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc098 expref: 52 pid: 8460 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.259742:0:7926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52000/0x9272d942b4a97488 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc098 expref: 52 pid: 8460 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.259762:0:7926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fccacd4e500) 00010000:00010000:3.0:1789265376.259768:0:7926:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a974e3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.259778:0:7926:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a974e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.259808:0:7926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a974e3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.259843:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265376.259917:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+51:2396:x1876180399653504:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 251us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265376.259925:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 98 00010000:00010000:1.0:1789265376.260468:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a974e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.260478:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a974e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265376.260649:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:1.0:1789265376.260805:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1789265376.260916:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf54d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1876180417529984:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789265376.260997:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265376.261088:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcca9528e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265376.261642:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417529984 00000100:00100000:3.0:1789265376.261652:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417529984 00000100:00100000:3.0:1789265376.261754:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789265376.261766:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1876180417529984:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789265376.261890:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1876180417529984:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 126us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265376.261897:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:0.0:1789265376.262594:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265376.262779:0:6520:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:1.0:1789265376.262787:0:6520:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:1.0:1789265376.262817:0:6520:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fcb8495e680, transno 4294967308 00000100:00100000:1.0:1789265376.263178:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf54d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1876180417529984:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789265376.263376:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1789265376.263469:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf54d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1876180417530112:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789265376.263532:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265376.263565:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0a7de40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265376.263707:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417530112 00000100:00100000:3.0:1789265376.263715:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417530112 00000100:00100000:3.0:1789265376.263774:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789265376.263785:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf54d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6520:x1876180417530112:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789265376.264099:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf54d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1876180417530112:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789265376.264158:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1789265376.264204:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a974e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.264216:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a974e3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.264225:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a974e3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.264244:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265376.264249:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a974e3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.264258:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a974e3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.264295:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fccacd4e500) 00010000:00010000:2.0:1789265376.264298:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789265376.264304:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a974e3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.264310:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a974e3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789265376.264421:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789265376.264497:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1789265376.264511:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 427494487207ns, next at 428494484146ns, rc = 0 00000001:00080000:2.0:1789265376.264517:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1789265376.264541:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fccacd4e500) 00010000:00010000:2.0:1789265376.264544:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789265376.264552:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a974ce lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0bb expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265376.265219:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdcbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+54:12441:x1876180399653376:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 11068us (11316us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1789265376.265240:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 56 00000020:00080000:2.0:1789265376.265246:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789265376.265369:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf54d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6520:x1876180417530112:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1584us (1835us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789265376.265379:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789265376.280344:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265376.280476:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399653632 00000100:00100000:2.0:1789265376.280490:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399653632 00000100:00100000:2.0:1789265376.280568:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 219 00000100:00100000:2.0:1789265376.280579:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+54:12441:x1876180399653632:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1789265376.280609:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265376.280640:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a974ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc0c2 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.280741:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a974ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0c2 expref: 55 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.280759:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a974ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0c2 expref: 55 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.280782:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:2.0:1789265376.280786:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265376.280790:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2f600, rc 0) 00000100:00100000:2.0:1789265376.280867:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+55:12441:x1876180399653632:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 289us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265376.280875:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 219 00000100:00100000:1.0:1789265376.283847:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265376.283980:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399653888 00000100:00100000:0.0:1789265376.283992:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399653888 00000100:00100000:0.0:1789265376.284114:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 57 00000100:00100000:0.0:1789265376.284127:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+55:12441:x1876180399653888:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:0.0:1789265376.284430:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+56:12441:x1876180399653888:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 305us (595us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1789265376.284438:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 57 00000100:00100000:1.0:1789265376.376704:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265376.376935:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399654016 00000100:00100000:3.0:1789265376.376951:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399654016 00000100:00100000:3.0:1789265376.377079:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 220 00000100:00100000:3.0:1789265376.377091:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+56:12451:x1876180399654016:12345-192.168.203.49@tcp:34:lfs.0 00010000:00010000:3.0:1789265376.377401:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a974f1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377440:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a974f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377456:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a974f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377470:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a974f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377479:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a974f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377485:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a974f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377598:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a974ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377607:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a974ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377613:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a974ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265376.377674:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a974ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377700:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a974f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377708:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a974f1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377726:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a974f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377734:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265376.377739:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a974f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377747:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a974f1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377763:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:3.0:1789265376.377767:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265376.377773:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a974f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377779:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a974f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377797:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a974f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377804:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a974f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377810:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a974f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377815:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81491e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265376.377818:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a974f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377834:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a974f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377843:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fccacd4e700) 00010000:00010000:3.0:1789265376.377845:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265376.377848:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a974f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377853:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a974f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377865:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a974ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377872:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a974ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377878:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a974ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377882:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265376.377885:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a974ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377891:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a974ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377898:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:3.0:1789265376.377900:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265376.377903:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a974ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.377919:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a974ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265376.378129:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+56:12451:x1876180399654016:12345-192.168.203.49@tcp:34:lfs.0 Request processed in 1037us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265376.378138:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 220 00000100:00100000:1.0:1789265376.430522:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265376.430725:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399654272 00000100:00100000:0.0:1789265376.430738:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399654272 00000100:00100000:0.0:1789265376.430819:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 221 00000100:00100000:0.0:1789265376.430832:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+56:12454:x1876180399654272:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:0.0:1789265376.430858:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265376.430884:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a97506 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc0c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.430977:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a9750d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.430996:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a9750d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.431072:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a9750d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.431088:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a97514 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.431097:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a97514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.431104:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a97514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.431246:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a9751b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.431256:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a9751b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.431263:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a9751b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265376.431273:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789265376.431374:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a9750d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.431382:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a9750d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.431388:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a9750d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.431395:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265376.431407:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a9750d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.431415:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a9750d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.431429:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:0.0:1789265376.431433:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265376.431438:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a9750d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.431444:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a9750d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.431461:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a97514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.431468:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a97514 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.431474:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a97514 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.431479:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265376.431482:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a97514 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.431488:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a97514 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.431495:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fccacd4e700) 00010000:00010000:0.0:1789265376.431497:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265376.431506:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a97514 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.431513:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5600/0x9272d942b4a97514 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.431555:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a97506 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0c9 expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.431570:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a9751b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0c9 expref: 58 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.431577:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:0.0:1789265376.431772:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265376.431776:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da4400, rc 0) 00000100:00100000:0.0:1789265376.431914:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+58:12454:x1876180399654272:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 1085us (1405us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1789265376.431924:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 221 00000100:00100000:0.0:1789265376.440705:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265376.441074:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399654400 00000100:00100000:1.0:1789265376.441088:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399654400 00000100:00100000:1.0:1789265376.441165:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 222 00000100:00100000:1.0:1789265376.441177:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf4fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+58:12454:x1876180399654400:12345-192.168.203.49@tcp:54:lfs.0 00010000:00010000:1.0:1789265376.441393:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53200/0x9272d942b4a97529 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.441417:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53200/0x9272d942b4a97529 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.441454:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53200/0x9272d942b4a97529 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.441503:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53200/0x9272d942b4a97529 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.441511:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53200/0x9272d942b4a97529 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.441518:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53200/0x9272d942b4a97529 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.441524:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f53200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265376.441530:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53200/0x9272d942b4a97529 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.441538:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53200/0x9272d942b4a97529 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.441552:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:1.0:1789265376.441555:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789265376.441562:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53200/0x9272d942b4a97529 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.441568:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53200/0x9272d942b4a97529 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265376.441731:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf4fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+58:12454:x1876180399654400:12345-192.168.203.49@tcp:54:lfs.0 Request processed in 556us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265376.441741:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 222 00000100:00100000:1.0:1789265376.444444:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265376.444570:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399654656 00000100:00100000:2.0:1789265376.444583:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399654656 00000100:00100000:2.0:1789265376.444659:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 58 00000100:00100000:2.0:1789265376.444672:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+58:12454:x1876180399654656:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:2.0:1789265376.445295:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+59:12454:x1876180399654656:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 623us (864us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1789265376.445305:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 58 00000100:00100000:0.0:1789265376.524209:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265376.524342:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399654912 00000100:00100000:1.0:1789265376.524357:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399654912 00000100:00100000:1.0:1789265376.524439:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 223 00000100:00100000:1.0:1789265376.524451:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+59:12464:x1876180399654912:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1789265376.524483:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265376.524487:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789265376.524521:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a974ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0ad expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.524547:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:1.0:1789265376.524553:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265376.524571:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53200/0x9272d942b4a97530 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc0d0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.524728:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97537 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.524744:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a9751b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0c9 expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.524753:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97537 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.524793:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a9751b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0c9 expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.524810:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a9751b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0c9 expref: 59 pid: 6517 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265376.524852:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb848e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876180417530240:192.168.203.49@tcp:104: 00000100:00100000:1.0:1789265376.524972:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0a7d000 going to sleep for 11 seconds 00000100:00100000:1.0:1789265376.529062:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265376.529219:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb848e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876180417530240:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265376.529270:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97537 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265376.529346:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399655040 00000100:00100000:3.0:1789265376.529355:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399655040 00010000:00010000:3.0:1789265376.529406:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a9751b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0c9 expref: 60 pid: 6517 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265376.529457:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 99 00000100:00100000:3.0:1789265376.529468:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+60:2396:x1876180399655040:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265376.529486:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265376.529494:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a9751b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0c9 expref: 60 pid: 6517 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.529508:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a9751b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0c9 expref: 60 pid: 6517 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.529538:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4400/0x9272d942b4a9751b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0c9 expref: 60 pid: 6517 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.529558:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:3.0:1789265376.529565:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97537 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.529607:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97537 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.529616:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97537 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.529647:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265376.529722:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+59:2396:x1876180399655040:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 254us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265376.529730:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 99 00010000:00010000:1.0:1789265376.530241:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97537 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.530252:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97537 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265376.530275:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789265376.530446:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53200/0x9272d942b4a97530 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0d0 expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.530467:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97537 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0d0 expref: 59 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.530476:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:1.0:1789265376.530478:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789265376.530481:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f53400, rc 0) 00000100:00100000:1.0:1789265376.530525:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+59:12464:x1876180399654912:12345-192.168.203.49@tcp:101:bash.0 Request processed in 6077us (6332us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1789265376.530533:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 223 00000100:00100000:3.0:1789265376.534285:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265376.534569:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399655168 00000100:00100000:0.0:1789265376.534598:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399655168 00000100:00100000:0.0:1789265376.534674:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 224 00000100:00100000:0.0:1789265376.534694:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+59:12464:x1876180399655168:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1789265376.534725:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265376.534755:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a97545 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc0d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.534799:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9754c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.534833:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9754c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.534847:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9754c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.535295:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5800/0x9272d942b4a97545 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0d7 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.535317:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9754c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0d7 expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.535328:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:0.0:1789265376.535331:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789265376.535335:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5200, rc 0) 00000100:00100000:0.0:1789265376.535423:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+60:12464:x1876180399655168:12345-192.168.203.49@tcp:101:bash.0 Request processed in 740us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265376.535432:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 224 00000100:00100000:0.0:1789265376.539605:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265376.539702:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399655424 00000100:00100000:1.0:1789265376.539716:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399655424 00000100:00100000:1.0:1789265376.539786:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 225 00000100:00100000:1.0:1789265376.539798:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+60:12464:x1876180399655424:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:1.0:1789265376.540174:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53c00/0x9272d942b4a97553 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.540197:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53c00/0x9272d942b4a97553 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.540210:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53c00/0x9272d942b4a97553 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265376.540278:0:8460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:1.0:1789265376.540305:0:8460:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005506237e reply state 00000000d4bb4d23 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53c00/0x9272d942b4a97553 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.540321:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53c00/0x9272d942b4a97553 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265376.540330:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:1.0:1789265376.540333:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789265376.540337:0:8460:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789265376.540448:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+63:12464:x1876180399655424:12345-192.168.203.49@tcp:36:bash.0 Request processed in 652us (858us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1789265376.540456:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 225 00000020:00080000:1.0:1789265376.540462:0:8460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789265376.544475:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265376.544585:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399655552 00000100:00100000:2.0:1789265376.544598:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399655552 00000100:00100000:2.0:1789265376.544703:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 226 00000100:00100000:2.0:1789265376.544714:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+63:12464:x1876180399655552:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1789265376.544746:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265376.544773:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9755a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc0de expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.544893:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ea00/0x9272d942b4a97561 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.544911:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97537 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0d0 expref: 64 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.544934:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ea00/0x9272d942b4a97561 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.544979:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97537 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0d0 expref: 64 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.544995:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97537 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0d0 expref: 64 pid: 6518 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265376.545011:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876180417530368:192.168.203.49@tcp:104: 00000100:00100000:2.0:1789265376.545157:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc906d4840 going to sleep for 11 seconds 00000100:00100000:3.0:1789265376.548708:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265376.548836:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399655680 00000100:00100000:0.0:1789265376.548849:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399655680 00010000:00010000:0.0:1789265376.548904:0:7926:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97537 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0d0 expref: 65 pid: 6518 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265376.548977:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 100 00000100:00100000:0.0:1789265376.548989:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84845c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+65:2396:x1876180399655680:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265376.549007:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265376.549084:0:7926:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97537 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0d0 expref: 65 pid: 6518 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.549100:0:7926:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97537 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0d0 expref: 65 pid: 6518 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.549131:0:7926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:0.0:1789265376.549137:0:7926:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ea00/0x9272d942b4a97561 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.549149:0:7926:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ea00/0x9272d942b4a97561 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.549159:0:7926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ea00/0x9272d942b4a97561 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265376.549186:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265376.549615:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97537 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0d0 expref: 65 pid: 6518 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265376.549639:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876180417530368:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265376.549666:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ea00/0x9272d942b4a97561 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.549698:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ea00/0x9272d942b4a97561 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.549705:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ea00/0x9272d942b4a97561 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265376.549776:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789265376.549782:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265376.549809:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ea00/0x9272d942b4a97561 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.549848:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a9755a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0de expref: 65 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.549864:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ea00/0x9272d942b4a97561 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0de expref: 64 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.549872:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:2.0:1789265376.549875:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265376.549878:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2ea00, rc 0) 00000100:00100000:0.0:1789265376.549937:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84845c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+64:2396:x1876180399655680:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 949us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265376.549946:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 100 00000100:00100000:2.0:1789265376.550568:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+63:12464:x1876180399655552:12345-192.168.203.49@tcp:101:bash.0 Request processed in 5853us (6104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265376.550577:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 226 00000100:00100000:0.0:1789265376.560667:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265376.561327:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399655936 00000100:00100000:1.0:1789265376.561350:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399655936 00000100:00100000:1.0:1789265376.561423:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 59 00000100:00100000:1.0:1789265376.561434:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+63:12464:x1876180399655936:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:1.0:1789265376.561748:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+64:12464:x1876180399655936:12345-192.168.203.49@tcp:35:bash.0 Request processed in 315us (1096us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1789265376.561778:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 59 00010000:00010000:2.0:1789265376.578898:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265376.583807:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265376.583858:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265376.583905:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265376.583957:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265376.583992:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265376.584052:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399656576 00000100:00100000:1.0:1789265376.584064:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399656576 00000100:00080000:1.0:1789265376.584104:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789265376.584133:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399656192 00000100:00100000:2.0:1789265376.584140:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399656192 00000100:00100000:1.0:1789265376.584163:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399656448 00000100:00100000:1.0:1789265376.584167:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399656448 00000100:00080000:1.0:1789265376.584176:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265376.584195:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265376.584198:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 332 00000100:00100000:2.0:1789265376.584214:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2394:x1876180399656576:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265376.584221:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 333 00000100:00100000:1.0:1789265376.584245:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399656192:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265376.584340:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399656064 00000100:00100000:3.0:1789265376.584346:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399656064 00000100:00100000:3.0:1789265376.584381:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 391 00000100:00100000:3.0:1789265376.584390:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2394:x1876180399656064:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265376.584465:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2394:x1876180399656576:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 255us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265376.584474:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 332 00000100:00100000:2.0:1789265376.584497:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 334 00000100:00100000:2.0:1789265376.584504:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0e07850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2394:x1876180399656448:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265376.584532:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0e07850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2394:x1876180399656448:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 30us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265376.584538:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 334 00000100:00100000:0.0:1789265376.584569:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399656320 00000100:00100000:0.0:1789265376.584575:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399656320 00000100:00100000:0.0:1789265376.584614:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 129 00000100:00100000:0.0:1789265376.584621:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+9:2394:x1876180399656320:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265376.584656:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+9:2394:x1876180399656320:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 36us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265376.584662:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 129 00000100:00100000:1.0:1789265376.586596:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399656192:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 2337us (2620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265376.586615:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 333 00000100:00100000:2.0:1789265376.588311:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2394:x1876180399656064:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 3906us (4502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265376.588332:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 391 00000100:00100000:1.0:1789265376.644516:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265376.644666:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399656704 00000100:00100000:2.0:1789265376.644680:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399656704 00000100:00100000:2.0:1789265376.644779:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 227 00000100:00100000:2.0:1789265376.644791:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+64:12470:x1876180399656704:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1789265376.644824:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265376.644852:0:8460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a97568 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc0e5 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.644942:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e800/0x9272d942b4a9756f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.644960:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e800/0x9272d942b4a9756f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.644976:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e800/0x9272d942b4a9756f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265376.645079:0:8460:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789265376.645084:0:8460:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265376.645108:0:8460:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e800/0x9272d942b4a9756f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.645143:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a97568 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0e5 expref: 66 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.645165:0:8460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e800/0x9272d942b4a9756f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0e5 expref: 65 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.645174:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:2.0:1789265376.645178:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265376.645182:0:8460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2e800, rc 0) 00000100:00100000:2.0:1789265376.645258:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+65:12470:x1876180399656704:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 470us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265376.645268:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 227 00000100:00100000:0.0:1789265376.650647:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265376.653461:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399656832 00000100:00100000:2.0:1789265376.653487:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399656832 00000100:00100000:2.0:1789265376.653659:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 228 00000100:00100000:2.0:1789265376.653675:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+65:12470:x1876180399656832:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1789265376.653713:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265376.653742:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a97576 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc0ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.653833:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a9757d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.653888:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a9757d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.653904:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a9757d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.653918:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97584 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.653927:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97584 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.653934:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97584 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.654083:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a9758b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.654094:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a9758b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.654102:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a9758b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265376.654156:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789265376.654162:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265376.654187:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a9758b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.654213:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a9758b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.654244:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a9757d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.654251:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a9757d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.654258:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a9757d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.654265:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265376.654270:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a9757d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.654278:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a9757d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.654294:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:2.0:1789265376.654297:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265376.654302:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a9757d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.654308:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a9757d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.654322:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97584 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.654329:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97584 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.654335:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97584 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.654347:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2fc00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265376.654350:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97584 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.654357:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97584 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.654365:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fccacd4e700) 00010000:00010000:2.0:1789265376.654368:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265376.654371:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97584 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.654376:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97584 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.654409:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a97576 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0ec expref: 67 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.654424:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a9758b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0ec expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.654431:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:2.0:1789265376.654433:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265376.654435:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2f200, rc 0) 00000100:00100000:2.0:1789265376.654536:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+66:12470:x1876180399656832:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 864us (3902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265376.654545:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 228 00000100:00100000:1.0:1789265376.660427:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265376.660530:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265376.660670:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399657216 00000100:00100000:3.0:1789265376.660692:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399657216 00000100:00100000:3.0:1789265376.660778:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 17 00000100:00100000:3.0:1789265376.660801:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+66:2393:x1876180399657216:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265376.660822:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265376.660853:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a9758b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0ec expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.660877:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:3.0:1789265376.660883:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265376.661058:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+65:2393:x1876180399657216:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 234us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265376.661067:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 17 00000100:00100000:2.0:1789265376.661463:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399657088 00000100:00100000:2.0:1789265376.661478:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399657088 00000100:00100000:2.0:1789265376.661518:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 229 00000100:00100000:2.0:1789265376.661527:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+65:12470:x1876180399657088:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1789265376.661549:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265376.661570:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a97592 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc0f3 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.661727:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97599 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.661747:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ea00/0x9272d942b4a97561 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0de expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.661757:0:8459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97599 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.661796:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ea00/0x9272d942b4a97561 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0de expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.661813:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ea00/0x9272d942b4a97561 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0de expref: 66 pid: 6518 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265376.661830:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8459:1876180417530496:192.168.203.49@tcp:104: 00000100:00100000:2.0:1789265376.661906:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc906d4540 going to sleep for 11 seconds 00000100:00100000:1.0:1789265376.664914:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265376.665245:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8459:1876180417530496:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265376.665282:0:8459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97599 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265376.666773:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399657344 00000100:00100000:3.0:1789265376.666791:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399657344 00010000:00010000:3.0:1789265376.666847:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ea00/0x9272d942b4a97561 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0de expref: 67 pid: 6518 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265376.667054:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 101 00000100:00100000:3.0:1789265376.667066:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+67:2395:x1876180399657344:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265376.667084:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265376.667092:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ea00/0x9272d942b4a97561 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0de expref: 67 pid: 6518 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.667107:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ea00/0x9272d942b4a97561 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0de expref: 67 pid: 6518 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.667142:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ea00/0x9272d942b4a97561 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0de expref: 67 pid: 6518 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.667161:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:3.0:1789265376.667167:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97599 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.667179:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97599 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.667188:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97599 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.667491:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265376.667536:0:8459:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97599 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.667552:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97599 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265376.667637:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+66:2395:x1876180399657344:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 515us (2677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265376.667647:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 101 00000004:00200000:2.0:1789265376.668273:0:8459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789265376.668467:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f800/0x9272d942b4a97592 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0f3 expref: 67 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.668489:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97599 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0f3 expref: 66 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.668498:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:2.0:1789265376.668501:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789265376.668504:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2fc00, rc 0) 00000100:00100000:2.0:1789265376.668562:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+66:12470:x1876180399657088:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 7036us (8149us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789265376.668575:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 229 00000100:00100000:1.0:1789265376.674759:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265376.674996:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399657600 00000100:00100000:3.0:1789265376.675009:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399657600 00000100:00100000:3.0:1789265376.675119:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 18 00000100:00100000:3.0:1789265376.675131:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+66:12470:x1876180399657600:12345-192.168.203.49@tcp:103:lfs.0 00010000:00010000:3.0:1789265376.675150:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265376.675181:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f600/0x9272d942b4a974ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0c2 expref: 66 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.675389:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:3.0:1789265376.675396:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265376.687295:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+65:12470:x1876180399657600:12345-192.168.203.49@tcp:103:lfs.0 Request processed in 12079us (12462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265376.687315:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 18 00000100:00100000:1.0:1789265376.691882:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265376.696187:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399657728 00000100:00100000:3.0:1789265376.696207:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399657728 00000100:00100000:3.0:1789265376.696298:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 230 00000100:00100000:3.0:1789265376.696310:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+65:12470:x1876180399657728:12345-192.168.203.49@tcp:58:lfs.0 00010000:00010000:3.0:1789265376.696501:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a975a7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.696523:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a975a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265376.696548:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a975a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265376.696693:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1789265376.696838:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+65:12470:x1876180399657728:12345-192.168.203.49@tcp:58:lfs.0 Request processed in 529us (4970us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265376.696849:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 230 00000100:00100000:1.0:1789265376.701216:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265376.701665:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399657856 00000100:00100000:2.0:1789265376.701677:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399657856 00000100:00100000:2.0:1789265376.701879:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 231 00000100:00100000:2.0:1789265376.701893:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+65:12470:x1876180399657856:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1789265376.701921:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265376.701956:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a975ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc0fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.702084:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a975a7 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.702134:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a975ae lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0fa expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.702159:0:6518:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a975a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.702173:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a975ae lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0fa expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.702190:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:2.0:1789265376.702193:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265376.702197:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a975ae lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0fa expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265376.702204:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2e600, rc 0) 00000100:00100000:2.0:1789265376.702287:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+66:12470:x1876180399657856:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 397us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265376.702296:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 231 00000100:00100000:0.0:1789265376.769485:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417530624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265376.769590:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265376.769778:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417530624 00000100:00100000:3.0:1789265376.769789:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417530624 00000100:00080000:1.0:1789265376.770002:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265376.770354:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789265376.770369:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417530624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789265376.770401:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265376.770479:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417530624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265376.770487:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789265376.770801:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417530624:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1789265377.281326:0:10002:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 428511299846ns, next at 429511293410ns, rc = 0 00000100:00100000:1.0:1789265377.281348:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417530752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265377.281609:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265377.281673:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417531264:0@lo:400:kworker.0 00000100:00100000:1.0:1789265377.281728:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265377.281747:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417531776:0@lo:400:kworker.0 00000100:00100000:1.0:1789265377.281779:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265377.281799:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417532288:0@lo:400:kworker.0 00000100:00100000:1.0:1789265377.281828:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265377.281850:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789265377.281857:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417531136:0@lo:400:kworker.0 00000100:00100000:3.0:1789265377.281933:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417530752 00000100:00100000:3.0:1789265377.281944:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417530752 00000100:00100000:3.0:1789265377.282010:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789265377.282050:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876180417530752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265377.282080:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265377.282136:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876180417530752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265377.282143:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789265377.282174:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417531776 00000100:00100000:3.0:1789265377.282178:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417531776 00000100:00100000:3.0:1789265377.282215:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417532288 00000100:00100000:3.0:1789265377.282218:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417532288 00000100:00100000:3.0:1789265377.282238:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789265377.282244:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417531776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265377.282282:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417531776:12345-0@lo:400:kworker.0 Request processed in 37us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265377.282289:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789265377.282302:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789265377.282321:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417532288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265377.282353:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417532288:12345-0@lo:400:kworker.0 Request processed in 34us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265377.282360:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1789265377.282379:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265377.282723:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417530880:0@lo:400:kworker.0 00000100:00100000:2.0:1789265377.282771:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265377.282815:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417531392:0@lo:400:kworker.0 00000100:00100000:2.0:1789265377.282855:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265377.282887:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417531904:0@lo:400:kworker.0 00000100:00100000:2.0:1789265377.282912:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265377.282948:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789265377.282955:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417531008:0@lo:400:kworker.0 00000100:00100000:2.0:1789265377.282979:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265377.282997:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417531520:0@lo:400:kworker.0 00000100:00100000:2.0:1789265377.283017:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265377.283056:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876180417532032:0@lo:400:kworker.0 00000100:00100000:2.0:1789265377.283079:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265377.283115:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417531264 00000100:00100000:2.0:1789265377.283121:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417531264 00000100:00100000:2.0:1789265377.283161:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789265377.283169:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb0923450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417531264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265377.283212:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb0923450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417531264:12345-0@lo:400:kworker.0 Request processed in 43us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265377.283227:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789265377.283612:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417531904 00000100:00100000:2.0:1789265377.283617:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417531904 00000100:00100000:2.0:1789265377.283650:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789265377.283657:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3641:x1876180417531904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265377.283710:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3641:x1876180417531904:12345-0@lo:400:kworker.0 Request processed in 54us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265377.283717:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789265377.283763:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417531904:0@lo:400:kworker.0 00000100:00100000:2.0:1789265377.283790:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417531392 00000100:00100000:2.0:1789265377.283794:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417531392 00000100:00100000:2.0:1789265377.283822:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417531008 00000100:00100000:2.0:1789265377.283826:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417531008 00000100:00100000:2.0:1789265377.283839:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417531520 00000100:00100000:2.0:1789265377.283850:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417531520 00000100:00100000:2.0:1789265377.283871:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417532032 00000100:00100000:2.0:1789265377.283874:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417532032 00000100:00100000:2.0:1789265377.283891:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789265377.283897:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417531392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265377.283937:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417531392:12345-0@lo:400:kworker.0 Request processed in 40us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265377.283945:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789265377.283958:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1789265377.283964:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417531008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265377.283993:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417531008:12345-0@lo:400:kworker.0 Request processed in 29us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265377.283999:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1789265377.284011:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1789265377.284018:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417531520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265377.284073:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417531520:12345-0@lo:400:kworker.0 Request processed in 56us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265377.284080:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1789265377.284093:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789265377.284099:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876180417532032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265377.284127:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876180417532032:12345-0@lo:400:kworker.0 Request processed in 28us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265377.284133:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789265377.284162:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417531008:0@lo:400:kworker.0 00000100:00100000:2.0:1789265377.284173:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417531520:0@lo:400:kworker.0 00000100:00100000:2.0:1789265377.284197:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876180417532032:0@lo:400:kworker.0 00000100:00100000:2.0:1789265377.284208:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417531392:0@lo:400:kworker.0 00000100:00100000:3.0:1789265377.284634:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417530880 00000100:00100000:3.0:1789265377.284641:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417530880 00000100:00100000:3.0:1789265377.284697:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1789265377.284705:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3641:x1876180417530880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265377.284982:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3641:x1876180417530880:12345-0@lo:400:kworker.0 Request processed in 278us (2210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265377.284991:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00080000:3.0:1789265377.285055:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265377.285062:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265377.287787:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417530880:0@lo:400:kworker.0 00000100:00100000:1.0:1789265377.288956:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265377.289046:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417531648:0@lo:400:kworker.0 00000100:00100000:3.0:1789265377.289169:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417531136 00000100:00100000:3.0:1789265377.289183:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417531136 00000100:00100000:1.0:1789265377.289797:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265377.289834:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180417532160:0@lo:400:kworker.0 00000100:00100000:1.0:1789265377.289862:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265377.289911:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417531264:0@lo:400:kworker.0 00000100:00100000:1.0:1789265377.289926:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417531776:0@lo:400:kworker.0 00000100:00100000:1.0:1789265377.289938:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417532288:0@lo:400:kworker.0 00000100:00100000:1.0:1789265377.289961:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417530752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265377.290150:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789265377.290166:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417531136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265377.290297:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417531136:12345-0@lo:400:kworker.0 Request processed in 135us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265377.290311:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789265377.290311:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417531136:0@lo:400:kworker.0 00000100:00100000:2.0:1789265377.290577:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417531648 00000100:00100000:2.0:1789265377.290586:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417531648 00000100:00100000:2.0:1789265377.290667:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417532160 00000100:00100000:2.0:1789265377.290671:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417532160 00000100:00100000:2.0:1789265377.290708:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789265377.290716:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417531648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265377.290767:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417531648:12345-0@lo:400:kworker.0 Request processed in 52us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265377.290774:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789265377.290790:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1789265377.290797:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180417532160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265377.290828:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180417532160:12345-0@lo:400:kworker.0 Request processed in 32us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265377.290835:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00080000:3.0:1789265377.290963:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789265377.291325:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb84847100 x1876180417531648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265377.291343:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417531648:0@lo:400:kworker.0 00010000:00080000:1.0:1789265377.291383:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb84844380 x1876180417532160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265377.291394:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180417532160:0@lo:400:kworker.0 00010000:00010000:0.0:1789265377.601298:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789265377.604184:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789265377.604198:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789265377.604242:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1789265377.604256:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789265377.604459:0:13799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1876180417532416:192.168.203.49@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789265377.604604:0:13799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c48840 going to sleep for 11 seconds 00000100:00100000:1.0:1789265377.612923:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265377.613074:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399657984 00000100:00100000:0.0:1789265377.613086:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399657984 00000100:00100000:0.0:1789265377.613194:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 232 00000100:00100000:0.0:1789265377.613206:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+67:12471:x1876180399657984:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789265377.613261:0:8460:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789265377.613421:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+67:12471:x1876180399657984:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 Request processed in 215us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265377.613430:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 232 00000100:00100000:3.0:1789265377.613545:0:13799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1876180417532416:192.168.203.49@tcp:107:hsm_cdtr.0 00000100:00080000:1.0:1789265377.614237:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265377.625264:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265377.625766:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399658112 00000100:00100000:0.0:1789265377.625781:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399658112 00000100:00100000:0.0:1789265377.625870:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 233 00000100:00100000:0.0:1789265377.625884:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+66:12471:x1876180399658112:12345-192.168.203.49@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789265377.625991:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a975b5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.626284:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a975b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.626301:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a975b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.626323:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a975bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.626330:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a975bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.626338:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a975bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.626370:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a975c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.626380:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a975c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.626388:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a975c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265377.626450:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789265377.626456:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265377.626474:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a975c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.626488:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a975b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.626505:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a975b5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.626513:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a975b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.626520:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4c00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265377.626525:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a975b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.626534:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a975b5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.626549:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fccbd2b4c00) 00010000:00010000:0.0:1789265377.626553:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265377.626560:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a975b5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.626566:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a975b5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.628201:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a975bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.628323:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a975bc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.628331:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a975bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.628338:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265377.628366:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a975bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.628375:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a975bc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.628396:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9fcca9677700) 00010000:00010000:0.0:1789265377.628400:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265377.628405:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a975bc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.628412:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a975bc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.628453:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a975c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.628459:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a975c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.628464:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a975c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.628469:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265377.628472:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a975c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.628478:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a975c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.628485:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:0.0:1789265377.628488:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265377.628498:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a975c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.628505:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a975c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265377.629116:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+66:12471:x1876180399658112:12345-192.168.203.49@tcp:34:lhsmtool_posix.0 Request processed in 3228us (3857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265377.629129:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 233 00000100:00100000:1.0:1789265377.644827:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265377.645623:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399658368 00000100:00100000:2.0:1789265377.645648:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399658368 00000100:00100000:2.0:1789265377.645774:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 234 00000100:00100000:2.0:1789265377.645793:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+66:12471:x1876180399658368:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265377.645832:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265377.645872:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a975ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc101 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.646098:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f400/0x9272d942b4a975d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.646139:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f400/0x9272d942b4a975d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.646156:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f400/0x9272d942b4a975d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265377.646176:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789265377.646453:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f400/0x9272d942b4a975d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.646461:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f400/0x9272d942b4a975d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.646468:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f400/0x9272d942b4a975d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.646474:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265377.646478:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f400/0x9272d942b4a975d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.646486:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f400/0x9272d942b4a975d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.646502:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:2.0:1789265377.646506:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789265377.646511:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f400/0x9272d942b4a975d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.646517:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f400/0x9272d942b4a975d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.646570:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a975ca lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc101 expref: 68 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.646589:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fccbd2b4c00) 00010000:00010000:2.0:1789265377.646592:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265377.646596:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a975ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc101 expref: 68 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.646606:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2fa00, rc 0) 00000100:00100000:2.0:1789265377.646701:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+67:12471:x1876180399658368:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 913us (1890us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1789265377.646710:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 234 00000100:00100000:1.0:1789265377.650310:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265377.650469:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399658496 00000100:00100000:2.0:1789265377.650482:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399658496 00000100:00100000:2.0:1789265377.650559:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 235 00000100:00100000:2.0:1789265377.650572:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+67:12471:x1876180399658496:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789265377.650618:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789265377.650777:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+67:12471:x1876180399658496:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 Request processed in 208us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265377.650786:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 235 00000100:00100000:1.0:1789265377.655781:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265377.655944:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399658752 00000100:00100000:0.0:1789265377.655957:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399658752 00000100:00100000:0.0:1789265377.656072:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 236 00000100:00100000:0.0:1789265377.656085:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+67:12471:x1876180399658752:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265377.656112:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265377.656116:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789265377.656151:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e800/0x9272d942b4a9756f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0e5 expref: 67 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.656176:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:0.0:1789265377.656182:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265377.656200:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a975df lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc108 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789265377.656737:0:6518:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:0.0:1789265377.656913:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a975e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.656930:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a975e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.656969:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a975e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.657111:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a975df lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc108 expref: 69 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.657131:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a975e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc108 expref: 68 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.657141:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fcca9677700) 00010000:00010000:0.0:1789265377.657144:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265377.657148:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5000, rc 0) 00000100:00100000:0.0:1789265377.657224:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+68:12471:x1876180399658752:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 1142us (1458us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1789265377.657233:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 236 00000100:00100000:1.0:1789265377.662373:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265377.663078:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399659008 00000100:00100000:3.0:1789265377.663094:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399659008 00000100:00100000:3.0:1789265377.663177:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 237 00000100:00100000:3.0:1789265377.663189:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+68:12471:x1876180399659008:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789265377.663269:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265377.663303:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5000/0x9272d942b4a975e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc108 expref: 68 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.663325:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fcca9677700) 00010000:00010000:3.0:1789265377.663352:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265377.663384:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a975f4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.663400:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a975f4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.663412:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a975f4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.663430:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a975fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x9ea72c2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.663437:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a975fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x9ea72c2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.663444:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a975fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x9ea72c2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.663527:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a975f4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.663538:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a975f4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.663545:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a975f4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.663551:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81491e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265377.663556:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a975f4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.663564:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a975f4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.663574:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:3.0:1789265377.663577:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265377.663842:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a975f4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.663851:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a975f4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.663866:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a975fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x9ea72c2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.663873:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a975fb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9ea72c2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.663879:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a975fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9ea72c2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.663893:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265377.663897:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a975fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9ea72c2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.663903:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a975fb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9ea72c2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.663913:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x9ea72c2f (ffff9fcca967b700) 00010000:00010000:3.0:1789265377.663915:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265377.663918:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a975fb lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x9ea72c2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.663924:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a975fb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x9ea72c2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265377.664087:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+67:12471:x1876180399659008:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 Request processed in 899us (1728us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789265377.664096:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 237 00000100:00100000:1.0:1789265377.673973:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265377.674165:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399659136 00000100:00100000:0.0:1789265377.674180:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399659136 00000100:00100000:0.0:1789265377.674280:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 238 00000100:00100000:0.0:1789265377.674293:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+67:12471:x1876180399659136:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265377.674324:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265377.674361:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a97602 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc10f expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.674417:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a97609 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.674437:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a97609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.674471:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a97609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.674634:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4200/0x9272d942b4a97602 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc10f expref: 69 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.674661:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a97609 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc10f expref: 68 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.674672:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fcca9677a00) 00010000:00010000:0.0:1789265377.674685:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789265377.674690:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da4c00, rc 0) 00000100:00100000:0.0:1789265377.674776:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+68:12471:x1876180399659136:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 485us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265377.674784:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 238 00000100:00100000:1.0:1789265377.680261:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265377.680422:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399659392 00000100:00100000:2.0:1789265377.680435:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399659392 00000100:00100000:2.0:1789265377.680518:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 239 00000100:00100000:2.0:1789265377.680531:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+68:12471:x1876180399659392:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789265377.680668:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97610 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.680698:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97610 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.680733:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97610 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265377.680964:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1789265377.680977:0:6517:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 428910953465ns, next at 429910949880ns, rc = 0 00000004:00010000:2.0:1789265377.681524:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001699648f reply state 0000000039ea5093 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97610 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.681542:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97610 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.681552:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fcca9677a00) 00010000:00010000:2.0:1789265377.681555:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789265377.681561:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265377.681727:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+70:12471:x1876180399659392:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 Request processed in 1195us (1477us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1789265377.681738:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 239 00000100:00100000:1.0:1789265377.684598:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265377.684703:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399659520 00000100:00100000:3.0:1789265377.684716:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399659520 00000100:00100000:3.0:1789265377.684825:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 240 00000100:00100000:3.0:1789265377.684838:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+70:12471:x1876180399659520:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265377.684868:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265377.684896:0:8460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a97617 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc116 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.684985:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a97617 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc116 expref: 71 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.685061:0:8460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a97617 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc116 expref: 71 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.685088:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fcca9677a00) 00010000:00010000:3.0:1789265377.685091:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789265377.685096:0:8460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81490200, rc 0) 00000100:00100000:3.0:1789265377.685164:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+71:12471:x1876180399659520:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 329us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265377.685174:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 240 00000100:00100000:1.0:1789265377.696355:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265377.696560:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399659648 00000100:00100000:0.0:1789265377.696573:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399659648 00000100:00100000:0.0:1789265377.696727:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 70 00000100:00100000:0.0:1789265377.696739:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+9:2396:x1876180399659648:12345-192.168.203.49@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789265377.697090:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+10:2396:x1876180399659648:12345-192.168.203.49@tcp:2:lhsmtool_posix.0 Request processed in 352us (752us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789265377.697099:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 70 00000100:00100000:2.0:1789265377.700536:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265377.700654:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399659904 00000100:00100000:3.0:1789265377.700667:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399659904 00000100:00100000:3.0:1789265377.700749:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 60 00000100:00100000:3.0:1789265377.700762:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+71:12471:x1876180399659904:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789265377.701136:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+72:12471:x1876180399659904:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 Request processed in 375us (614us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1789265377.701144:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 60 00000100:00080000:1.0:1789265377.702305:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265377.703870:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265377.704290:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399660160 00000100:00100000:2.0:1789265377.704305:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399660160 00000100:00100000:2.0:1789265377.704389:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 241 00000100:00100000:2.0:1789265377.704402:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+72:12471:x1876180399660160:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789265377.704566:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+72:12471:x1876180399660160:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 Request processed in 167us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265377.704574:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 241 00000100:00100000:2.0:1789265377.707365:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265377.707545:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399660288 00000100:00100000:1.0:1789265377.707557:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399660288 00000100:00100000:1.0:1789265377.707751:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 242 00000100:00100000:1.0:1789265377.707766:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+72:12471:x1876180399660288:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265377.707793:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265377.707821:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52e00/0x9272d942b4a9761e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc11d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265377.707916:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52a00/0x9272d942b4a97625 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265377.707945:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52a00/0x9272d942b4a97625 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265377.707984:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52a00/0x9272d942b4a97625 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265377.708133:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789265377.708158:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52a00/0x9272d942b4a97625 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265377.708190:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52e00/0x9272d942b4a9761e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc11d expref: 74 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265377.708214:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52a00/0x9272d942b4a97625 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc11d expref: 73 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265377.708293:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fcca9677a00) 00010000:00010000:1.0:1789265377.708296:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789265377.708300:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f52a00, rc 0) 00000100:00100000:1.0:1789265377.708427:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+73:12471:x1876180399660288:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 665us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265377.708437:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 242 00000100:00100000:0.0:1789265377.711482:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265377.711570:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399660416 00000100:00100000:2.0:1789265377.711601:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399660416 00000100:00100000:2.0:1789265377.711671:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 71 00000100:00100000:2.0:1789265377.711692:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+10:2396:x1876180399660416:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265377.711716:0:8914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265377.711744:0:8914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081f97a95/0x9272d942b4a9762c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc124 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265377.711775:0:8914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa605e2, blocks: 0x0 00010000:00010000:2.0:1789265377.711802:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1789265377.711808:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265377.711819:0:8914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081f97a95/0x9272d942b4a9762c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc124 expref: 11 pid: 8914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.711840:0:8914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000081f97a95/0x9272d942b4a9762c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc124 expref: 11 pid: 8914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.711857:0:8914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2e200, rc 0) 00000100:00100000:2.0:1789265377.712226:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+11:2396:x1876180399660416:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 526us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265377.712235:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 71 00000100:00100000:0.0:1789265377.715462:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265377.715572:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399660672 00000100:00100000:3.0:1789265377.715586:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399660672 00000100:00100000:3.0:1789265377.715663:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 243 00000100:00100000:3.0:1789265377.715674:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+73:12471:x1876180399660672:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789265377.715828:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+73:12471:x1876180399660672:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 Request processed in 155us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265377.715836:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 243 00000100:00100000:2.0:1789265377.718623:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265377.718832:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399660800 00000100:00100000:0.0:1789265377.718845:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399660800 00000100:00100000:0.0:1789265377.718936:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 72 00000100:00100000:0.0:1789265377.718958:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+11:12471:x1876180399660800:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265377.718983:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265377.719007:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97633 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc12b expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.719091:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081f97a95/0x9272d942b4a9762c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc124 expref: 12 pid: 8914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.719102:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265377.719107:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265377.719113:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97633 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc12b expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.719158:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081f97a95/0x9272d942b4a9762c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc124 expref: 12 pid: 8914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.719175:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081f97a95/0x9272d942b4a9762c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc124 expref: 12 pid: 8914 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265377.719191:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91423100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1876180417532544:192.168.203.49@tcp:104: 00000100:00100000:0.0:1789265377.719474:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c27180 going to sleep for 11 seconds 00000100:00100000:2.0:1789265377.722572:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91423100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1876180417532544:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265377.722622:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97633 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc12b expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.722651:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5400, rc 0) 00000100:00100000:2.0:1789265377.722762:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+12:12471:x1876180399660800:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 3805us (4149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265377.722774:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 72 00000100:00100000:1.0:1789265377.725884:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265377.726064:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399660928 00000100:00100000:0.0:1789265377.726077:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399660928 00010000:00010000:0.0:1789265377.726138:0:7926:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081f97a95/0x9272d942b4a9762c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc124 expref: 12 pid: 8914 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265377.726207:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 102 00000100:00100000:0.0:1789265377.726232:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+12:2394:x1876180399660928:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265377.726254:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265377.726285:0:7926:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081f97a95/0x9272d942b4a9762c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc124 expref: 12 pid: 8914 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.726302:0:7926:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081f97a95/0x9272d942b4a9762c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc124 expref: 12 pid: 8914 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.726333:0:7926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081f97a95/0x9272d942b4a9762c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc124 expref: 12 pid: 8914 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.726356:0:7926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265377.726362:0:7926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265377.726372:0:7926:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97633 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc12b expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.726384:0:7926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97633 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc12b expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.726436:0:7926:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97633 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc12b expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265377.726455:0:7926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91423800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7926:1876180417532672:192.168.203.49@tcp:105: 00000100:00100000:0.0:1789265377.726577:0:7926:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c27cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265377.729558:0:7926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91423800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7926:1876180417532672:192.168.203.49@tcp:105: 00010000:00010000:3.0:1789265377.729593:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265377.729666:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+11:2394:x1876180399660928:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 3449us (3798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265377.729689:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 102 00000100:00100000:1.0:1789265377.733446:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265377.733735:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399661056 00000100:00100000:3.0:1789265377.733749:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399661056 00002000:00100000:3.0:1789265377.733818:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9fccbd3e7480 x1876180399661056/t0(0) o4->5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp:703/0 lens 504/0 e 0 to 0 dl 1789265388 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265377.733830:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fccbd3e7480 with x1876180399661056 ext(0->12) 00002000:00010000:3.0:1789265377.733836:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fccbd3e7480 00000100:00100000:3.0:1789265377.733876:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 6 00000100:00100000:3.0:1789265377.733887:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5b43750b-84cf-4d62-9028-e016267b6509+11:2395:x1876180399661056:12345-192.168.203.49@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789265377.735936:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5b43750b-84cf-4d62-9028-e016267b6509+13:2395:x1876180399661056:12345-192.168.203.49@tcp:4:lhsmtool_posix.0 Request processed in 2036us (2489us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789265377.735953:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 6 00002000:00100000:2.0:1789265377.735967:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9fccbd3e7480 x1876180399661056/t4294967321(0) o4->5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp:703/0 lens 504/448 e 0 to 0 dl 1789265388 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789265377.735978:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fccbd3e7480 with x1876180399661056 ext(0->12) 00002000:00010000:2.0:1789265377.735985:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fccbd3e7480 00000100:00100000:1.0:1789265377.738669:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265377.738776:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399661184 00000100:00100000:3.0:1789265377.738794:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399661184 00000100:00100000:3.0:1789265377.738877:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 244 00000100:00100000:3.0:1789265377.738889:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+73:12471:x1876180399661184:12345-192.168.203.49@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789265377.751603:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:2.0:1789265377.751625:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:2.0:1789265377.751652:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:2.0:1789265377.751695:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1789265377.751704:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fcca9528780 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1789265377.751709:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fcb83e70000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fccae763b40 00000020:00080000:2.0:1789265377.751712:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fcb83e70c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fcb83c36e00 00000004:00080000:2.0:1789265377.751733:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1789265377.751760:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fccae763a80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1789265377.751764:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fcb82b7d800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fccae763600 00000020:00080000:2.0:1789265377.751766:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fcb82b7de00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fcb83d0fa00 00010000:00010000:0.0:1789265377.751861:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a97338 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.751874:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a97338 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.751883:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a97338 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.751888:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5a00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265377.751892:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a97338 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.751899:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a97338 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.751915:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fcb83b86300) 00010000:00010000:0.0:1789265377.751918:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265377.751923:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a97338 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.751930:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5a00/0x9272d942b4a97338 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.751964:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a973e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.751969:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a973e0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.751974:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a973e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.751995:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fe000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265377.751998:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a973e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752003:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a973e0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752012:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fcca9677d00) 00010000:00010000:0.0:1789265377.752077:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265377.752082:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a973e0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752089:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe000/0x9272d942b4a973e0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752117:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a9745e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752124:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a9745e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752131:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a9745e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265377.752204:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265377.752234:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417532800:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789265377.752334:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265377.752416:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417532800 00010000:00010000:0.0:1789265377.752428:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff400 already unused, calling callback (ffffffffc17a14f0) 00000100:00100000:3.0:1789265377.752429:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417532800 00010000:00010000:0.0:1789265377.752436:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a9745e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752445:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a9745e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752471:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fccacd4e700) 00010000:00010000:0.0:1789265377.752474:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265377.752478:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a9745e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752484:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff400/0x9272d942b4a9745e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752503:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53000/0x9272d942b4a97481 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265377.752656:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417532928:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789265377.752728:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789265377.752752:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53000/0x9272d942b4a97481 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752758:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53000/0x9272d942b4a97481 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752763:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f53000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265377.752766:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53000/0x9272d942b4a97481 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752772:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53000/0x9272d942b4a97481 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752780:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fccacd4e700) 00010000:00010000:0.0:1789265377.752782:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265377.752785:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53000/0x9272d942b4a97481 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752791:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53000/0x9272d942b4a97481 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752821:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53c00/0x9272d942b4a97553 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752827:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53c00/0x9272d942b4a97553 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752833:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53c00/0x9272d942b4a97553 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752838:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f53c00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265377.752841:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53c00/0x9272d942b4a97553 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752848:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53c00/0x9272d942b4a97553 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752857:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:0.0:1789265377.752859:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265377.752862:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53c00/0x9272d942b4a97553 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752867:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53c00/0x9272d942b4a97553 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752878:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97610 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752884:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97610 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752889:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97610 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752901:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2fa00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265377.752904:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97610 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752910:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97610 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752918:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fcca9677a00) 00010000:00010000:0.0:1789265377.752921:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789265377.752924:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97610 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.752930:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97610 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789265377.752949:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1789265377.753005:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1789265377.754811:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417533056:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789265377.755483:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+21:12471:x1876180399661184:12345-192.168.203.49@tcp:44:lhsmtool_posix.0 Request processed in 16592us (16818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265377.755494:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 244 00000100:00100000:0.0:1789265377.758416:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265377.761550:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417532928 00000100:00100000:3.0:1789265377.761571:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417532928 00000100:00100000:3.0:1789265377.761668:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789265377.761692:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180417532800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789265377.761754:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:3.0:1789265377.761802:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa605e0, atime: 0x6aa605e0, ctime: 0x6aa605e0, blocks: 0x8 00010000:00010000:3.0:1789265377.761812:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001664e76/0x9272d942b4a9763a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.761836:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789265377.761842:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265377.761850:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001664e76/0x9272d942b4a9763a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.761872:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001664e76/0x9272d942b4a9763a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.761885:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001664e76/0x9272d942b4a9763a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.761894:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001664e76/0x9272d942b4a9763a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.761920:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789265377.763552:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3642:x1876180417532800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1859us (11202us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789265377.763572:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789265377.763631:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789265377.763650:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180417532928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789265377.763696:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:3.0:1789265377.763751:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b76d190/0x9272d942b4a97641 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.763780:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000053508460/0x9272d942b4a973ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc083 expref: 12 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.763791:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789265377.763797:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265377.763804:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b76d190/0x9272d942b4a97641 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789265377.763991:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fcb84847480/2, rc 0, transno 4294967311 00000100:00100000:1.0:1789265377.764002:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417532800:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789265377.764396:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000053508460/0x9272d942b4a973ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc083 expref: 12 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.764417:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000053508460/0x9272d942b4a973ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc083 expref: 12 pid: 8434 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265377.764434:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8435:1876180417533184:192.168.203.49@tcp:104: 00000100:00100000:3.0:1789265377.764536:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c48900 going to sleep for 11 seconds 00010000:00010000:0.0:1789265377.766828:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265377.766844:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001664e76/0x9272d942b4a9763a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.766859:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81491e00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265377.766864:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001664e76/0x9272d942b4a9763a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.766876:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001664e76/0x9272d942b4a9763a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.766914:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001664e76/0x9272d942b4a9763a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.766922:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001664e76/0x9272d942b4a9763a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.766946:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265377.766948:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265377.766950:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265377.767004:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417533056 00000100:00100000:2.0:1789265377.767040:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417533056 00000100:00100000:2.0:1789265377.767101:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789265377.767116:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3643:x1876180417533056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789265377.767125:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00002000:00010000:2.0:1789265377.767249:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789265377.767253:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789265378 00002000:00010000:2.0:1789265377.767256:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789265377.767257:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789265378 -> 1789265378 00002000:00010000:2.0:1789265377.767259:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789265377.767334:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3643:x1876180417533056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 224us (8924us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1789265377.767342:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789265377.767359:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399661312 00000100:00100000:2.0:1789265377.767363:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399661312 00000100:00100000:2.0:1789265377.767380:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 76 00000100:00100000:2.0:1789265377.767387:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+13:2396:x1876180399661312:12345-192.168.203.49@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1789265377.767796:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fccbd3e7b80/2, rc 0, transno 4294967322 00000100:00100000:1.0:1789265377.767810:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417533056:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789265377.768650:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8435:1876180417533184:192.168.203.49@tcp:104: 00010000:00010000:3.0:1789265377.768691:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005b76d190/0x9272d942b4a97641 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265377.770979:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265377.771074:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399661440 00000100:00100000:0.0:1789265377.771084:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399661440 00010000:00010000:0.0:1789265377.771121:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000053508460/0x9272d942b4a973ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc083 expref: 14 pid: 8434 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265377.771158:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 103 00000100:00100000:0.0:1789265377.771167:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+14:2396:x1876180399661440:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265377.771182:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265377.771188:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 0000000053508460/0x9272d942b4a973ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc083 expref: 14 pid: 8434 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.771202:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000053508460/0x9272d942b4a973ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc083 expref: 14 pid: 8434 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.771228:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053508460/0x9272d942b4a973ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc083 expref: 14 pid: 8434 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.771263:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1789265377.771268:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265377.771274:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005b76d190/0x9272d942b4a97641 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.771283:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b76d190/0x9272d942b4a97641 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.771365:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265377.771415:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+13:2396:x1876180399661440:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 249us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265377.771424:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 103 00010000:00010000:1.0:1789265377.773604:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005b76d190/0x9272d942b4a97641 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265377.773626:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b76d190/0x9272d942b4a97641 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265377.773637:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b76d190/0x9272d942b4a97641 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265377.773645:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b76d190/0x9272d942b4a97641 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265377.773670:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:0.0:1789265377.773671:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00010000:00010000:2.0:1789265377.773710:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265377.773716:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b76d190/0x9272d942b4a97641 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.773724:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81491000 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265377.773728:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b76d190/0x9272d942b4a97641 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.773737:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b76d190/0x9272d942b4a97641 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.773756:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b76d190/0x9272d942b4a97641 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.773773:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b76d190/0x9272d942b4a97641 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.773796:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265377.773798:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265377.773800:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789265377.773827:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:2.0:1789265377.774449:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+7:2396:x1876180399661312:12345-192.168.203.49@tcp:16:lhsmtool_posix.0 Request processed in 7057us (7336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265377.774460:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 76 00000100:00100000:1.0:1789265377.774831:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180417532928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11188us (22101us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1789265377.774839:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789265377.775463:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1789265377.775471:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:3.0:1789265377.775492:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fccbd3e7b80, transno 4294967322 00000100:00100000:3.0:1789265377.775561:0:3642:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9fccbd3e7800 x1876180417532928/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789265393 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789265377.775574:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fccbd3e7800/2, rc 0, transno 4294967323 00000100:00100000:3.0:1789265377.775775:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417532928:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789265377.781688:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265377.782607:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399661696 00000100:00100000:2.0:1789265377.782621:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399661696 00000100:00100000:2.0:1789265377.782749:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 245 00000100:00100000:2.0:1789265377.782760:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+21:12471:x1876180399661696:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789265377.782816:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265377.782845:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52a00/0x9272d942b4a97625 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc11d expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.782864:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fcca9677a00) 00010000:00010000:2.0:1789265377.782869:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265377.782904:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97648 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.782918:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97648 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.782929:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97648 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265377.783102:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd790b97 reply state 000000004a225f7d transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97648 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.783116:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97648 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.783122:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fcca9677a00) 00010000:00010000:2.0:1789265377.783125:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789265377.783128:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265377.783371:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+22:12471:x1876180399661696:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 Request processed in 612us (1707us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1789265377.783380:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 245 00000100:00100000:0.0:1789265377.790448:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265377.790553:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399661824 00000100:00100000:3.0:1789265377.790562:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399661824 00000100:00100000:3.0:1789265377.790651:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 77 00000100:00100000:3.0:1789265377.790661:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+7:2395:x1876180399661824:12345-192.168.203.49@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789265377.790827:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789265377.790831:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1789265378 -> 1789265377 00002000:00010000:3.0:1789265377.790834:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789265376 00002000:00010000:3.0:1789265377.790836:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789265378 -> 1789265377 00002000:00010000:3.0:1789265377.790838:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789265377.790902:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+8:2395:x1876180399661824:12345-192.168.203.49@tcp:2:lhsmtool_posix.0 Request processed in 243us (461us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1789265377.790910:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 77 00000100:00100000:1.0:1789265377.797398:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265377.797710:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399662080 00000100:00100000:2.0:1789265377.797721:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399662080 00000100:00100000:2.0:1789265377.797792:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 246 00000100:00100000:2.0:1789265377.797803:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+22:12471:x1876180399662080:12345-192.168.203.49@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789265377.797987:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a9764f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.798005:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a97609 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc10f expref: 22 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.798015:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a9764f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.798090:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a97609 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc10f expref: 22 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.798122:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a97609 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc10f expref: 22 pid: 8459 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265377.798430:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876180417533312:192.168.203.49@tcp:104: 00000100:00100000:2.0:1789265377.798527:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc906d4540 going to sleep for 11 seconds 00000100:00100000:2.0:1789265377.801905:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876180417533312:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265377.801935:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a9764f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265377.808899:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265377.809383:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399662208 00000100:00100000:3.0:1789265377.809394:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399662208 00010000:00010000:3.0:1789265377.809561:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a97609 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc10f expref: 23 pid: 8459 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265377.809658:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 104 00000100:00100000:3.0:1789265377.809670:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+23:2396:x1876180399662208:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265377.809695:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265377.809704:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a97609 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc10f expref: 23 pid: 8459 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.809735:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a97609 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc10f expref: 23 pid: 8459 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.809758:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a97609 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc10f expref: 23 pid: 8459 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.809774:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fcca9677a00) 00010000:00010000:3.0:1789265377.809781:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a9764f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.809790:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a9764f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.809798:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a9764f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.809834:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265377.809897:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+22:2396:x1876180399662208:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 229us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265377.809905:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 104 00010000:00010000:2.0:1789265377.809975:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a9764f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.809983:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a9764f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.810018:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a9764f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.810045:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a9764f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.810052:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a9764f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.810058:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2ec00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265377.810063:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a9764f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.810081:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a9764f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.810091:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fcca9677a00) 00010000:00010000:2.0:1789265377.810094:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789265377.810098:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a9764f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.810104:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a9764f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265377.810145:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+21:12471:x1876180399662080:12345-192.168.203.49@tcp:55:lhsmtool_posix.0 Request processed in 12344us (12757us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789265377.810153:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 246 00000100:00100000:1.0:1789265377.817083:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265377.817171:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399662336 00000100:00100000:2.0:1789265377.817180:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399662336 00000100:00100000:2.0:1789265377.817247:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 78 00000100:00100000:2.0:1789265377.817258:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb5fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+8:2395:x1876180399662336:12345-192.168.203.49@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789265377.817302:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009661a421/0x9272d942b4a97656 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.817324:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97633 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc12b expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.817333:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789265377.817338:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265377.817342:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009661a421/0x9272d942b4a97656 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.817393:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97633 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc12b expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.817413:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97633 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc12b expref: 8 pid: 8433 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265377.817430:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8434:1876180417533440:192.168.203.49@tcp:104: 00000100:00100000:2.0:1789265377.817591:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc906d4540 going to sleep for 11 seconds 00000100:00100000:2.0:1789265377.826175:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8434:1876180417533440:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265377.826202:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009661a421/0x9272d942b4a97656 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265377.833739:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265377.836360:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399662464 00000100:00100000:0.0:1789265377.836375:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399662464 00010000:00010000:0.0:1789265377.836427:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97633 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc12b expref: 9 pid: 8433 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265377.836473:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 105 00000100:00100000:0.0:1789265377.836483:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+9:2395:x1876180399662464:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265377.836566:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265377.836652:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97633 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc12b expref: 9 pid: 8433 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.836700:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97633 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc12b expref: 9 pid: 8433 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.836726:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97633 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc12b expref: 9 pid: 8433 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.836743:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265377.836748:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265377.836753:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009661a421/0x9272d942b4a97656 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.836763:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009661a421/0x9272d942b4a97656 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.837615:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265377.837694:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+8:2395:x1876180399662464:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 1209us (3961us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265377.837703:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 105 00010000:00010000:2.0:1789265377.844350:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009661a421/0x9272d942b4a97656 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.844371:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009661a421/0x9272d942b4a97656 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.844401:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009661a421/0x9272d942b4a97656 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.844409:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009661a421/0x9272d942b4a97656 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.844441:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009661a421/0x9272d942b4a97656 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.844449:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2ec00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265377.844454:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009661a421/0x9272d942b4a97656 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.844462:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009661a421/0x9272d942b4a97656 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.844483:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009661a421/0x9272d942b4a97656 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.844500:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009661a421/0x9272d942b4a97656 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265377.844612:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb5fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b43750b-84cf-4d62-9028-e016267b6509+7:2395:x1876180399662336:12345-192.168.203.49@tcp:1:lhsmtool_posix.0 Request processed in 27351us (27534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265377.844621:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 78 00000100:00100000:1.0:1789265377.856214:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265377.856295:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399662720 00000100:00100000:2.0:1789265377.856304:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399662720 00000100:00100000:2.0:1789265377.856363:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 247 00000100:00100000:2.0:1789265377.856374:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+21:12471:x1876180399662720:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789265377.856457:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a9765d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.856485:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9754c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0d7 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.856504:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a9765d lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.856539:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9754c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0d7 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.856553:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9754c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0d7 expref: 21 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265377.856567:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876180417533568:192.168.203.49@tcp:104: 00000100:00100000:2.0:1789265377.856663:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc906d4540 going to sleep for 11 seconds 00000100:00100000:1.0:1789265377.862091:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265377.862172:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399662848 00000100:00100000:0.0:1789265377.862182:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399662848 00010000:00010000:0.0:1789265377.862221:0:7926:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9754c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0d7 expref: 22 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265377.862265:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 106 00000100:00100000:0.0:1789265377.862275:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+22:2396:x1876180399662848:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265377.862322:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265377.862330:0:7926:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9754c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0d7 expref: 22 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.862346:0:7926:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9754c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0d7 expref: 22 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.862371:0:7926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:0.0:1789265377.862378:0:7926:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a975ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0fa expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.862388:0:7926:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a9765d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.862395:0:7926:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a9765d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.862401:0:7926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a9765d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.862420:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265377.862477:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b43750b-84cf-4d62-9028-e016267b6509+22:2396:x1876180399662848:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 203us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265377.862485:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 106 00010000:00010000:2.0:1789265377.862624:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5200/0x9272d942b4a9754c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0d7 expref: 21 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265377.862640:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876180417533568:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265377.862658:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a9765d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.862665:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a9765d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.862671:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a9765d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.862841:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a97664 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.862858:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a97617 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc116 expref: 21 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.862866:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a97664 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.862893:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a97617 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc116 expref: 21 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.862906:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a97617 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc116 expref: 21 pid: 8460 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265377.862919:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876180417533696:192.168.203.49@tcp:104: 00000100:00100000:2.0:1789265377.862968:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc906d4000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265377.872246:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876180417533696:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265377.872277:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a97664 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265377.874570:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265377.875666:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399662976 00000100:00100000:3.0:1789265377.875686:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399662976 00010000:00010000:3.0:1789265377.875728:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a97617 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc116 expref: 22 pid: 8460 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265377.875878:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 107 00000100:00100000:3.0:1789265377.875888:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+22:2396:x1876180399662976:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265377.875916:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265377.875922:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a97617 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc116 expref: 22 pid: 8460 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.875936:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a97617 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc116 expref: 22 pid: 8460 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.875957:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a97617 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc116 expref: 22 pid: 8460 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.875973:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fcca9677a00) 00010000:00010000:3.0:1789265377.875978:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a97664 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.875987:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a97664 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.875994:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a97664 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.876060:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265377.876105:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b43750b-84cf-4d62-9028-e016267b6509+21:2396:x1876180399662976:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 218us (1542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265377.876112:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 107 00010000:00010000:2.0:1789265377.876173:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a97664 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.876181:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a97664 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265377.876287:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1789265377.876381:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1789265377.876409:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1789265377.876476:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6516:1876180417533824:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789265377.876544:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265377.876570:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b29180 going to sleep for 11 seconds 00000100:00100000:2.0:1789265377.876601:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417533824 00000100:00100000:2.0:1789265377.876604:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417533824 00000100:00100000:2.0:1789265377.876631:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789265377.876637:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6516:x1876180417533824:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789265377.876708:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6516:x1876180417533824:12345-0@lo:1000:mdt00_000.0 Request processed in 71us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265377.876715:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789265377.876745:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6516:1876180417533824:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789265377.876849:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1789265377.876885:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6516:1876180417533952:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789265377.876909:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265377.876924:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b29780 going to sleep for 11 seconds 00000100:00100000:2.0:1789265377.876949:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417533952 00000100:00100000:2.0:1789265377.876952:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417533952 00000100:00100000:2.0:1789265377.876972:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789265377.876977:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6516:x1876180417533952:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789265377.877078:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6516:x1876180417533952:12345-0@lo:1000:mdt00_000.0 Request processed in 100us (168us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1789265377.877084:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789265377.877112:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6516:1876180417533952:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789265377.877138:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a97664 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.877146:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a97664 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.877164:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a97664 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.877171:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2ec00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265377.877176:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a97664 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.877183:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a97664 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.877194:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fcca9677a00) 00010000:00010000:2.0:1789265377.877197:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265377.877200:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a97664 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.877206:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a97664 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.877228:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a975a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.877234:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a975a7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.877240:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a975a7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.877245:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265377.877248:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a975a7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.877264:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a975a7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.877272:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:2.0:1789265377.877274:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265377.877279:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a975ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0fa expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.877287:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a975ae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0fa expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.877296:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a975ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0fa expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.877318:0:6516:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a975ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0fa expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265377.877328:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876180417534080:192.168.203.49@tcp:105: 00000100:00100000:2.0:1789265377.877374:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b29780 going to sleep for 11 seconds 00000100:00100000:2.0:1789265377.889009:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1876180417534080:192.168.203.49@tcp:105: 00010000:00010000:2.0:1789265377.889065:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a975a7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.889076:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a975a7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.889109:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a9766b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.889135:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a9766b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.889146:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a9766b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.889156:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a9766b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.889162:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a9766b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.889168:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a9766b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.889174:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2fe00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265377.889178:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a9766b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.889185:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a9766b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.889196:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:2.0:1789265377.889199:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265377.889203:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a9766b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.889209:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a9766b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.889230:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a9765d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.889243:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a9765d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.889248:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a9765d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.889253:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265377.889256:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a9765d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.889262:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a9765d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.889270:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:2.0:1789265377.889272:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789265377.889275:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a9765d lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.889280:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a9765d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265377.889443:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+24:12471:x1876180399662720:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 Request processed in 33070us (33238us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1789265377.889453:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 247 00000020:00080000:2.0:1789265377.889459:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789265377.889764:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000040:00080000:3.0:1789265377.891132:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789265377.891140:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1789265377.891297:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399663104 00000100:00100000:0.0:1789265377.891306:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399663104 00000100:00100000:0.0:1789265377.891355:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 61 00000100:00100000:0.0:1789265377.891363:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+24:12470:x1876180399663104:12345-192.168.203.49@tcp:49:lfs.0 00000100:00100000:0.0:1789265377.891476:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+24:12470:x1876180399663104:12345-192.168.203.49@tcp:49:lfs.0 Request processed in 113us (1712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265377.891483:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 61 00000040:00080000:3.0:1789265377.891655:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789265377.891666:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789265377.894186:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265377.894773:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399663360 00000100:00100000:2.0:1789265377.894784:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399663360 00000100:00100000:2.0:1789265377.894908:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 248 00000100:00100000:2.0:1789265377.894919:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+24:12470:x1876180399663360:12345-192.168.203.49@tcp:58:lfs.0 00000040:00080000:2.0:1789265377.895181:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1789265377.895255:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+24:12470:x1876180399663360:12345-192.168.203.49@tcp:58:lfs.0 Request processed in 337us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265377.895263:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 248 00000100:00100000:1.0:1789265377.895416:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265377.895766:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399663616 00000100:00100000:0.0:1789265377.895772:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399663616 00000100:00100000:0.0:1789265377.895891:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 62 00000100:00100000:0.0:1789265377.896048:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdc9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+24:12471:x1876180399663616:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789265377.896302:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789265377.896332:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:0.0:1789265377.896359:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97672 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.896374:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97672 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.896385:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97672 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.896393:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97672 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.896399:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97672 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.896404:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97672 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265377.896426:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789265377.896493:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdc9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+26:12471:x1876180399663616:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 Request processed in 448us (1076us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1789265377.896515:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 62 00000020:00080000:0.0:1789265377.896520:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789265377.897442:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265377.897452:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97672 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.897580:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4a00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265377.897584:0:7473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97672 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.897606:0:7473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97672 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.897621:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fcca9677a00) 00010000:00010000:2.0:1789265377.897624:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789265377.897629:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97672 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.897635:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97672 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.897648:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265377.897650:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265377.897652:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265377.940610:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265377.940771:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399663744 00000100:00100000:2.0:1789265377.940784:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399663744 00000100:00100000:2.0:1789265377.940869:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 249 00000100:00100000:2.0:1789265377.940880:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+26:12473:x1876180399663744:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1789265377.940953:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265377.940988:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a97679 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc132 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.941142:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a97680 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.941159:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a97680 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.941174:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a97680 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.941193:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a97687 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.941201:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a97687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.941209:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a97687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.941338:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f400/0x9272d942b4a9768e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.941351:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97599 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0f3 expref: 27 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.941361:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f400/0x9272d942b4a9768e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.941404:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97599 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0f3 expref: 27 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.941430:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97599 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0f3 expref: 27 pid: 8459 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265377.941448:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876180417534208:192.168.203.49@tcp:104: 00000100:00100000:2.0:1789265377.941564:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b299c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265377.946302:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265377.946510:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1876180417534208:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265377.946550:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f400/0x9272d942b4a9768e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265377.947744:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399664000 00000100:00100000:0.0:1789265377.947760:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399664000 00000100:00100000:0.0:1789265377.947857:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 63 00000100:00100000:0.0:1789265377.947872:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+28:6161:x1876180399664000:12345-192.168.203.49@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789265377.948383:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+29:6161:x1876180399664000:12345-192.168.203.49@tcp:35:ldlm_bl.0 Request processed in 514us (2779us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1789265377.948393:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 63 00000100:00100000:1.0:1789265377.952280:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265377.952407:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399664128 00000100:00100000:3.0:1789265377.952422:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399664128 00010000:00010000:3.0:1789265377.952478:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97599 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0f3 expref: 29 pid: 8459 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265377.952533:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 108 00000100:00100000:3.0:1789265377.952545:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+29:2395:x1876180399664128:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265377.952566:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265377.952574:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97599 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0f3 expref: 29 pid: 8459 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.952589:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97599 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0f3 expref: 29 pid: 8459 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.952619:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97599 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0f3 expref: 29 pid: 8459 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.952640:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:3.0:1789265377.952646:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f400/0x9272d942b4a9768e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.952655:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f400/0x9272d942b4a9768e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.952665:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f400/0x9272d942b4a9768e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265377.952713:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265377.952790:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43750b-84cf-4d62-9028-e016267b6509+28:2395:x1876180399664128:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 246us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265377.952820:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 108 00010000:00010000:2.0:1789265377.952907:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f400/0x9272d942b4a9768e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.952917:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f400/0x9272d942b4a9768e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265377.952992:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789265377.952998:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265377.953075:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f400/0x9272d942b4a9768e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.953102:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f400/0x9272d942b4a9768e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.953113:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a97680 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.953120:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a97680 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.953140:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a97680 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.953147:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2fe00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265377.953151:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a97680 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.953160:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a97680 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.953172:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:2.0:1789265377.953175:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265377.953180:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a97680 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.953186:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a97680 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.953198:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a97687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.953205:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a97687 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.953211:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a97687 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.953215:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2ec00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265377.953218:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a97687 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.953240:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a97687 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.953249:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fcb83b84b00) 00010000:00010000:2.0:1789265377.953251:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265377.953254:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a97687 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.953260:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ec00/0x9272d942b4a97687 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.953307:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a97679 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc132 expref: 28 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.953323:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f400/0x9272d942b4a9768e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc132 expref: 27 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265377.953330:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:2.0:1789265377.953332:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265377.953335:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2f400, rc 0) 00000100:00100000:2.0:1789265377.953372:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+27:12473:x1876180399663744:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 12494us (12780us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265377.953381:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 249 00000040:00080000:3.0:1789265378.567583:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789265378.627451:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789265378.941127:0:14758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265378.941137:0:14758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265378.941171:0:14758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789265378.941179:0:14758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789265378.953323:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265378.953334:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265378.953377:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789265378.953385:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789265378.953530:0:13799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1876180417534336:192.168.203.49@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789265378.953688:0:13799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b299c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265378.966263:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265378.967598:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399664256 00000100:00100000:3.0:1789265378.967610:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399664256 00000100:00100000:3.0:1789265378.967795:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 250 00000100:00100000:3.0:1789265378.967807:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+28:12484:x1876180399664256:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789265378.967843:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789265378.967958:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+28:12484:x1876180399664256:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 Request processed in 153us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265378.967966:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 250 00000100:00100000:2.0:1789265378.973128:0:13799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1876180417534336:192.168.203.49@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789265378.978364:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265378.978438:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399664512 00000100:00100000:1.0:1789265378.978449:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399664512 00000100:00100000:1.0:1789265378.978513:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 251 00000100:00100000:1.0:1789265378.978524:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+27:12484:x1876180399664512:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265378.978544:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265378.978564:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a97695 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc139 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265378.978664:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52200/0x9272d942b4a9769c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265378.978690:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52200/0x9272d942b4a9769c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265378.978703:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52200/0x9272d942b4a9769c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265378.978713:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789265378.978821:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a97695 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc139 expref: 30 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265378.978838:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52200/0x9272d942b4a9769c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc139 expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265378.978860:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:1.0:1789265378.978864:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265378.978868:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f52200, rc 0) 00000100:00100000:1.0:1789265378.978934:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+29:12484:x1876180399664512:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 411us (575us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1789265378.978941:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 251 00000100:00100000:1.0:1789265378.987483:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265378.987518:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265378.987584:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399664896 00000100:00100000:3.0:1789265378.987594:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399664896 00000100:00100000:3.0:1789265378.987678:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 19 00000100:00100000:3.0:1789265378.987689:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+29:2393:x1876180399664896:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265378.987703:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265378.987728:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52200/0x9272d942b4a9769c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc139 expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265378.987746:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:3.0:1789265378.987750:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265378.987811:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43750b-84cf-4d62-9028-e016267b6509+28:2393:x1876180399664896:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 124us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265378.987818:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 19 00000100:00100000:2.0:1789265378.987926:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399664768 00000100:00100000:2.0:1789265378.987932:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399664768 00000100:00100000:2.0:1789265378.987974:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 252 00000100:00100000:2.0:1789265378.987982:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+28:12484:x1876180399664768:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789265378.988068:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a976aa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265378.988082:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a976aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265378.988094:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a976aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265378.988239:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a976aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265378.988247:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a976aa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265378.988253:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a976aa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265378.988259:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2ee00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265378.988263:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a976aa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265378.988270:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a976aa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265378.988290:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:2.0:1789265378.988292:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789265378.988297:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a976aa lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265378.988303:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2ee00/0x9272d942b4a976aa lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265378.988379:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+29:12484:x1876180399664768:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 Request processed in 398us (906us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1789265378.988386:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 252 00000040:00080000:2.0:1789265378.988464:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265378.988469:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265378.989888:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789265378.989902:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789265379.000127:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265379.000210:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399665152 00000100:00100000:3.0:1789265379.000224:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399665152 00000100:00100000:3.0:1789265379.000289:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 64 00000100:00100000:3.0:1789265379.000307:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+29:12484:x1876180399665152:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 00000100:00080000:1.0:1789265379.000359:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265379.000526:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+30:12484:x1876180399665152:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 Request processed in 220us (410us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1789265379.000534:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 64 00010000:00010000:2.0:1789265379.649827:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265379.841916:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265379.842007:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417534592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265379.842097:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265379.842172:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417534592 00000100:00100000:1.0:1789265379.842180:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417534592 00000100:00100000:1.0:1789265379.842226:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789265379.842235:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417534592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789265379.842267:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789265379.842313:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417534592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265379.842321:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789265379.842364:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417534592:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265379.853916:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417534464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265379.858337:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265379.859259:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417534464 00000100:00100000:1.0:1789265379.859270:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417534464 00000100:00100000:1.0:1789265379.859338:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789265379.859347:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417534464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265379.859383:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789265379.859474:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417534464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265379.859496:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789265379.859738:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417534464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265380.353711:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417534720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265380.353781:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265380.353833:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265380.353840:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417534848:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265380.353861:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265380.353887:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417534720 00000100:00100000:0.0:1789265380.353894:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417534720 00000100:00100000:0.0:1789265380.353938:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417534848 00000100:00100000:0.0:1789265380.353941:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417534848 00000100:00100000:0.0:1789265380.353956:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789265380.353963:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1876180417534720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265380.354002:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789265380.354066:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1876180417534720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265380.354074:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789265380.354100:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789265380.354106:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417534848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789265380.354115:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789265380.354138:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417534848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 32us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265380.354143:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:0.0:1789265380.354158:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265380.354188:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417534848:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265380.354471:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417534720:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789265380.674103:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789265380.856756:0:14810:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265380.856767:0:14810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265380.856800:0:14810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789265380.856808:0:14810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789265381.073499:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265381.073543:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399665408 00000100:00100000:3.0:1789265381.073553:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399665408 00000100:00100000:3.0:1789265381.073633:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 253 00000100:00100000:3.0:1789265381.073645:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+30:12505:x1876180399665408:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1789265381.073675:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265381.073696:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a976b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc140 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265381.073810:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a976b8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265381.073826:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a976b8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265381.073839:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a976b8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265381.073852:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789265381.073968:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a976b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc140 expref: 33 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265381.074007:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a976b8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc140 expref: 32 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265381.074015:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:3.0:1789265381.074018:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789265381.074063:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81490200, rc 0) 00000100:00100000:3.0:1789265381.074126:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+32:12505:x1876180399665408:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 484us (647us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1789265381.074133:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 253 00000100:00080000:0.0:1789265381.074481:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265381.079066:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265381.079270:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399665536 00000100:00100000:3.0:1789265381.079282:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399665536 00000100:00100000:3.0:1789265381.079346:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 254 00000100:00100000:3.0:1789265381.079357:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+32:12505:x1876180399665536:12345-192.168.203.49@tcp:54:lfs.0 00010000:00010000:3.0:1789265381.079991:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a976c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265381.080009:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a976c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265381.080098:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a976c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265381.080138:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a976c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265381.080146:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a976c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265381.080177:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a976c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265381.080184:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265381.080188:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a976c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265381.080195:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a976c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265381.080207:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:3.0:1789265381.080210:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265381.080214:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a976c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265381.080219:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a976c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265381.080306:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+32:12505:x1876180399665536:12345-192.168.203.49@tcp:54:lfs.0 Request processed in 949us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265381.080315:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 254 00000100:00100000:2.0:1789265381.187236:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265381.187325:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399665664 00000100:00100000:3.0:1789265381.187335:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399665664 00000100:00100000:3.0:1789265381.187417:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 79 00000100:00100000:3.0:1789265381.187429:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+7:2395:x1876180399665664:12345-192.168.203.49@tcp:101:cat.0 00010000:00010000:3.0:1789265381.187446:0:8914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265381.187468:0:8914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb74d500/0x9272d942b4a976cd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc147 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265381.187513:0:8914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aa605e1, atime: 0x6aa605e0, ctime: 0x6aa605e1, blocks: 0x8 00000100:00080000:0.0:1789265381.187732:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789265381.187774:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789265381.187780:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265381.187790:0:8914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb74d500/0x9272d942b4a976cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc147 expref: 8 pid: 8914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265381.187811:0:8914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eb74d500/0x9272d942b4a976cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc147 expref: 8 pid: 8914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265381.187824:0:8914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81490400, rc 0) 00000100:00100000:3.0:1789265381.187918:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+8:2395:x1876180399665664:12345-192.168.203.49@tcp:101:cat.0 Request processed in 484us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265381.187926:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 79 00000100:00100000:1.0:1789265381.193384:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265381.193498:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399665792 00000100:00100000:2.0:1789265381.193508:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399665792 00002000:00100000:2.0:1789265381.193727:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9fcb83bbb800 x1876180399665792/t0(0) o3->5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp:707/0 lens 488/0 e 0 to 0 dl 1789265392 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789265381.193756:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fcb83bbb800 with x1876180399665792 ext(0->4095) 00002000:00010000:2.0:1789265381.193763:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fcb83bbb800 00000100:00100000:2.0:1789265381.193838:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:2.0:1789265381.193849:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5b43750b-84cf-4d62-9028-e016267b6509+8:2396:x1876180399665792:12345-192.168.203.49@tcp:3:cat.0 00000100:00100000:2.0:1789265381.194046:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5b43750b-84cf-4d62-9028-e016267b6509+8:2396:x1876180399665792:12345-192.168.203.49@tcp:3:cat.0 Request processed in 199us (674us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789265381.194054:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 7 00002000:00100000:2.0:1789265381.194061:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9fcb83bbb800 x1876180399665792/t0(0) o3->5b43750b-84cf-4d62-9028-e016267b6509@192.168.203.49@tcp:707/0 lens 488/4536 e 0 to 0 dl 1789265392 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789265381.194069:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fcb83bbb800 with x1876180399665792 ext(0->4095) 00002000:00010000:2.0:1789265381.194072:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fcb83bbb800 00010000:00010000:0.0:1789265381.699125:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265381.701815:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265381.701864:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265381.701900:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265381.701923:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265381.701948:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265381.701970:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265381.702009:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399666176 00000100:00100000:1.0:1789265381.702009:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399666304 00000100:00100000:1.0:1789265381.702020:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399666304 00000100:00100000:2.0:1789265381.702046:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399666176 00000100:00100000:1.0:1789265381.702117:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 133 00000100:00100000:1.0:1789265381.702127:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+7:2394:x1876180399666304:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265381.702177:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399666432 00000100:00100000:2.0:1789265381.702183:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399666432 00000100:00100000:1.0:1789265381.702196:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b43750b-84cf-4d62-9028-e016267b6509+7:2394:x1876180399666304:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 71us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265381.702206:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 133 00000100:00100000:2.0:1789265381.702219:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399666048 00000100:00100000:2.0:1789265381.702223:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399666048 00000100:00100000:2.0:1789265381.702240:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399666560 00000100:00100000:2.0:1789265381.702243:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399666560 00000100:00100000:1.0:1789265381.702247:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 341 00000100:00100000:1.0:1789265381.702258:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399666176:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265381.702263:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 342 00000100:00100000:2.0:1789265381.702272:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2394:x1876180399666432:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265381.702302:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2394:x1876180399666432:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 32us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265381.702307:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 342 00000100:00100000:2.0:1789265381.702320:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 343 00000100:00100000:2.0:1789265381.702339:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+32:2394:x1876180399666048:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265381.702379:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399665920 00000100:00100000:2.0:1789265381.702382:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b43750b-84cf-4d62-9028-e016267b6509+32:2394:x1876180399666048:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 41us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265381.702384:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399665920 00000100:00100000:2.0:1789265381.702393:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 343 00000100:00100000:2.0:1789265381.702409:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 344 00000100:00100000:2.0:1789265381.702416:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2394:x1876180399666560:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265381.702427:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 393 00000100:00100000:0.0:1789265381.702436:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2394:x1876180399665920:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265381.702444:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2394:x1876180399666560:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 26us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265381.702450:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 344 00000100:00100000:0.0:1789265381.702473:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2394:x1876180399665920:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 37us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265381.702480:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 393 00000100:00080000:0.0:1789265381.702512:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265381.702517:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265381.702525:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265381.704193:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5b43750b-84cf-4d62-9028-e016267b6509+5:2394:x1876180399666176:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 1928us (2318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265381.704205:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 341 00000100:00100000:2.0:1789265381.889237:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265381.889263:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417534976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265381.889699:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265381.891149:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417534976 00000100:00100000:1.0:1789265381.891163:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417534976 00000100:00080000:2.0:1789265381.891306:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265381.891313:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789265381.891326:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417534976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789265381.891431:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265381.891704:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417534976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 377us (2364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265381.891713:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789265381.891768:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417534976:0@lo:13:osp-pre-1-1.0 00000001:00080000:0.0:1789265381.898126:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1789265381.898154:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:1.0:1789265382.401285:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265382.402390:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417535104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265382.402461:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265382.402633:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417535104 00000100:00100000:0.0:1789265382.402642:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417535104 00000100:00100000:0.0:1789265382.402753:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789265382.402763:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417535104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265382.402787:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1789265382.402849:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417535104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265382.402857:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789265382.403859:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417535360:0@lo:400:kworker.0 00000100:00100000:0.0:1789265382.403915:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265382.403942:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417535872:0@lo:400:kworker.0 00000100:00100000:0.0:1789265382.403965:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265382.403990:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91423100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417536384:0@lo:400:kworker.0 00000100:00100000:0.0:1789265382.404012:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265382.404061:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789265382.404068:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91421500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417535488:0@lo:400:kworker.0 00000100:00100000:0.0:1789265382.404092:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265382.404116:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91422d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417536000:0@lo:400:kworker.0 00000100:00100000:0.0:1789265382.404139:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265382.404156:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417536512:0@lo:400:kworker.0 00000100:00100000:0.0:1789265382.404173:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265382.404201:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417535360 00000100:00100000:0.0:1789265382.404207:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417535360 00000100:00100000:0.0:1789265382.404254:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417535872 00000100:00100000:0.0:1789265382.404257:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417535872 00000100:00100000:1.0:1789265382.404322:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417535232:0@lo:400:kworker.0 00000100:00100000:3.0:1789265382.404348:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417535616:0@lo:400:kworker.0 00000100:00100000:1.0:1789265382.404365:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265382.404390:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265382.404401:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417535744:0@lo:400:kworker.0 00000100:00100000:3.0:1789265382.404417:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417536128:0@lo:400:kworker.0 00000100:00100000:1.0:1789265382.404434:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265382.404451:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265382.404454:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417536256:0@lo:400:kworker.0 00000100:00100000:1.0:1789265382.404482:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265382.404518:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1789265382.404523:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:1.0:1789265382.404553:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fcb84847480, transno 4294967311 00000100:00100000:1.0:1789265382.404584:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417535104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265382.404612:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417535232 00000100:00100000:1.0:1789265382.404616:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417535232 00000100:00100000:1.0:1789265382.404658:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1789265382.404666:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca94cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417535232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265382.404710:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca94cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417535232:12345-0@lo:400:kworker.0 Request processed in 46us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265382.404717:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1789265382.404747:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417535488 00000100:00100000:1.0:1789265382.404757:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417535488 00000100:00100000:1.0:1789265382.404781:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417535616 00000100:00100000:1.0:1789265382.404783:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417535616 00000100:00100000:1.0:1789265382.404798:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789265382.404803:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417535488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265382.404844:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417535488:12345-0@lo:400:kworker.0 Request processed in 41us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265382.404850:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789265382.404862:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789265382.404867:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417535616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265382.404900:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417535616:12345-0@lo:400:kworker.0 Request processed in 33us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265382.404906:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789265382.404925:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417536128 00000100:00100000:1.0:1789265382.404928:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417536128 00000100:00100000:3.0:1789265382.410244:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417536384 00000100:00100000:3.0:1789265382.410259:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417536384 00000100:00100000:0.0:1789265382.410416:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417536000 00000100:00100000:0.0:1789265382.410421:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417536000 00000100:00100000:0.0:1789265382.410435:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417536512 00000100:00100000:0.0:1789265382.410438:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417536512 00000100:00100000:0.0:1789265382.410449:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417535744 00000100:00100000:0.0:1789265382.410451:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417535744 00000100:00100000:0.0:1789265382.410469:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789265382.410490:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417535360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265382.410573:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417535360:12345-0@lo:400:kworker.0 Request processed in 96us (6658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265382.410581:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789265382.410600:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1789265382.410606:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417535872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265382.410636:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417535872:12345-0@lo:400:kworker.0 Request processed in 31us (6671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265382.410652:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1789265382.410665:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789265382.410671:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417536000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265382.410698:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417536000:12345-0@lo:400:kworker.0 Request processed in 28us (6557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265382.410705:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789265382.410717:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1789265382.410723:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417536512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265382.410749:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417536512:12345-0@lo:400:kworker.0 Request processed in 27us (6575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265382.410785:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1789265382.410798:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789265382.410804:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417535744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265382.410835:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417535744:12345-0@lo:400:kworker.0 Request processed in 31us (6402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265382.410841:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789265382.410904:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91421500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417535488:0@lo:400:kworker.0 00010000:00080000:0.0:1789265382.410919:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc91422d80 x1876180417536000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265382.410930:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91422d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417536000:0@lo:400:kworker.0 00010000:00080000:0.0:1789265382.410941:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc91420000 x1876180417536512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265382.410948:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417536512:0@lo:400:kworker.0 00000100:00100000:0.0:1789265382.410959:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417535360:0@lo:400:kworker.0 00000100:00100000:0.0:1789265382.410968:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417535872:0@lo:400:kworker.0 00000100:00100000:1.0:1789265382.411103:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417536256 00000100:00100000:1.0:1789265382.411109:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417536256 00000100:00100000:1.0:1789265382.411142:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789265382.411151:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417536128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265382.411192:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417536128:12345-0@lo:400:kworker.0 Request processed in 43us (6742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265382.411198:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789265382.411213:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789265382.411219:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3642:x1876180417536256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265382.411248:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3642:x1876180417536256:12345-0@lo:400:kworker.0 Request processed in 29us (6764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265382.411254:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789265382.411301:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417535616:0@lo:400:kworker.0 00000100:00100000:1.0:1789265382.411326:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417536128:0@lo:400:kworker.0 00000100:00100000:1.0:1789265382.411355:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417535232:0@lo:400:kworker.0 00000100:00100000:1.0:1789265382.411366:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417535744:0@lo:400:kworker.0 00000100:00100000:1.0:1789265382.411375:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417536256:0@lo:400:kworker.0 00000100:00080000:2.0:1789265382.412751:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789265382.412770:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789265382.412773:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265382.412776:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265382.415336:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1789265382.415351:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417536384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265382.415466:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417536384:12345-0@lo:400:kworker.0 Request processed in 117us (11451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265382.415506:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91423100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417536384:0@lo:400:kworker.0 00000100:00100000:3.0:1789265382.415597:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00010000:00010000:2.0:1789265382.722049:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265383.746268:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789265383.942070:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00010000:00010000:3.0:1789265383.942099:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97648 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265383.942116:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97648 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265383.942126:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97648 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265383.942134:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2fa00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265383.942140:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97648 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265383.942149:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97648 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265383.942172:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fcca9677a00) 00010000:00010000:3.0:1789265383.942176:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265383.942183:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97648 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265383.942189:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97648 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789265383.942223:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fcb82b29000 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1789265383.942230:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fcb82e20c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fcb82b29180 00000020:00080000:2.0:1789265383.942235:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fcb82e20800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fcb82d8c600 00000020:00080000:2.0:1789265383.942267:0:6495:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1789265383.942365:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000001:00080000:1.0:1789265383.944705:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:1.0:1789265383.944727:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000020:00080000:2.0:1789265383.951691:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1789265384.769308:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265384.964861:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417536640:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265384.964962:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265384.965099:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417536640 00000100:00100000:3.0:1789265384.965108:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417536640 00000100:00100000:3.0:1789265384.965493:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789265384.965507:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417536640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265384.965562:0:7479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789265384.965636:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417536640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265384.965644:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789265384.965712:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417536640:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265384.969514:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417536768:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265384.969617:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265384.971227:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417536768 00000100:00100000:1.0:1789265384.971245:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417536768 00000100:00100000:1.0:1789265384.971317:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789265384.971329:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417536768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789265384.971377:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789265384.971479:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417536768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 151us (1862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265384.971487:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789265384.971946:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417536768:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265385.473348:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8492ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417536896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265385.473416:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265385.473485:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417536896 00000100:00100000:0.0:1789265385.473491:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417536896 00000100:00100000:0.0:1789265385.473546:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789265385.473564:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417536896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789265385.473593:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789265385.473655:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417536896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265385.473663:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789265385.473711:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8492ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417536896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265385.473946:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417537024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265385.473976:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265385.474006:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417537024 00000100:00100000:3.0:1789265385.474010:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417537024 00000100:00100000:3.0:1789265385.474055:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789265385.474062:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417537024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265385.474073:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789265385.474105:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417537024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265385.474112:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789265385.474137:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1789265385.474142:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fccbd3e7800, transno 4294967323 00000004:00080000:3.0:1789265385.474153:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1789265385.474384:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417537024:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789265385.474522:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789265385.797349:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265385.992070:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265385.992272:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399666688 00000100:00100000:0.0:1789265385.992282:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399666688 00000100:00080000:3.0:1789265385.992337:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265385.992363:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 255 00000100:00100000:0.0:1789265385.992374:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+18:12150:x1876180399666688:12345-192.168.203.49@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789265385.992476:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+18:12150:x1876180399666688:12345-192.168.203.49@tcp:60:lhsmtool_posix.0 Request processed in 104us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265385.992483:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 255 00000100:00100000:2.0:1789265386.005910:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265386.005999:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399666816 00000100:00100000:3.0:1789265386.006009:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399666816 00000100:00100000:3.0:1789265386.006126:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 256 00000100:00100000:3.0:1789265386.006136:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+5:12150:x1876180399666816:12345-192.168.203.49@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789265386.006229:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+5:12150:x1876180399666816:12345-192.168.203.49@tcp:60:lhsmtool_posix.0 Request processed in 95us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265386.006236:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 256 00000100:00080000:2.0:1789265386.006559:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265386.013435:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265386.013554:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399667072 00000100:00100000:2.0:1789265386.013568:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399667072 00000100:00100000:2.0:1789265386.013647:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 65 00000100:00100000:2.0:1789265386.013660:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+18:12150:x1876180399667072:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789265386.014191:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+19:12150:x1876180399667072:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 Request processed in 531us (768us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789265386.014200:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 65 00000100:00100000:0.0:1789265386.172019:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265386.172950:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399667200 00000100:00100000:2.0:1789265386.172975:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399667200 00000100:00100000:2.0:1789265386.173167:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 257 00000100:00100000:2.0:1789265386.173183:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:12962:x1876180399667200:12345-192.168.203.49@tcp:101:lsof.0 00010000:00010000:2.0:1789265386.173220:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265386.173256:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a976d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc14e expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789265386.173521:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789265386.173599:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e800/0x9272d942b4a976db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265386.173627:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e800/0x9272d942b4a976db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265386.173643:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e800/0x9272d942b4a976db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265386.173707:0:8459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789265386.173729:0:8459:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265386.173760:0:8459:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e800/0x9272d942b4a976db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265386.173804:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fe00/0x9272d942b4a976d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc14e expref: 7 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265386.173828:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e800/0x9272d942b4a976db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc14e expref: 6 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265386.173839:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fccacd4ed00) 00010000:00010000:2.0:1789265386.173842:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265386.173846:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2e800, rc 0) 00000100:00100000:2.0:1789265386.173988:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:12962:x1876180399667200:12345-192.168.203.49@tcp:101:lsof.0 Request processed in 810us (1978us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265386.173997:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 257 00010000:00010000:2.0:1789265386.817417:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265386.822701:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265386.822752:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265386.822789:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265386.822829:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265386.822858:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265386.822884:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265386.822937:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399667328 00000100:00100000:1.0:1789265386.822948:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399667328 00000100:00100000:3.0:1789265386.823003:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399667456 00000100:00100000:3.0:1789265386.823010:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399667456 00000100:00100000:1.0:1789265386.823015:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 395 00000100:00100000:1.0:1789265386.823062:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2396:x1876180399667328:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265386.823124:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399667968 00000100:00100000:3.0:1789265386.823129:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399667968 00000100:00100000:1.0:1789265386.823155:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2396:x1876180399667328:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 130us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265386.823164:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 395 00000100:00100000:3.0:1789265386.823177:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399667584 00000100:00100000:3.0:1789265386.823182:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399667584 00000100:00100000:1.0:1789265386.823208:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399667712 00000100:00100000:1.0:1789265386.823214:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399667712 00000100:00100000:3.0:1789265386.823218:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 351 00000100:00100000:3.0:1789265386.823229:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+19:2396:x1876180399667456:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265386.823248:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399667840 00000100:00100000:1.0:1789265386.823252:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399667840 00000100:00100000:3.0:1789265386.823278:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+19:2396:x1876180399667456:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 49us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265386.823278:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 136 00000100:00100000:1.0:1789265386.823291:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+7:2396:x1876180399667712:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265386.823292:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 351 00000100:00100000:3.0:1789265386.823313:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 352 00000100:00100000:3.0:1789265386.823322:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2396:x1876180399667968:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265386.823333:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+7:2396:x1876180399667712:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 45us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265386.823341:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 136 00000100:00100000:1.0:1789265386.823356:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 137 00000100:00100000:3.0:1789265386.823363:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2396:x1876180399667968:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 42us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265386.823367:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399667840:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265386.823376:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 352 00000100:00100000:3.0:1789265386.823394:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 353 00000100:00100000:1.0:1789265386.823401:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399667840:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 37us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265386.823405:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399667584:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265386.823417:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 137 00000100:00100000:3.0:1789265386.823440:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b43750b-84cf-4d62-9028-e016267b6509+5:2396:x1876180399667584:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 38us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265386.823456:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 353 00000100:00080000:1.0:1789265386.823626:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265386.823631:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265386.823635:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265387.009444:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417537152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265387.009561:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265387.009768:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417537152 00000100:00100000:1.0:1789265387.009778:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417537152 00000100:00080000:3.0:1789265387.009838:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265387.009871:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789265387.009942:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417537152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789265387.009982:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265387.010090:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417537152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 150us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265387.010167:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417537152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265387.011212:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789265387.523247:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417537408:0@lo:400:kworker.0 00000100:00100000:3.0:1789265387.523276:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417537536:0@lo:400:kworker.0 00000100:00100000:2.0:1789265387.523355:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417537280:0@lo:400:kworker.0 00000100:00100000:0.0:1789265387.523390:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417537664:0@lo:400:kworker.0 00000100:00100000:3.0:1789265387.526092:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265387.526197:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417538048:0@lo:400:kworker.0 00000100:00100000:3.0:1789265387.526251:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265387.526277:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180417538560:0@lo:400:kworker.0 00000100:00100000:3.0:1789265387.526298:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265387.526333:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265387.526339:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180417538432:0@lo:400:kworker.0 00000100:00100000:3.0:1789265387.526361:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265387.526411:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417538048 00000100:00100000:3.0:1789265387.526422:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417538048 00000100:00100000:3.0:1789265387.526496:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417538560 00000100:00100000:3.0:1789265387.526500:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417538560 00000100:00100000:3.0:1789265387.526529:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417538432 00000100:00100000:3.0:1789265387.526532:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417538432 00000100:00100000:3.0:1789265387.526550:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1789265387.526560:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417538048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265387.526635:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417538048:12345-0@lo:400:kworker.0 Request processed in 76us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265387.526644:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1789265387.527061:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1789265387.527076:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180417538560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265387.527117:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180417538560:12345-0@lo:400:kworker.0 Request processed in 46us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265387.527146:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1789265387.527162:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1789265387.527169:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180417538432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265387.527204:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180417538432:12345-0@lo:400:kworker.0 Request processed in 36us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265387.527209:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00080000:3.0:1789265387.527237:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265387.527242:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265387.527283:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180417538432:0@lo:400:kworker.0 00010000:00080000:3.0:1789265387.527300:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb84845180 x1876180417538048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265387.527311:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417538048:0@lo:400:kworker.0 00010000:00080000:3.0:1789265387.527323:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb84844380 x1876180417538560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265387.527331:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180417538560:0@lo:400:kworker.0 00000100:00100000:3.0:1789265387.527422:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417537536 00000100:00100000:3.0:1789265387.527427:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417537536 00000100:00100000:3.0:1789265387.527463:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789265387.527471:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417537536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265387.527515:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417537536:12345-0@lo:400:kworker.0 Request processed in 45us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265387.527522:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789265387.527555:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417537536:0@lo:400:kworker.0 00000100:00100000:1.0:1789265387.535431:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265387.535510:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417537920:0@lo:400:kworker.0 00000100:00100000:3.0:1789265387.536196:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417537408 00000100:00100000:3.0:1789265387.536230:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417537408 00000100:00100000:3.0:1789265387.536310:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789265387.536322:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417537408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265387.539983:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417537408:12345-0@lo:400:kworker.0 Request processed in 3594us (4493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265387.540004:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1789265387.540201:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265387.540277:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417537792:0@lo:400:kworker.0 00000100:00100000:2.0:1789265387.540327:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265387.540356:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417538304:0@lo:400:kworker.0 00000100:00100000:2.0:1789265387.540383:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265387.540419:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8492c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417538816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265387.540447:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265387.540479:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417538816 00000100:00100000:2.0:1789265387.540488:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417538816 00000100:00100000:2.0:1789265387.540575:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789265387.540585:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417538816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265387.540623:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265387.540855:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265387.540894:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417537664 00000100:00100000:0.0:1789265387.540899:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417537664 00000100:00100000:1.0:1789265387.540923:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265387.540933:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789265387.540960:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417537792 00000100:00100000:1.0:1789265387.540964:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417537792 00000100:00100000:1.0:1789265387.540993:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417537920 00000100:00100000:1.0:1789265387.540997:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417537920 00000100:00100000:0.0:1789265387.541001:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417537664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265387.541067:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1789265387.541075:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417537664:12345-0@lo:400:kworker.0 Request processed in 79us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265387.541089:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417537792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265387.541096:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789265387.541136:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417537792:12345-0@lo:400:kworker.0 Request processed in 62us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265387.541143:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789265387.541157:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1789265387.541163:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417537920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265387.541191:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417537920:12345-0@lo:400:kworker.0 Request processed in 28us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265387.541197:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1789265387.541243:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417537920:0@lo:400:kworker.0 00000100:00100000:1.0:1789265387.541280:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417537408:0@lo:400:kworker.0 00000100:00100000:1.0:1789265387.541333:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417538304 00000100:00100000:1.0:1789265387.541337:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417538304 00000100:00100000:1.0:1789265387.541376:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789265387.541384:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417538304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265387.541387:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417537280 00000100:00100000:3.0:1789265387.541394:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417537280 00000100:00100000:1.0:1789265387.541426:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417538304:12345-0@lo:400:kworker.0 Request processed in 42us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265387.541439:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1789265387.541450:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789265387.541451:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417537280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265387.541501:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3642:x1876180417537280:12345-0@lo:400:kworker.0 Request processed in 54us (1301us total) trans 0 rc 0/0 00000100:00080000:1.0:1789265387.541502:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265387.541510:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265387.541513:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00080000:1.0:1789265387.541515:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265387.541572:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417537280:0@lo:400:kworker.0 00000100:00100000:3.0:1789265387.541586:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417537792:0@lo:400:kworker.0 00000100:00100000:3.0:1789265387.541596:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417538304:0@lo:400:kworker.0 00000100:00100000:2.0:1789265387.541858:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417538816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1272us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265387.541867:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789265387.542476:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417537664:0@lo:400:kworker.0 00000100:00100000:0.0:1789265387.542492:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417538176:0@lo:400:kworker.0 00000100:00100000:0.0:1789265387.542539:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265387.542573:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417538688:0@lo:400:kworker.0 00000100:00100000:0.0:1789265387.542598:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265387.542702:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8492c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417538816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265387.545126:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417538176 00000100:00100000:2.0:1789265387.545147:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417538176 00000100:00100000:1.0:1789265387.546042:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417538688 00000100:00100000:1.0:1789265387.546053:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417538688 00000100:00100000:1.0:1789265387.546353:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789265387.546366:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417538688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265387.546510:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417538688:12345-0@lo:400:kworker.0 Request processed in 146us (3910us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265387.546518:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:3.0:1789265387.549448:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265387.549775:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789265387.549805:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417538176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265387.549948:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417538176:12345-0@lo:400:kworker.0 Request processed in 150us (7398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265387.549956:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789265387.550043:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417538176:0@lo:400:kworker.0 00000100:00100000:0.0:1789265387.550058:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417538688:0@lo:400:kworker.0 00010000:00010000:0.0:1789265387.841337:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789265388.225323:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265388.225337:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265388.225486:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:2.0:1789265388.225495:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789265388.802463:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789265388.865910:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789265389.571888:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1789265389.571907:0:6495:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1789265389.571953:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1789265389.571966:0:6548:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:02000400:0.0:1789265389.882081:0:15007:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 22:09:49 (1789265389) 00010000:00010000:2.0:1789265389.919946:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265390.085134:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417538944:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265390.085207:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265390.087264:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417538944 00000100:00100000:3.0:1789265390.087280:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417538944 00000100:00100000:3.0:1789265390.087334:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789265390.087344:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417538944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789265390.087380:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789265390.087459:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417538944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (2251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265390.087477:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789265390.089877:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417538944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265390.089907:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265390.089919:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417539072:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265390.089977:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265390.090047:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417539072 00000100:00100000:3.0:1789265390.090053:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417539072 00000100:00100000:3.0:1789265390.090091:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789265390.090099:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417539072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265390.090787:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789265390.090844:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417539072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 744us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265390.090853:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789265390.091249:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417539072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265390.604966:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417539200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265390.605057:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265390.607657:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265390.607674:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb848e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417539328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265390.607744:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265390.610990:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417539200 00000100:00100000:2.0:1789265390.611004:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417539200 00000100:00100000:2.0:1789265390.611085:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417539328 00000100:00100000:2.0:1789265390.611089:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417539328 00000100:00100000:2.0:1789265390.611111:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789265390.611227:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417539200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789265390.611258:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789265390.611349:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417539200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (6292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265390.611356:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789265390.611382:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789265390.611388:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417539328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265390.611398:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789265390.611426:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417539328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (3682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265390.611433:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:3.0:1789265390.611561:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265390.611675:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb848e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417539328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265390.611693:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417539200:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789265390.977181:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265391.946790:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265391.946854:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265391.946939:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399668096 00000100:00100000:3.0:1789265391.946950:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399668096 00000100:00100000:3.0:1789265391.947000:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 397 00000100:00100000:3.0:1789265391.947009:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2395:x1876180399668096:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265391.947092:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2395:x1876180399668096:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 83us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265391.947099:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 397 00000100:00100000:1.0:1789265391.947453:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265391.947476:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265391.950757:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265391.950828:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399668352 00000100:00100000:0.0:1789265391.950837:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399668352 00000100:00100000:0.0:1789265391.950903:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399668864 00000100:00100000:0.0:1789265391.950907:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399668864 00000100:00100000:0.0:1789265391.950934:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 360 00000100:00100000:0.0:1789265391.950942:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399668352:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265391.951043:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399668352:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 101us (4188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265391.951050:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 360 00000100:00100000:0.0:1789265391.951068:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 361 00000100:00100000:0.0:1789265391.951075:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2395:x1876180399668864:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265391.951099:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2395:x1876180399668864:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 25us (3622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265391.951107:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 361 00000100:00080000:2.0:1789265391.951603:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265391.951715:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399668608 00000100:00100000:0.0:1789265391.951720:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399668608 00000100:00100000:0.0:1789265391.951795:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 141 00000100:00100000:0.0:1789265391.951802:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399668608:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265391.951836:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2395:x1876180399668608:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 35us (4384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265391.951843:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 141 00000100:00100000:1.0:1789265391.952878:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265391.952909:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265391.952935:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399668224 00000100:00100000:1.0:1789265391.952940:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399668224 00000100:00100000:0.0:1789265391.952992:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399668736 00000100:00100000:0.0:1789265391.952996:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399668736 00000100:00080000:2.0:1789265391.953038:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265391.953042:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265391.953054:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399668480 00000100:00100000:2.0:1789265391.953057:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399668480 00000100:00100000:2.0:1789265391.953096:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 142 00000100:00100000:2.0:1789265391.953105:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+7:2395:x1876180399668480:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265391.953157:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+7:2395:x1876180399668480:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 53us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265391.953164:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 142 00000100:00080000:2.0:1789265391.953253:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265391.953616:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 362 00000100:00100000:1.0:1789265391.953625:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+18:2395:x1876180399668224:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265391.953673:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+18:2395:x1876180399668224:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 50us (2924us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265391.953679:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 362 00000100:00100000:0.0:1789265391.953987:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 363 00000100:00100000:0.0:1789265391.953994:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:2395:x1876180399668736:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265391.954047:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:2395:x1876180399668736:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 53us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265391.954054:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 363 00010000:00010000:2.0:1789265392.001247:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265392.130732:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265392.130757:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb848e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417539456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265392.130841:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265392.131105:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417539456 00000100:00100000:2.0:1789265392.131115:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417539456 00000100:00100000:2.0:1789265392.131190:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789265392.131201:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417539456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789265392.131235:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265392.131374:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417539456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 174us (530us total) trans 0 rc 0/0 00000100:00080000:1.0:1789265392.131381:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265392.131385:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789265392.132929:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb848e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417539456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265392.641889:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265392.641915:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417539968:0@lo:400:kworker.0 00000100:00100000:0.0:1789265392.641976:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417539712:0@lo:400:kworker.0 00000100:00100000:3.0:1789265392.641979:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417539840:0@lo:400:kworker.0 00000100:00100000:1.0:1789265392.641992:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265392.642051:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265392.642089:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417539584:0@lo:400:kworker.0 00000100:00100000:2.0:1789265392.642106:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417540096:0@lo:400:kworker.0 00000100:00100000:1.0:1789265392.642134:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265392.642357:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265392.645470:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417540480:0@lo:400:kworker.0 00000100:00100000:1.0:1789265392.645528:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265392.645560:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417541120:0@lo:400:kworker.0 00000100:00100000:1.0:1789265392.645595:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265392.645638:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417539584 00000100:00100000:1.0:1789265392.645646:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417539584 00000100:00100000:1.0:1789265392.645692:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1789265392.645700:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3643:x1876180417539584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265392.645769:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3643:x1876180417539584:12345-0@lo:400:kworker.0 Request processed in 69us (3634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265392.645776:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1789265392.645807:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417540480 00000100:00100000:1.0:1789265392.645812:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417540480 00000100:00100000:1.0:1789265392.645842:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417541120 00000100:00100000:1.0:1789265392.645845:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417541120 00000100:00100000:1.0:1789265392.645866:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789265392.645873:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417540480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265392.646845:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417540352:0@lo:400:kworker.0 00000100:00100000:0.0:1789265392.646968:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417540224:0@lo:400:kworker.0 00000100:00100000:1.0:1789265392.647013:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417540480:12345-0@lo:400:kworker.0 Request processed in 1139us (1483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265392.647013:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265392.647049:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876180417540736:0@lo:400:kworker.0 00000100:00100000:0.0:1789265392.647070:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265392.647112:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789265392.647123:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417541120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265392.647159:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417541120:12345-0@lo:400:kworker.0 Request processed in 38us (1563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265392.647169:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789265392.647175:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789265392.647209:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417539712 00000100:00100000:1.0:1789265392.647214:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417539712 00000100:00100000:0.0:1789265392.647223:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417540224 00000100:00100000:0.0:1789265392.647229:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417540224 00000100:00100000:1.0:1789265392.647251:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417540736 00000100:00100000:1.0:1789265392.647255:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417540736 00000100:00100000:0.0:1789265392.647266:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1789265392.647277:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417539712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265392.647282:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1789265392.647292:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417540224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265392.647322:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417539712:12345-0@lo:400:kworker.0 Request processed in 47us (5302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265392.647329:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1789265392.647337:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417540224:12345-0@lo:400:kworker.0 Request processed in 46us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265392.647345:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1789265392.647352:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876180417540736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265392.647378:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876180417540736:12345-0@lo:400:kworker.0 Request processed in 27us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265392.647384:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1789265392.647420:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417540480:0@lo:400:kworker.0 00000100:00100000:0.0:1789265392.647447:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417541120:0@lo:400:kworker.0 00000100:00100000:0.0:1789265392.647456:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417539584:0@lo:400:kworker.0 00000100:00080000:0.0:1789265392.647488:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265392.647492:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265392.647494:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265392.647508:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417539712:0@lo:400:kworker.0 00000100:00100000:0.0:1789265392.647518:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417540224:0@lo:400:kworker.0 00000100:00100000:0.0:1789265392.647526:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876180417540736:0@lo:400:kworker.0 00000100:00100000:0.0:1789265392.647590:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265392.647612:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417540608:0@lo:400:kworker.0 00000100:00100000:0.0:1789265392.647636:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265392.647651:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8492f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417540992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265392.647671:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265392.647700:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417540096 00000100:00100000:0.0:1789265392.647704:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417540096 00000100:00100000:0.0:1789265392.647726:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1789265392.647731:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417540096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265392.647763:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417540096:12345-0@lo:400:kworker.0 Request processed in 32us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265392.647770:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1789265392.647798:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417540096:0@lo:400:kworker.0 00000100:00100000:0.0:1789265392.647822:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417540608 00000100:00100000:0.0:1789265392.647825:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417540608 00000100:00100000:2.0:1789265392.647945:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417539968 00000100:00100000:1.0:1789265392.647955:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1789265392.647957:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417539968 00000100:00100000:1.0:1789265392.647987:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417540992 00000100:00100000:1.0:1789265392.647992:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417540992 00000100:00100000:2.0:1789265392.647993:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417539840 00000100:00100000:2.0:1789265392.647998:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417539840 00000100:00100000:2.0:1789265392.648034:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789265392.648041:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417539968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265392.648065:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789265392.648074:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf610700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417540992:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265392.648086:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417539968:12345-0@lo:400:kworker.0 Request processed in 44us (6095us total) trans 0 rc 0/0 00002000:00000024:1.0:1789265392.648091:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265392.648096:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789265392.648113:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789265392.648123:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417539840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265392.648139:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf610700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417540992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265392.648155:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789265392.648162:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417539840:12345-0@lo:400:kworker.0 Request processed in 40us (6142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265392.648170:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789265392.648198:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8492f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417540992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265392.648209:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417539968:0@lo:400:kworker.0 00000100:00080000:1.0:1789265392.648233:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265392.648251:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265392.648276:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417540864:0@lo:400:kworker.0 00000100:00100000:2.0:1789265392.648300:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265392.648338:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417539840:0@lo:400:kworker.0 00000100:00100000:1.0:1789265392.648482:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417540352 00000100:00100000:1.0:1789265392.648487:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417540352 00000100:00100000:1.0:1789265392.648515:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417540864 00000100:00100000:1.0:1789265392.648519:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417540864 00000100:00100000:1.0:1789265392.648539:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1789265392.648546:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417540352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265392.648593:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417540352:12345-0@lo:400:kworker.0 Request processed in 47us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265392.648599:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1789265392.648612:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1789265392.648618:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876180417540864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265392.648647:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876180417540864:12345-0@lo:400:kworker.0 Request processed in 30us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265392.648653:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00010000:00080000:1.0:1789265392.648685:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf611500 x1876180417540352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265392.648697:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417540352:0@lo:400:kworker.0 00010000:00080000:1.0:1789265392.648708:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbf613b80 x1876180417540864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265392.648716:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417540864:0@lo:400:kworker.0 00000100:00100000:0.0:1789265392.650688:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789265392.650723:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417540608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265392.650812:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417540608:12345-0@lo:400:kworker.0 Request processed in 97us (3174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265392.650819:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789265392.650872:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417540608:0@lo:400:kworker.0 00000100:00080000:2.0:1789265392.651986:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789265393.025297:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265393.740911:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265393.741055:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399669120 00000100:00100000:3.0:1789265393.741064:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399669120 00000100:00100000:3.0:1789265393.741135:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 66 00000100:00100000:3.0:1789265393.741146:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+18:13185:x1876180399669120:12345-192.168.203.49@tcp:35:umount.0 00000100:00100000:3.0:1789265393.741414:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+19:13185:x1876180399669120:12345-192.168.203.49@tcp:35:umount.0 Request processed in 270us (513us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1789265393.741424:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 66 00000100:00080000:2.0:1789265393.741614:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265393.751582:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265393.751656:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399669376 00000100:00100000:1.0:1789265393.751676:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399669376 00000100:00100000:1.0:1789265393.751745:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 67 00000100:00100000:1.0:1789265393.751755:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+19:13185:x1876180399669376:12345-192.168.203.49@tcp:35:umount.0 00000100:00100000:1.0:1789265393.752099:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+20:13185:x1876180399669376:12345-192.168.203.49@tcp:35:umount.0 Request processed in 345us (536us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1789265393.752107:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 67 00000100:00100000:1.0:1789265393.754764:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265393.760183:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399669632 00000100:00100000:3.0:1789265393.760198:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399669632 00000100:00100000:2.0:1789265393.770038:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 68 00000100:00100000:2.0:1789265393.770052:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccacdcb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+20:13185:x1876180399669632:12345-192.168.203.49@tcp:35:umount.0 00000100:00100000:2.0:1789265393.770297:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccacdcb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b43750b-84cf-4d62-9028-e016267b6509+21:13185:x1876180399669632:12345-192.168.203.49@tcp:35:umount.0 Request processed in 247us (15542us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1789265393.770320:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 68 00000100:00100000:0.0:1789265393.776604:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265393.776666:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399669888 00000100:00100000:3.0:1789265393.776675:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399669888 00000100:00100000:3.0:1789265393.776725:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 69 00000100:00100000:3.0:1789265393.776734:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+21:13185:x1876180399669888:12345-192.168.203.49@tcp:35:umount.0 00000100:00100000:3.0:1789265393.777081:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b43750b-84cf-4d62-9028-e016267b6509+22:13185:x1876180399669888:12345-192.168.203.49@tcp:35:umount.0 Request processed in 346us (486us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1789265393.777089:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 69 00000100:00100000:0.0:1789265393.781850:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265393.781887:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265393.781913:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265393.781948:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265393.782078:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399670272 00000100:00100000:2.0:1789265393.782088:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399670272 00000100:00100000:2.0:1789265393.782156:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399670144 00000100:00100000:2.0:1789265393.782160:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399670144 00000100:00100000:2.0:1789265393.782174:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399670400 00000100:00100000:2.0:1789265393.782177:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399670400 00000100:00100000:2.0:1789265393.782192:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 20 00000100:00100000:2.0:1789265393.782201:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf612680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f6ab780-f65a-4da8-8aa9-108982c08b32+15:2395:x1876180399670272:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265393.782225:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265393.782242:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccb520be00/0x9272d942b4a965f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbc62 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265393.782257:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265393.782299:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf612680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f6ab780-f65a-4da8-8aa9-108982c08b32+14:2395:x1876180399670272:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 99us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265393.782306:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 20 00000100:00100000:2.0:1789265393.782323:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 21 00000100:00100000:2.0:1789265393.782329:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf610000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f6ab780-f65a-4da8-8aa9-108982c08b32+13:2395:x1876180399670144:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265393.782335:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265393.782343:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccb520b200/0x9272d942b4a966b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbca1 expref: 13 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265393.782350:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265393.782378:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf610000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f6ab780-f65a-4da8-8aa9-108982c08b32+12:2395:x1876180399670144:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 49us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265393.782384:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 21 00000100:00100000:2.0:1789265393.782408:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 22 00000100:00100000:2.0:1789265393.782414:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf612d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f6ab780-f65a-4da8-8aa9-108982c08b32+11:2395:x1876180399670400:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265393.782421:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265393.782430:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81692200/0x9272d942b4a968cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd7a expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265393.782438:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265393.782457:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf612d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:2395:x1876180399670400:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 43us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265393.782463:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 22 00000100:00100000:1.0:1789265393.782912:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399670016 00000100:00100000:1.0:1789265393.782917:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399670016 00000100:00100000:1.0:1789265393.782966:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 80 00000100:00100000:1.0:1789265393.782973:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+5:2392:x1876180399670016:12345-192.168.203.49@tcp:9:umount.0 00000020:00000080:1.0:1789265393.782996:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a969d0 00000100:00080000:1.0:1789265393.783003:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9fcc82d49000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789265393.783066:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1789265393.783201:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b43750b-84cf-4d62-9028-e016267b6509+2:2392:x1876180399670016:12345-192.168.203.49@tcp:9:umount.0 Request processed in 228us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265393.783452:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 80 00010000:00010000:1.0:1789265393.783479:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789265393.784238:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265393.799505:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265393.800109:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399670784 00000100:00100000:0.0:1789265393.800119:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399670784 00000100:00100000:0.0:1789265393.800190:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 81 00000100:00100000:0.0:1789265393.800200:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+7:2392:x1876180399670784:12345-192.168.203.49@tcp:9:umount.0 00000100:00080000:2.0:1789265393.800275:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1789265393.800319:0:8914:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a96c46 00000020:00010000:0.0:1789265393.800326:0:8914:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fccbf558000: total 0 00000100:00080000:0.0:1789265393.800330:0:8914:0:(import.c:65:import_set_state_nolock()) ffff9fccbf55d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789265393.802848:0:8914:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1789265393.803058:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b43750b-84cf-4d62-9028-e016267b6509+5:2392:x1876180399670784:12345-192.168.203.49@tcp:9:umount.0 Request processed in 2855us (3556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265393.803069:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 81 00000020:00010000:2.0:1789265393.810783:0:6504:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fccbf558000: total 0 00010000:00010000:2.0:1789265393.810929:0:6504:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fccbf558000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1789265393.812251:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb74d500/0x9272d942b4a976cd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc147 expref: 4 pid: 8914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265393.812296:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096eac9fc/0x9272d942b4a96ffe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf64 expref: 3 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265393.812311:0:6504:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fccbf558000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1789265393.812338:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265393.812341:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265393.812343:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265393.821537:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265393.821669:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399671808 00000100:00100000:1.0:1789265393.821682:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399671808 00000100:00100000:1.0:1789265393.821765:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 258 00000100:00100000:1.0:1789265393.821777:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+22:2392:x1876180399671808:12345-192.168.203.49@tcp:39:umount.0 00000020:00000080:1.0:1789265393.821820:0:6517:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a96603 00000020:00010000:1.0:1789265393.821843:0:6517:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fccbf426000: total 0 00000100:00080000:1.0:1789265393.821850:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9fccbf425800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789265393.821886:0:6517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:2.0:1789265393.821938:0:7473:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fccbf426000: total 0 00010000:00010000:2.0:1789265393.822080:0:7473:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fccbf426000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1789265393.822131:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:2.0:1789265393.822149:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789265393.822161:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb520a600/0x9272d942b4a97083 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf87 expref: 21 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265393.822189:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00000100:00100000:1.0:1789265393.822191:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b43750b-84cf-4d62-9028-e016267b6509+20:2392:x1876180399671808:12345-192.168.203.49@tcp:39:umount.0 Request processed in 412us (665us total) trans 4294967527 rc 0/0 00010000:00010000:2.0:1789265393.822195:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265393.822209:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a96edf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf17 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265393.822219:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 258 00010000:00010000:2.0:1789265393.822234:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fcc9b3f5000) 00010000:00010000:2.0:1789265393.822240:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265393.822246:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7a00/0x9272d942b4a9692f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd88 expref: 18 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265393.822270:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:2.0:1789265393.822274:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265393.822278:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f400/0x9272d942b4a9768e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc132 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265393.822298:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:2.0:1789265393.822301:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789265393.822307:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a976b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc140 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265393.822320:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fccacd4ec00) 00010000:00010000:2.0:1789265393.822321:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789265393.822324:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff200/0x9272d942b4a97370 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc060 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265393.822353:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fccacd4ed00) 00010000:00010000:2.0:1789265393.822356:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265393.822359:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fec00/0x9272d942b4a97067 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf80 expref: 14 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265393.822894:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:1.0:1789265393.822901:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789265393.822909:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a969a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbda4 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265393.822931:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:1.0:1789265393.822934:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265393.822939:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffc00/0x9272d942b4a96fbf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf4f expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265393.826060:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fcca9673900) 00010000:00010000:1.0:1789265393.826073:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789265393.826089:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe400/0x9272d942b4a96fe9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbf5d expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265393.826132:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fcca967bc00) 00010000:00010000:1.0:1789265393.826136:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789265393.826142:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5c00/0x9272d942b4a96ca1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbe7d expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265393.826164:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fccbd2b4c00) 00010000:00010000:1.0:1789265393.826166:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265393.826170:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4600/0x9272d942b4a9694b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd8f expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265393.826227:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fcb83b86e00) 00010000:00010000:1.0:1789265393.826230:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265393.826235:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a975ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc0fa expref: 8 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265393.826257:0:7473:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fccbf426000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1789265393.826308:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265393.826312:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265393.826315:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265393.836159:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265393.836271:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399671936 00000100:00100000:0.0:1789265393.836285:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399671936 00000100:00100000:0.0:1789265393.836395:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 259 00000100:00100000:0.0:1789265393.836408:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+5:2392:x1876180399671936:12345-192.168.203.49@tcp:39:umount.0 00000100:00080000:2.0:1789265393.836540:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:0.0:1789265393.836731:0:6518:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a9660a 00000100:00080000:0.0:1789265393.836758:0:6518:0:(import.c:65:import_set_state_nolock()) ffff9fccae77e000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789265393.836839:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789265393.837096:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b43750b-84cf-4d62-9028-e016267b6509+3:2392:x1876180399671936:12345-192.168.203.49@tcp:39:umount.0 Request processed in 689us (949us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789265393.837105:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 259 00010000:00010000:2.0:1789265393.837918:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265394.051273:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265395.073981:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265395.201450:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265395.201484:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417541248:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265395.201604:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265395.201614:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265395.201629:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417541376:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265395.201670:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265395.201767:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417541248 00000100:00100000:1.0:1789265395.201777:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417541248 00000100:00100000:1.0:1789265395.201854:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417541376 00000100:00100000:1.0:1789265395.201858:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417541376 00000100:00100000:1.0:1789265395.201877:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789265395.201886:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417541248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265395.201927:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789265395.201989:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417541248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265395.201997:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789265395.202014:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789265395.202056:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417541376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789265395.202075:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789265395.202109:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417541376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265395.202135:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789265395.202179:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417541376:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265395.202502:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417541248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265395.713333:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb848ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417541504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265395.713439:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265395.713542:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265395.713550:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417541632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265395.713586:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265395.715031:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417541504 00000100:00100000:3.0:1789265395.715053:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417541504 00000100:00100000:3.0:1789265395.715181:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417541632 00000100:00100000:3.0:1789265395.715185:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417541632 00000100:00100000:3.0:1789265395.715224:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789265395.715237:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417541504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265395.715288:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789265395.715407:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417541504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 172us (1967us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265395.715415:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789265395.715435:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789265395.715441:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417541632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789265395.715451:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789265395.715476:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417541632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265395.715481:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:2.0:1789265395.716145:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265395.720422:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417541632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265395.720453:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb848ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417541504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265395.841251:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265395.841307:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265395.841358:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265395.841399:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399672192 00000100:00100000:1.0:1789265395.841412:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399672192 00000100:00100000:1.0:1789265395.841474:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399672064 00000100:00100000:1.0:1789265395.841477:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399672064 00000100:00100000:1.0:1789265395.841489:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399672320 00000100:00100000:1.0:1789265395.841492:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399672320 00000100:00100000:1.0:1789265395.841510:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23 00000100:00100000:1.0:1789265395.841521:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f6ab780-f65a-4da8-8aa9-108982c08b32+12:2393:x1876180399672192:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265395.841542:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265395.841578:0:7926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b6000/0x9272d942b4a9670d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbce7 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265395.841601:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265395.841665:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f6ab780-f65a-4da8-8aa9-108982c08b32+11:2393:x1876180399672192:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 145us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265395.841673:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23 00000100:00100000:1.0:1789265395.841725:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24 00000100:00100000:1.0:1789265395.841732:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f6ab780-f65a-4da8-8aa9-108982c08b32+10:2393:x1876180399672064:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265395.841740:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265395.841750:0:7926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b6600/0x9272d942b4a96706 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbcb6 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265395.841783:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265395.841804:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f6ab780-f65a-4da8-8aa9-108982c08b32+9:2393:x1876180399672064:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 72us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265395.841811:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24 00000100:00100000:1.0:1789265395.841825:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 25 00000100:00100000:1.0:1789265395.841831:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f6ab780-f65a-4da8-8aa9-108982c08b32+8:2393:x1876180399672320:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265395.841841:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265395.841850:0:7926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81692a00/0x9272d942b4a968c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbd73 expref: 8 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265395.841860:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265395.841878:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f6ab780-f65a-4da8-8aa9-108982c08b32+7:2393:x1876180399672320:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 48us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265395.841884:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 25 00000100:00100000:3.0:1789265395.849223:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265395.849398:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399672576 00000100:00100000:1.0:1789265395.849412:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399672576 00000100:00100000:1.0:1789265395.849519:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 260 00000100:00100000:1.0:1789265395.849533:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+6:2392:x1876180399672576:12345-192.168.203.49@tcp:39:umount.0 00000020:00000080:1.0:1789265395.849595:0:6516:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a9671b 00000020:00010000:1.0:1789265395.849606:0:6516:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fcb8391e000: total 0 00000100:00080000:1.0:1789265395.849611:0:6516:0:(import.c:65:import_set_state_nolock()) ffff9fcb8391b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789265395.849653:0:6516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:1.0:1789265395.849861:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2392:x1876180399672576:12345-192.168.203.49@tcp:39:umount.0 Request processed in 330us (664us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1789265395.849870:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 260 00000020:00010000:0.0:1789265395.850195:0:6505:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fcb8391e000: total 0 00010000:00010000:0.0:1789265395.850201:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265395.850280:0:6505:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fcb8391e000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789265395.850355:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fccacd4ed00) 00010000:00010000:0.0:1789265395.850360:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265395.850370:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e800/0x9272d942b4a976db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc14e expref: 4 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265395.850415:0:6505:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fcb8391e000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789265395.850430:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265395.850432:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265395.850434:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789265395.850953:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265395.863909:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265395.864057:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399672704 00000100:00100000:0.0:1789265395.864071:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399672704 00000100:00100000:0.0:1789265395.864170:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 261 00000100:00100000:0.0:1789265395.864183:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+5:2392:x1876180399672704:12345-192.168.203.49@tcp:39:umount.0 00000020:00000080:0.0:1789265395.864240:0:8459:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a96722 00000100:00080000:0.0:1789265395.864253:0:8459:0:(import.c:65:import_set_state_nolock()) ffff9fcb8391f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789265395.864288:0:8459:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:3.0:1789265395.864427:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265395.864495:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0766e4d-45ff-4def-8795-0d9246c8f4c4+3:2392:x1876180399672704:12345-192.168.203.49@tcp:39:umount.0 Request processed in 314us (601us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789265395.864505:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 261 00000100:00080000:2.0:1789265395.864741:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265395.936295:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265395.936589:0:7458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399672960 00000100:00100000:3.0:1789265395.936603:0:7458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399672960 00000100:00100000:3.0:1789265395.936681:0:7458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 399 00000100:00100000:3.0:1789265395.936695:0:7458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+7:2392:x1876180399672960:12345-192.168.203.49@tcp:251:umount.0 00000020:00000080:3.0:1789265395.939310:0:7458:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a965e0 00000020:00010000:3.0:1789265395.939335:0:7458:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fcb83936000: total 0 00000100:00080000:3.0:1789265395.939344:0:7458:0:(import.c:65:import_set_state_nolock()) ffff9fcb83932000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789265395.939474:0:7458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5f6ab780-f65a-4da8-8aa9-108982c08b32+3:2392:x1876180399672960:12345-192.168.203.49@tcp:251:umount.0 Request processed in 2776us (3187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265395.939498:0:7458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 399 00000020:00010000:0.0:1789265395.939729:0:7473:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fcb83936000: total 0 00010000:00010000:0.0:1789265395.939829:0:7473:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fcb83936000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789265395.939875:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc80030000/0x9272d942b4a966b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cbca8 expref: 2 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265395.939892:0:7473:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fcb83936000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1789265395.939905:0:7473:0:(genops.c:885:class_export_put()) final put ffff9fcb83936000/5f6ab780-f65a-4da8-8aa9-108982c08b32 00010000:00010000:0.0:1789265395.939930:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265395.939932:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265395.939934:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789265395.941046:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb83936000/5f6ab780-f65a-4da8-8aa9-108982c08b32 for MGS 00000020:00000080:3.0:1789265395.941109:0:14028:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb83932000 for MGS 00010000:00010000:2.0:1789265396.102731:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265397.125951:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265397.249565:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb848e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417541760:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265397.249633:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265397.255268:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417541760 00000100:00100000:2.0:1789265397.255282:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417541760 00000100:00100000:2.0:1789265397.255353:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789265397.255363:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417541760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789265397.255394:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265397.255483:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417541760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (5848us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265397.255490:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:1.0:1789265397.255607:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265397.255722:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb848e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417541760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265397.761712:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417541888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265397.761791:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265397.762155:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417542016:0@lo:400:kworker.0 00000100:00100000:3.0:1789265397.762224:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265397.762253:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417542528:0@lo:400:kworker.0 00000100:00100000:3.0:1789265397.762279:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265397.762298:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417543040:0@lo:400:kworker.0 00000100:00100000:3.0:1789265397.762321:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265397.762342:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789265397.762347:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417542144:0@lo:400:kworker.0 00000100:00100000:3.0:1789265397.762368:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265397.762384:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417542656:0@lo:400:kworker.0 00000100:00100000:3.0:1789265397.762404:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265397.762420:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417543168:0@lo:400:kworker.0 00000100:00100000:3.0:1789265397.762438:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265397.762468:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417542528 00000100:00100000:3.0:1789265397.762476:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417542528 00000100:00100000:3.0:1789265397.762533:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417542144 00000100:00100000:3.0:1789265397.762537:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417542144 00000100:00100000:3.0:1789265397.762565:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417542656 00000100:00100000:3.0:1789265397.762567:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417542656 00000100:00100000:3.0:1789265397.762588:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417543168 00000100:00100000:3.0:1789265397.762591:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417543168 00000100:00100000:3.0:1789265397.762609:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1789265397.762617:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417542528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265397.762670:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417542528:12345-0@lo:400:kworker.0 Request processed in 53us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265397.762677:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1789265397.762695:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1789265397.762701:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417542144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265397.762740:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417542144:12345-0@lo:400:kworker.0 Request processed in 38us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265397.762747:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1789265397.762760:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1789265397.762766:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417542656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265397.762791:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417542656:12345-0@lo:400:kworker.0 Request processed in 25us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265397.762796:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1789265397.762807:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1789265397.762813:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417543168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265397.762839:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417543168:12345-0@lo:400:kworker.0 Request processed in 26us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265397.762859:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1789265397.762900:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417542144:0@lo:400:kworker.0 00000100:00100000:3.0:1789265397.762912:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417542656:0@lo:400:kworker.0 00000100:00100000:3.0:1789265397.762920:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417543168:0@lo:400:kworker.0 00000100:00100000:3.0:1789265397.762929:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417542528:0@lo:400:kworker.0 00000100:00100000:0.0:1789265397.763399:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417541888 00000100:00100000:0.0:1789265397.763404:0:9135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417541888 00000100:00100000:0.0:1789265397.763450:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789265397.763465:0:9135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417541888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265397.763484:0:9135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265397.763551:0:9135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417541888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (1746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265397.763558:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789265397.765770:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417542272:0@lo:400:kworker.0 00000100:00100000:2.0:1789265397.765873:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265397.765943:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8492f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417542784:0@lo:400:kworker.0 00000100:00100000:2.0:1789265397.765983:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265397.766002:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417543296:0@lo:400:kworker.0 00000100:00100000:2.0:1789265397.766036:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265397.766067:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789265397.766075:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417542400:0@lo:400:kworker.0 00000100:00100000:2.0:1789265397.766286:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265397.766307:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417542912:0@lo:400:kworker.0 00000100:00100000:2.0:1789265397.766329:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265397.766363:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417542272 00000100:00100000:2.0:1789265397.766369:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417542272 00000100:00100000:2.0:1789265397.766417:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417542400 00000100:00100000:2.0:1789265397.766420:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417542400 00000100:00100000:2.0:1789265397.766434:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789265397.766441:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417542272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265397.766492:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417542272:12345-0@lo:400:kworker.0 Request processed in 50us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265397.766499:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789265397.766648:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789265397.766655:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417542400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265397.766688:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417542400:12345-0@lo:400:kworker.0 Request processed in 34us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265397.766693:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789265397.766712:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417543040 00000100:00100000:2.0:1789265397.766716:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417543040 00000100:00100000:2.0:1789265397.766741:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417542912 00000100:00100000:2.0:1789265397.766744:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417542912 00000100:00100000:2.0:1789265397.766775:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789265397.766781:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417543040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265397.766818:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417543040:12345-0@lo:400:kworker.0 Request processed in 37us (4496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265397.766824:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789265397.766835:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789265397.767011:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417542784 00000100:00100000:0.0:1789265397.767015:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417542784 00000100:00100000:0.0:1789265397.767059:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417543296 00000100:00100000:0.0:1789265397.767062:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417543296 00000100:00100000:0.0:1789265397.767075:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1789265397.767195:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417542784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265397.767234:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417542784:12345-0@lo:400:kworker.0 Request processed in 153us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265397.767241:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1789265397.767254:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1789265397.767260:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb848e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417543296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265397.767287:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb848e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417543296:12345-0@lo:400:kworker.0 Request processed in 28us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265397.767292:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1789265397.767442:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417542912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265397.767474:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417542912:12345-0@lo:400:kworker.0 Request processed in 633us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265397.767479:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789265397.767933:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417543040:0@lo:400:kworker.0 00000100:00100000:2.0:1789265397.768458:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417542400:0@lo:400:kworker.0 00000100:00100000:2.0:1789265397.768473:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417542912:0@lo:400:kworker.0 00000100:00100000:2.0:1789265397.768483:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417542272:0@lo:400:kworker.0 00010000:00080000:2.0:1789265397.768498:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb8492f480 x1876180417542784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265397.768913:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8492f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417542784:0@lo:400:kworker.0 00010000:00080000:2.0:1789265397.768931:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83e2f800 x1876180417543296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265397.768940:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417543296:0@lo:400:kworker.0 00000100:00100000:3.0:1789265397.769642:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417542016 00000100:00100000:3.0:1789265397.769651:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417542016 00000100:00100000:3.0:1789265397.769712:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1789265397.769722:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb08ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3643:x1876180417542016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265397.769809:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb08ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3643:x1876180417542016:12345-0@lo:400:kworker.0 Request processed in 78us (7575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265397.769841:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1789265397.770712:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417541888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265397.770749:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417542016:0@lo:400:kworker.0 00000100:00080000:1.0:1789265397.772418:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265397.772428:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265397.772431:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265397.772434:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1789265398.022709:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1789265398.060008:0:15203:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1789265398.099235:0:15203:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789265398.099295:0:15203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520a400/0x9272d942b4a96688 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9668f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265398.099311:0:15203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520a400/0x9272d942b4a96688 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9668f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265398.099324:0:15203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520a400/0x9272d942b4a96688 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a9668f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265398.099332:0:15203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fccb520a400/0x9272d942b4a96688 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a9668f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265398.099355:0:15203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789265398.099360:0:15203:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789265398.099385:0:15203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789265398.099389:0:15203:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789265398.099394:0:15203:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789265398.099428:0:15203:0:(import.c:65:import_set_state_nolock()) ffff9fccb092f800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1789265398.100202:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265398.100211:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fccb520a400/0x9272d942b4a96688 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a9668f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.100221:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520a400 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:1.0:1789265398.100224:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fccb520a400/0x9272d942b4a96688 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a9668f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.100234:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fccb520a400/0x9272d942b4a96688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a9668f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265398.100241:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fccb520a400/0x9272d942b4a96688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a9668f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265398.100247:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789265398.100249:0:7473:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789265398.100251:0:7473:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789265398.100280:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fccb520a400/0x9272d942b4a96688 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a9668f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.100287:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265398.100333:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fccb520a400/0x9272d942b4a96688 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a9668f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.100340:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fccb520a400/0x9272d942b4a96688 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a9668f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.100353:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265398.100355:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265398.100357:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265398.100365:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265398.100384:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417543552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265398.100464:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265398.100524:0:7926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417543552 00000100:00100000:1.0:1789265398.100531:0:7926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417543552 00000100:00100000:1.0:1789265398.100601:0:7926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789265398.100610:0:7926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3641:x1876180417543552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265398.100622:0:7926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265398.100637:0:7926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc80030400/0x9272d942b4a9668f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a96688 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.100651:0:7926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265398.100685:0:7926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c287aa82-1100-4c72-b927-3b8d47a88a15+23:3641:x1876180417543552:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265398.100692:0:7926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789265398.100729:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417543552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265398.101940:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8492f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876180417543424:0@lo:39:umount.0 00000100:00100000:0.0:1789265398.101991:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265398.104346:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417543424 00000100:00100000:1.0:1789265398.104360:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417543424 00000100:00100000:1.0:1789265398.104515:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789265398.104526:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876180417543424:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789265398.104582:0:6517:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a961f7 00000100:00080000:1.0:1789265398.104602:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9fcc992fd800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789265398.104708:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3640:x1876180417543424:12345-0@lo:39:umount.0 Request processed in 185us (2716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265398.104717:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:1.0:1789265398.104727:0:6517:0:(genops.c:885:class_export_put()) final put ffff9fccb092d800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1789265398.104765:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789265398.104777:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccb092d800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789265398.104822:0:14028:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcc992fd800 for lustre-MDT0000 00000100:00080000:0.0:1789265398.105297:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccb092f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789265398.105314:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8492f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876180417543424:0@lo:39:umount.0 00000100:00080000:1.0:1789265398.108732:0:15203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789265398.108742:0:15203:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789265398.108750:0:15203:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789265398.109864:0:15203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe200/0x9272d942b4a96696 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9669d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.109882:0:15203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe200/0x9272d942b4a96696 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9669d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.109889:0:15203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe200/0x9272d942b4a96696 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a9669d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.109896:0:15203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe200/0x9272d942b4a96696 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a9669d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.109925:0:15203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265398.109931:0:15203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a9659a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a965a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.109938:0:15203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a9659a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a965a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.109958:0:15203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a9659a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a965a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.109965:0:15203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a9659a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a965a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.109982:0:15203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789265398.109999:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265398.110005:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe200/0x9272d942b4a96696 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a9669d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.110012:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fe200 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:1.0:1789265398.110015:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe200/0x9272d942b4a96696 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a9669d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.110046:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe200/0x9272d942b4a96696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a9669d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265398.110053:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe200/0x9272d942b4a96696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a9669d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265398.110059:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789265398.110061:0:7473:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1789265398.110112:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe200/0x9272d942b4a96696 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a9669d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.110119:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265398.110144:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe200/0x9272d942b4a96696 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a9669d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.110162:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe200/0x9272d942b4a96696 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a9669d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.110177:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265398.110180:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a9659a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a965a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.110186:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7400 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:1.0:1789265398.110189:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a9659a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a965a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.110194:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a9659a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a965a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265398.110200:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a9659a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a965a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265398.110204:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789265398.110206:0:7473:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1789265398.110208:0:7473:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1789265398.110222:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a9659a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a965a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.110229:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265398.110235:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a9659a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a965a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.110241:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7400/0x9272d942b4a9659a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a965a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.110261:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265398.110263:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265398.110264:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265398.110284:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417543680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265398.110351:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265398.110395:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265398.111201:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417543808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265398.111239:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265398.111281:0:15203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a968fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96905 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.111292:0:15203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a968fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96905 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.111299:0:15203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a968fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a96905 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.111305:0:15203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a968fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a96905 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.111321:0:15203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265398.111330:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265398.111334:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a968fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a96905 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.111341:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81693600 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:1.0:1789265398.111344:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a968fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a96905 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.111360:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a968fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a96905 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265398.111366:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a968fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a96905 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265398.111371:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789265398.111374:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789265398.111375:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789265398.111395:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a968fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a96905 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265398.111702:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265398.111718:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417543680 00000100:00100000:0.0:1789265398.111726:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417543680 00000100:00100000:0.0:1789265398.111785:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417543808 00000100:00100000:0.0:1789265398.111788:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417543808 00000100:00100000:0.0:1789265398.111809:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789265398.111817:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+24:3643:x1876180417543680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265398.111830:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265398.111846:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccb520a200/0x9272d942b4a9669d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a96696 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265398.111870:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265398.111915:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+23:3643:x1876180417543680:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265398.111922:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789265398.111938:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789265398.111944:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+22:3643:x1876180417543808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265398.111952:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265398.111961:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81490e00/0x9272d942b4a965a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a9659a expref: 22 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265398.111970:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265398.111992:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+21:3643:x1876180417543808:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265398.111998:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789265398.112053:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417543808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265398.112062:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417543680:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265398.112684:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789265398.112734:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417543936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265398.112773:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265398.112831:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a968fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a96905 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.112841:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc81693600/0x9272d942b4a968fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a96905 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.112868:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265398.112871:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265398.112873:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265398.112891:0:15203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a96156 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9615d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.112898:0:15203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a96156 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9615d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.112904:0:15203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a96156 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a9615d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.112921:0:15203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a96156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a9615d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.112934:0:15203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789265398.112939:0:15203:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1789265398.112943:0:15203:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1789265398.112980:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265398.112986:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a96156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a9615d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.112992:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7600 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:1.0:1789265398.112994:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a96156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a9615d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.113000:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a96156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a9615d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265398.113006:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a96156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a9615d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265398.113011:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789265398.113013:0:7473:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789265398.113015:0:7473:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1789265398.113052:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a96156 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a9615d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.113058:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789265398.118516:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265398.118551:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417544064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265398.118642:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265398.118711:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417543936 00000100:00100000:0.0:1789265398.118718:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417543936 00000100:00100000:0.0:1789265398.118768:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417544064 00000100:00100000:0.0:1789265398.118770:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417544064 00000100:00100000:0.0:1789265398.118790:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265398.118798:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf613480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+22:3641:x1876180417543936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265398.118811:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265398.118828:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81692000/0x9272d942b4a96905 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a968fe expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265398.118845:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265398.119341:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789265398.119352:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc83e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+21:3641:x1876180417544064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265398.119362:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265398.119372:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc8152e400/0x9272d942b4a9615d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a96156 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265398.119384:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265398.121819:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a96156 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a9615d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.121856:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a96156 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a9615d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265398.121885:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265398.121887:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265398.121890:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265398.125807:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc83e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c287aa82-1100-4c72-b927-3b8d47a88a15+20:3641:x1876180417544064:12345-0@lo:103:ldlm_bl.0 Request processed in 6448us (7155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265398.125840:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789265398.125906:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417544064:0@lo:103:ldlm_bl.0 00000020:01000004:1.0:1789265398.126529:0:15203:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1789265398.126534:0:15203:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1789265398.126552:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265398.126559:0:15203:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1789265398.126566:0:15203:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fcb83935000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789265398.126572:0:15203:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fccaea50800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789265398.126577:0:15203:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fccbc7ea800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789265398.126581:0:15203:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fccbc7eb800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1789265398.127272:0:15203:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9fcb8391e000 a0766e4d-45ff-4def-8795-0d9246c8f4c4 192.168.203.49@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789265398.127277:0:15203:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9fccbf426000 5b43750b-84cf-4d62-9028-e016267b6509 192.168.203.49@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:1.0:1789265398.127283:0:15203:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9fcc837e99b8) has exports, disconnecting them 00000020:00080000:1.0:1789265398.127288:0:15203:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fcb83935000), last request at 1789265397 00000020:00000080:1.0:1789265398.127296:0:15203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a96507 00000100:00080000:1.0:1789265398.127312:0:15203:0:(import.c:65:import_set_state_nolock()) ffff9fcb83930000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789265398.127364:0:15203:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fcb83935000): rc 0 00000020:00000080:1.0:1789265398.127366:0:15203:0:(genops.c:885:class_export_put()) final put ffff9fcb83935000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1789265398.127376:0:15203:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fccaea50800), last request at 1789265397 00000020:00000080:1.0:1789265398.127379:0:15203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a963ef 00000100:00080000:1.0:1789265398.127387:0:15203:0:(import.c:65:import_set_state_nolock()) ffff9fccaea53800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789265398.127503:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789265398.128315:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb83935000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1789265398.128372:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb83930000 for lustre-MDT0000 00000020:00080000:1.0:1789265398.128389:0:15203:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fccaea50800): rc 0 00000020:00000080:1.0:1789265398.128393:0:15203:0:(genops.c:885:class_export_put()) final put ffff9fccaea50800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1789265398.128413:0:15203:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fccbc7ea800), last request at 1789265164 00000020:00000080:1.0:1789265398.128419:0:15203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a9631d 00000100:00080000:1.0:1789265398.128425:0:15203:0:(import.c:65:import_set_state_nolock()) ffff9fccbc7ed800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789265398.128517:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf613480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c287aa82-1100-4c72-b927-3b8d47a88a15+19:3641:x1876180417543936:12345-0@lo:103:ldlm_bl.0 Request processed in 9717us (15740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265398.128529:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265398.128639:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c287aa82-1100-4c72-b927-3b8d47a88a15:3641:1876180417543936:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789265398.130452:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccaea50800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789265398.130514:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccaea53800 for lustre-MDT0000 00010000:00010000:2.0:1789265398.130796:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265398.135356:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789265398.135507:0:15203:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fccbc7ea800): rc 0 00000020:00000080:1.0:1789265398.135513:0:15203:0:(genops.c:885:class_export_put()) final put ffff9fccbc7ea800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1789265398.135592:0:15203:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fccbc7eb800), last request at 1789265164 00000020:00000080:1.0:1789265398.135601:0:15203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a962e5 00000100:00080000:1.0:1789265398.135611:0:15203:0:(import.c:65:import_set_state_nolock()) ffff9fccbc7ec000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789265398.135631:0:15203:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:1.0:1789265398.135705:0:15203:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fccbc7eb800): rc 0 00000004:00000080:1.0:1789265398.135712:0:15203:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbf45c178fae0 00000100:00080000:1.0:1789265398.135730:0:15203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789265398.135733:0:15203:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:0.0:1789265398.136255:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789265398.136909:0:15203:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789265398.136938:0:15203:0:(import.c:65:import_set_state_nolock()) ffff9fccbc564000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789265398.136995:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417544192:0@lo:39:umount.0 00000100:00100000:0.0:1789265398.137239:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789265398.137550:0:15203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789265398.137554:0:15203:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1789265398.137565:0:15203:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789265398.137704:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417544192 00000100:00100000:2.0:1789265398.137713:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417544192 00000100:00100000:2.0:1789265398.137759:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789265398.137770:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876180417544192:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789265398.137796:0:7479:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a9632b 00000100:00080000:2.0:1789265398.137802:0:7479:0:(import.c:65:import_set_state_nolock()) ffff9fccbd27c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789265398.137821:0:7479:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000020:00000080:3.0:1789265398.137986:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbc7ea800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789265398.138040:0:14028:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccbc7ed800 for lustre-MDT0000 00000100:00080000:1.0:1789265398.138151:0:15203:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789265398.138165:0:15203:0:(import.c:65:import_set_state_nolock()) ffff9fcb821f6000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789265398.141568:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417544320:0@lo:9:umount.0 00000100:00100000:0.0:1789265398.141659:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265398.141779:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417544320 00000100:00100000:3.0:1789265398.141787:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417544320 00000100:00100000:3.0:1789265398.141845:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789265398.141855:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876180417544320:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789265398.141883:0:8435:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a96489 00000100:00080000:3.0:1789265398.141892:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9fcc992f8800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789265398.141934:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1789265398.142103:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3640:x1876180417544320:12345-0@lo:9:umount.0 Request processed in 249us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265398.142111:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789265398.142438:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3640:x1876180417544192:12345-0@lo:39:umount.0 Request processed in 4668us (5196us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789265398.142448:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00010000:00010000:2.0:1789265398.142482:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265398.142490:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789265398.142626:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccbc564000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789265398.142635:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417544192:0@lo:39:umount.0 00000100:00080000:0.0:1789265398.142669:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb821f6000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789265398.142685:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789265398.142687:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789265398.142690:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417544320:0@lo:9:umount.0 00000100:00080000:1.0:1789265398.142958:0:15203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789265398.142962:0:15203:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1789265398.143194:0:15203:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789265398.143341:0:15203:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789265398.143369:0:15203:0:(import.c:65:import_set_state_nolock()) ffff9fccae77a000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789265398.143516:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417544448:0@lo:9:umount.0 00000100:00100000:0.0:1789265398.143568:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1789265398.143739:0:15203:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9fcc837e99b8) has no exports 00000100:00100000:3.0:1789265398.144352:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417544448 00000100:00100000:3.0:1789265398.144360:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417544448 00000100:00100000:1.0:1789265398.144483:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789265398.144493:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876180417544448:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789265398.144518:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a965cb 00000100:00080000:1.0:1789265398.144525:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9fcb8391a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789265398.144577:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1789265398.144709:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3640:x1876180417544448:12345-0@lo:9:umount.0 Request processed in 216us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265398.144716:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:2.0:1789265398.144829:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789265398.144992:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccae77a000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789265398.145010:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789265398.145012:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789265398.145015:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417544448:0@lo:9:umount.0 00010000:00010000:2.0:1789265398.145793:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789265398.157712:0:15203:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9fcc837e99b8) has no exports 00000020:00000080:1.0:1789265398.258839:0:15203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a961b1 00000020:00000080:1.0:1789265398.258855:0:15203:0:(genops.c:885:class_export_put()) final put ffff9fccb4fdf000/lustre-QMT0000_UUID 00000020:01000000:1.0:1789265398.258874:0:15203:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789265398.260431:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccb4fdf000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1789265398.260462:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265398.260473:0:15203:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789265398.260477:0:15203:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9fcc837e8000) has no exports 00000020:00000080:0.0:1789265398.261689:0:15203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a961aa 00000020:00000080:0.0:1789265398.261703:0:15203:0:(genops.c:885:class_export_put()) final put ffff9fccb4fc4000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789265398.261772:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265398.261781:0:15203:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789265398.261784:0:15203:0:(genops.c:885:class_export_put()) final put ffff9fccb4fc6000/lustre-QMT0000_UUID 00000020:00000080:0.0:1789265398.261786:0:15203:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccb4fc6000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1789265398.261791:0:15203:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1789265398.261976:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccb4fc4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1789265399.169321:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789265399.811175:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789265399.811186:0:6495:0:(genops.c:885:class_export_put()) final put ffff9fccbc7eb800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1789265399.811213:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a0766e4d-45ff-4def-8795-0d9246c8f4c4 00000001:00080000:2.0:1789265399.811221:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1789265399.811224:0:6495:0:(genops.c:885:class_export_put()) final put ffff9fcb8391e000/a0766e4d-45ff-4def-8795-0d9246c8f4c4 00000001:00100000:2.0:1789265399.811229:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5b43750b-84cf-4d62-9028-e016267b6509 00000001:00080000:2.0:1789265399.811232:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1789265399.811253:0:6495:0:(genops.c:885:class_export_put()) final put ffff9fccbf426000/5b43750b-84cf-4d62-9028-e016267b6509 00000020:00000080:0.0:1789265399.811590:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbc7eb800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1789265399.811666:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb8391e000/a0766e4d-45ff-4def-8795-0d9246c8f4c4 for lustre-MDT0000 00000020:00000080:0.0:1789265399.811699:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbf426000/5b43750b-84cf-4d62-9028-e016267b6509 for lustre-MDT0000 00000020:00000080:0.0:1789265399.811730:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccbc7ec000 for lustre-MDT0000 00000020:00000080:0.0:1789265399.811735:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb8391b000 for lustre-MDT0000 00000020:00000080:0.0:1789265399.811740:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccbf425800 for lustre-MDT0000 00000001:00100000:3.0:1789265399.819684:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789265399.819701:0:7448:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1789265399.819707:0:7448:0:(genops.c:885:class_export_put()) final put ffff9fccbd279000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789265399.819732:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a0766e4d-45ff-4def-8795-0d9246c8f4c4 00000001:00080000:3.0:1789265399.819743:0:7448:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1789265399.819745:0:7448:0:(genops.c:885:class_export_put()) final put ffff9fcb8391a000/a0766e4d-45ff-4def-8795-0d9246c8f4c4 00000001:00100000:3.0:1789265399.819752:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5b43750b-84cf-4d62-9028-e016267b6509 00000001:00080000:3.0:1789265399.819755:0:7448:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1789265399.819757:0:7448:0:(genops.c:885:class_export_put()) final put ffff9fccbf426800/5b43750b-84cf-4d62-9028-e016267b6509 00000020:00000080:1.0:1789265399.820350:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbd279000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1789265399.820457:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb8391a000/a0766e4d-45ff-4def-8795-0d9246c8f4c4 for lustre-MDT0001 00000020:00000080:1.0:1789265399.820489:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbf426800/5b43750b-84cf-4d62-9028-e016267b6509 for lustre-MDT0001 00000020:00000080:1.0:1789265399.820515:0:14028:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccbd27c000 for lustre-MDT0001 00000020:00000080:1.0:1789265399.820520:0:14028:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb8391f000 for lustre-MDT0001 00000020:00000080:1.0:1789265399.820523:0:14028:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccae77e000 for lustre-MDT0001 00000001:00100000:2.0:1789265399.820714:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789265399.820719:0:8428:0:(genops.c:885:class_export_put()) final put ffff9fcc992fa000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789265399.820739:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5b43750b-84cf-4d62-9028-e016267b6509 00000020:00000080:2.0:1789265399.820741:0:8428:0:(genops.c:885:class_export_put()) final put ffff9fccbf558000/5b43750b-84cf-4d62-9028-e016267b6509 00000020:00000080:1.0:1789265399.820915:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc992fa000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789265399.820939:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbf558000/5b43750b-84cf-4d62-9028-e016267b6509 for lustre-OST0000 00000020:00000080:1.0:1789265399.820954:0:14028:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcc992f8800 for lustre-OST0000 00000020:00000080:1.0:1789265399.820963:0:14028:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccbf55d000 for lustre-OST0000 00000001:00100000:0.0:1789265399.823839:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789265399.823863:0:9515:0:(genops.c:885:class_export_put()) final put ffff9fcb8391e800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789265399.823888:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5b43750b-84cf-4d62-9028-e016267b6509 00000020:00000080:0.0:1789265399.823891:0:9515:0:(genops.c:885:class_export_put()) final put ffff9fcc82d4e800/5b43750b-84cf-4d62-9028-e016267b6509 00000020:00000080:2.0:1789265399.823941:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb8391e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789265399.823996:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc82d4e800/5b43750b-84cf-4d62-9028-e016267b6509 for lustre-OST0001 00000020:00000080:2.0:1789265399.824012:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb8391a800 for lustre-OST0001 00000020:00000080:2.0:1789265399.824016:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcc82d49000 for lustre-OST0001 00010000:00010000:2.0:1789265400.193248:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789265400.321962:0:15203:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fcc887fc660 - data ffff9fcc87acb6c0/ffff9fccbf4bdc00 00000020:01000000:0.0:1789265400.322181:0:15203:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fccacd24060 - data ffff9fcc87953948/ffff9fccad95b000 00000100:00100000:1.0:1789265400.323503:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265400.323534:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417544576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265400.323602:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265400.323942:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417544576 00000100:00100000:3.0:1789265400.323951:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417544576 00000100:00100000:3.0:1789265400.324013:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789265400.324056:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876180417544576:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1789265400.324075:0:6521:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789265400.324117:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876180417544576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (515us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789265400.324125:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:02020000:1.0:1789265400.324267:0:3644:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1789265400.341819:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789265400.341827:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fccbc578000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789265400.341831:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789265400.358828:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fccbc578000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789265400.358841:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 215 00000100:00080000:1.0:1789265400.358851:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9fccbc578000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:0.0:1789265400.359011:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fccbf612d80 x1876180417544704/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265400.359790:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417544704:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789265400.359858:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:0.0:1789265400.360554:0:15203:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:3.0:1789265400.361134:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417544704 00000100:00100000:3.0:1789265400.361143:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417544704 00000100:00100000:3.0:1789265400.361232:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789265400.361241:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1876180417544704:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1789265400.361258:0:6522:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789265400.368624:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1876180417544704:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 7375us (8757us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789265400.368640:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00080000:1.0:1789265400.369631:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccbc578000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265400.369641:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789265400.369646:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417544704:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1789265400.405198:0:15203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789265400.405207:0:15203:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1789265400.405226:0:15203:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9fcb83e2c000 x1876180417544192/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789265408 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265400.405253:0:15203:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789265400.415188:0:15203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789265400.415195:0:15203:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1789265400.415219:0:15203:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789265400.415222:0:15203:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789265400.415564:0:8912:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789265400.415569:0:8912:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1789265400.415580:0:8912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789265400.417055:0:15203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789265400.417290:0:15203:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1789265400.417315:0:15203:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789265400.417317:0:15203:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789265400.417841:0:10000:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789265400.417846:0:10000:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1789265400.417856:0:10000:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1789265400.425418:0:15203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a96179 00000020:00000080:1.0:1789265400.425431:0:15203:0:(genops.c:885:class_export_put()) final put ffff9fcc837f1800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789265400.425542:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc837f1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789265400.430263:0:15203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a9618e 00000020:00000080:1.0:1789265400.430279:0:15203:0:(genops.c:885:class_export_put()) final put ffff9fcc837f0800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789265400.430292:0:15203:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789265400.430298:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265400.430307:0:15203:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789265400.430311:0:15203:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9fcc837eb370) has no exports 00000020:00000080:0.0:1789265400.430364:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc837f0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1789265400.430477:0:15203:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789265400.430487:0:15203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a965c4 00000020:00000080:1.0:1789265400.430491:0:15203:0:(genops.c:885:class_export_put()) final put ffff9fccbf422000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789265400.430508:0:15203:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789265400.430512:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265400.430542:0:15203:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789265400.430545:0:15203:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9fccbd378000) has no exports 00000020:00000080:1.0:1789265400.430551:0:15203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a965bd 00000020:00000080:1.0:1789265400.430555:0:15203:0:(genops.c:885:class_export_put()) final put ffff9fccae77e800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789265400.430896:0:15203:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789265400.430900:0:15203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789265400.430904:0:15203:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1789265400.430908:0:15203:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789265400.430909:0:15203:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789265400.430935:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789265400.430943:0:15203:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789265400.430948:0:15203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a96482 00000020:00000080:1.0:1789265400.430953:0:15203:0:(genops.c:885:class_export_put()) final put ffff9fccbc7ee800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789265400.430957:0:15203:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789265400.430960:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265400.430964:0:15203:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789265400.430967:0:15203:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9fccbf4599b8) has no exports 00000020:00000080:1.0:1789265400.430971:0:15203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a9647b 00000020:00000080:1.0:1789265400.430973:0:15203:0:(genops.c:885:class_export_put()) final put ffff9fcb821f7000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789265400.431305:0:15203:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789265400.431309:0:15203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789265400.431311:0:15203:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1789265400.431315:0:15203:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789265400.431316:0:15203:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789265400.431340:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789265400.431347:0:15203:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1789265400.431356:0:15203:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789265400.431360:0:15203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a962b4 00000020:00000080:1.0:1789265400.431365:0:15203:0:(genops.c:885:class_export_put()) final put ffff9fccbc563000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789265400.431368:0:15203:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1789265400.431372:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265400.431375:0:15203:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789265400.431385:0:15203:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9fccb08b0000) has no exports 00000020:00000080:1.0:1789265400.431389:0:15203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a962ad 00000020:00000080:1.0:1789265400.431392:0:15203:0:(genops.c:885:class_export_put()) final put ffff9fccbc563800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789265400.432314:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbf422000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789265400.432324:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccae77e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789265400.432328:0:14028:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccae77a000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789265400.432334:0:14028:0:(genops.c:885:class_export_put()) final put ffff9fcb82f00800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789265400.432336:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb82f00800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789265400.432340:0:14028:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789265400.432425:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbc7ee800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789265400.432431:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb821f7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789265400.432437:0:14028:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb821f6000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789265400.432441:0:14028:0:(genops.c:885:class_export_put()) final put ffff9fcb821f0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789265400.432442:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb821f0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789265400.432446:0:14028:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789265400.432469:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbc563000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789265400.432481:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbc563800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789265400.433237:0:15203:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1789265400.433243:0:15203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789265400.433247:0:15203:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789265400.433253:0:15203:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789265400.433297:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265400.433306:0:15203:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789265400.433337:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265400.433342:0:15203:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789265400.433345:0:15203:0:(genops.c:885:class_export_put()) final put ffff9fcc837f3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789265400.433348:0:15203:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc837f3800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789265400.433355:0:15203:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789265400.433374:0:14028:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccbc564000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1789265400.433382:0:14028:0:(genops.c:885:class_export_put()) final put ffff9fccbc566800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789265400.433390:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbc566800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1789265400.433397:0:14028:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789265400.433423:0:15203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a96195 00000020:00000080:0.0:1789265400.433428:0:15203:0:(genops.c:885:class_export_put()) final put ffff9fcc837f3000/lustre-MDD0000_UUID 00000020:01000000:0.0:1789265400.433441:0:15203:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789265400.433444:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265400.433448:0:15203:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789265400.433451:0:15203:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9fcc837ecd28) has no exports 00000020:00000080:0.0:1789265400.433469:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265400.433472:0:15203:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789265400.433475:0:15203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a9619c 00000020:00000080:0.0:1789265400.433479:0:15203:0:(genops.c:885:class_export_put()) final put ffff9fcc837f7000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789265400.433710:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc837f3000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1789265400.433715:0:14028:0:(genops.c:885:class_export_put()) final put ffff9fcc837f4800/lustre-MDD0000_UUID 00000020:00000080:3.0:1789265400.433717:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc837f4800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1789265400.433722:0:14028:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1789265400.438782:0:15203:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fcc8a583000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789265400.438792:0:15203:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fcc8a583000 3 00000020:01000004:0.0:1789265400.438795:0:15203:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fcc8a583000 from lustre-MDT0000 00000020:00000080:0.0:1789265400.438828:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265400.438839:0:15203:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789265400.438843:0:15203:0:(genops.c:885:class_export_put()) final put ffff9fcc837f0000/lustre-MDT0000_UUID 00000020:00000080:0.0:1789265400.438846:0:15203:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc837f0000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789265400.438860:0:15203:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:3.0:1789265400.438934:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc837f7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1789265400.439063:0:15203:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1789265400.439077:0:15203:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789265400.439080:0:15203:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789265400.439084:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265400.439087:0:15203:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789265400.439093:0:15203:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9fcc9900b800 c287aa82-1100-4c72-b927-3b8d47a88a15 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789265400.439101:0:15203:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9fccb09b3370) has exports, disconnecting them 00000020:00080000:0.0:1789265400.439105:0:15203:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9fcc9900b800), last request at 1789265147 00000020:00000080:0.0:1789265400.439121:0:15203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a9613a 00000020:00010000:0.0:1789265400.439126:0:15203:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fcc9900b800: total 0 00000100:00080000:0.0:1789265400.439131:0:15203:0:(import.c:65:import_set_state_nolock()) ffff9fcc99008800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789265400.439148:0:15203:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fcc9900b800): rc 0 00000020:00080000:0.0:1789265400.439152:0:15203:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9fccb09b3370) has no exports 00000020:00010000:3.0:1789265400.439280:0:6505:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fcc9900b800: total 0 00010000:00010000:3.0:1789265400.439319:0:6505:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fcc9900b800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1789265400.439354:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81693e00/0x9272d942b4a968f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a968f0 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265400.439371:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccb520ba00/0x9272d942b4a966ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a966a4 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265400.439382:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc80031400/0x9272d942b4a9663b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a96634 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265400.439391:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81692400/0x9272d942b4a96260 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a96259 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265400.439402:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccbd2fee00/0x9272d942b4a968e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a968e2 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265400.439411:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc8152e800/0x9272d942b4a96649 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a96642 expref: 9 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265400.439421:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81693000/0x9272d942b4a9655b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a96554 expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265400.439431:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc80031000/0x9272d942b4a96657 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a96650 expref: 7 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265400.439448:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81693400/0x9272d942b4a96252 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a96244 expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265400.439458:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc80031a00/0x9272d942b4a96673 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a9666c expref: 5 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265400.439466:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccb520ae00/0x9272d942b4a96665 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a9665e expref: 4 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265400.439474:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccbd2fe600/0x9272d942b4a968db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a968d4 expref: 3 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265400.439483:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc8152ea00/0x9272d942b4a96681 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a9667a expref: 2 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265400.439492:0:6505:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fcc9900b800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1789265400.439503:0:6505:0:(genops.c:885:class_export_put()) final put ffff9fcc9900b800/c287aa82-1100-4c72-b927-3b8d47a88a15 00010000:00010000:3.0:1789265400.439513:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265400.439515:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265400.439820:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265400.439871:0:7458:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9fccb0ead800:7458] 3 exiting: rc = 0 00000100:00100000:0.0:1789265400.439912:0:6508:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9fcc989bc400:6508] 0 exiting: rc = 1 00000020:00000080:2.0:1789265400.440903:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc9900b800/c287aa82-1100-4c72-b927-3b8d47a88a15 for MGS 00000100:00100000:3.0:1789265400.441942:0:6510:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9fcca1a23400:6510] 1 exiting: rc = 0 00000020:00000080:3.0:1789265400.442145:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcc99008800 for MGS 00000100:00100000:0.0:1789265400.442716:0:6511:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9fcc99299200:6511] 2 exiting: rc = 0 00000100:00100000:3.0:1789265400.442834:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.442842:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.442847:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.442853:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.442859:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.442865:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.442871:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.442893:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.442899:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.442905:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.442912:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.442917:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.442923:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.442928:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.442934:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.442938:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.442943:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.442948:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.442954:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443261:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443274:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443281:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443287:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443294:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443300:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443307:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443313:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443319:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443412:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443420:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443426:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443433:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443439:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443445:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443451:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443458:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443463:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443468:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443474:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443480:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443485:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443491:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443509:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443515:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443531:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443538:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443543:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443549:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443558:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443565:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443571:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443576:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443582:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443589:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443594:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443600:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443606:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443613:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443618:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443623:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443628:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443633:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443638:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265400.443643:0:15203:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1789265400.448108:0:15203:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fcc833809c0 - data ffff9fcb8243da20/ffff9fccbf4e3400 00000020:01000000:3.0:1789265400.448614:0:15203:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fccacd24960 - data ffff9fcc87901000/ffff9fccb09a1800 00000020:00000080:3.0:1789265400.449245:0:15203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a9611e 00000020:00000080:3.0:1789265400.449254:0:15203:0:(genops.c:885:class_export_put()) final put ffff9fcca1be5800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789265400.449274:0:15203:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fcc8a583000 from MGS, refs=2 00000020:01000004:3.0:1789265400.449277:0:15203:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fcc8a583000 2 00000020:01000004:3.0:1789265400.449280:0:15203:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fcc8a583000 from MGS 00000020:00000080:3.0:1789265400.449298:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265400.449304:0:15203:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1789265400.449306:0:15203:0:(genops.c:885:class_export_put()) final put ffff9fcc91055800/MGS 00000020:00000080:3.0:1789265400.449308:0:15203:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc91055800/MGS for MGS 00000020:01000000:3.0:1789265400.449314:0:15203:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1789265400.449388:0:15203:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1789265400.449391:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265400.449396:0:15203:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789265400.449402:0:15203:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9fccb092c800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789265400.449408:0:15203:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9fccb09b19b8) has exports, disconnecting them 00000020:00080000:3.0:1789265400.449412:0:15203:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9fccb092c800), last request at 1789265147 00000020:00000080:3.0:1789265400.449416:0:15203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a961e9 00000020:00080000:3.0:1789265400.449424:0:15203:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fccb092c800): rc 0 00000020:00000080:3.0:1789265400.449429:0:15203:0:(genops.c:885:class_export_put()) final put ffff9fccb092c800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789265400.449552:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcca1be5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789265400.449560:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccb092c800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789265400.456878:0:15203:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789265400.456890:0:15203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789265400.456894:0:15203:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789265400.456902:0:15203:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789265400.456935:0:14028:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccb092f800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789265400.457617:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265400.457627:0:15203:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789265400.457633:0:15203:0:(genops.c:885:class_export_put()) final put ffff9fccb092c000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789265400.457637:0:15203:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccb092c000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789265400.457666:0:15203:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789265400.457747:0:15203:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fcc8a583000 1 00000020:00000080:0.0:1789265400.457754:0:15203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a96110 00000020:00000080:0.0:1789265400.457761:0:15203:0:(genops.c:885:class_export_put()) final put ffff9fcc91057800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789265400.457773:0:15203:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789265400.457794:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc91057800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789265400.457807:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265400.457812:0:15203:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789265400.457815:0:15203:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9fcc83f13370) has no exports 00000020:00000080:1.0:1789265400.586984:0:15203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789265400.586997:0:15203:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1789265400.587002:0:15203:0:(genops.c:885:class_export_put()) final put ffff9fcc8a587000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789265400.587007:0:15203:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc8a587000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789265400.587013:0:15203:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1789265400.587990:0:15203:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fcc8a582000 00000020:02000400:1.0:1789265400.588911:0:15203:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1789265400.833311:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417544832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265400.833391:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265400.835336:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417544832 00000100:00100000:2.0:1789265400.835922:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417544832 00000100:00100000:2.0:1789265400.837706:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789265400.837721:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8492f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417544832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789265400.837751:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789265400.837838:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8492f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417544832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (4446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265400.837845:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789265400.837908:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417544832:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789265400.840728:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789265401.218289:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265402.246850:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265402.369228:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265402.369250:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83daad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417544960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265402.369323:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265402.369411:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417544960 00000100:00100000:2.0:1789265402.369419:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417544960 00000100:00100000:2.0:1789265402.369473:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789265402.369482:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417544960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789265402.369519:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265402.369563:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417544960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265402.369571:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789265402.369620:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83daad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417544960:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789265402.370179:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265402.884980:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789265402.884987:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789265402.884990:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fccbc578000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265402.884999:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 451 00000100:00080000:2.0:1789265402.885005:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789265402.885012:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9fccbc578000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265402.885054:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83dab480 x1876180417545216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789265402.885070:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83daad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417545088:0@lo:400:kworker.0 00000400:00000100:3.0:1789265402.885126:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876180417545088 offset 0 length 224: 4 00000100:00100000:2.0:1789265402.885153:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417545600:0@lo:400:kworker.0 00000100:00100000:3.0:1789265402.885183:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417545728:0@lo:400:kworker.0 00000100:00100000:2.0:1789265402.885196:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265402.885223:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265402.885223:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417546112:0@lo:400:kworker.0 00000100:00100000:2.0:1789265402.885256:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265402.885299:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417545216:0@lo:38:kworker.0 00000100:00100000:2.0:1789265402.885324:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265402.885350:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417545344:0@lo:400:kworker.0 00000100:00100000:2.0:1789265402.885372:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265402.885402:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83daa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417545856:0@lo:400:kworker.0 00000100:00100000:2.0:1789265402.885422:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265402.885440:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789265402.885446:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83daaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417545472:0@lo:400:kworker.0 00000100:00100000:2.0:1789265402.885466:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265402.885482:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417545984:0@lo:400:kworker.0 00000100:00100000:2.0:1789265402.885500:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265402.885823:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417545728 00000100:00100000:3.0:1789265402.885831:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417545728 00000100:00100000:0.0:1789265402.885867:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417545600 00000100:00100000:0.0:1789265402.885875:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417545600 00000100:00100000:3.0:1789265402.885886:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417546112 00000100:00100000:3.0:1789265402.885890:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417546112 00000100:00100000:0.0:1789265402.885908:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417545344 00000100:00100000:0.0:1789265402.885912:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417545344 00000100:00100000:3.0:1789265402.885917:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789265402.885929:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417545728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265402.885929:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417545856 00000100:00100000:0.0:1789265402.885934:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417545856 00000100:00100000:0.0:1789265402.885945:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417545472 00000100:00100000:0.0:1789265402.885947:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417545472 00000100:00100000:0.0:1789265402.885969:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417545984 00000100:00100000:0.0:1789265402.885972:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417545984 00000100:00100000:3.0:1789265402.885982:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417545728:12345-0@lo:400:kworker.0 Request processed in 55us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265402.885991:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789265402.886002:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1789265402.886010:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417545600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265402.886012:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789265402.886050:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417546112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265402.886089:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417545600:12345-0@lo:400:kworker.0 Request processed in 78us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265402.886095:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417546112:12345-0@lo:400:kworker.0 Request processed in 72us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265402.886101:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1789265402.886106:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789265402.886122:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1789265402.886131:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417545984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265402.886140:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789265402.886146:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83daa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1876180417545344:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789265402.886153:0:8460:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789265402.886173:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417545984:12345-0@lo:400:kworker.0 Request processed in 43us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265402.886180:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1789265402.886190:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83daa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1876180417545344:12345-0@lo:400:kworker.0 Request processed in 42us (816us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789265402.886197:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789265402.889449:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789265402.889488:0:7479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417545216 00000100:00100000:2.0:1789265402.889500:0:7479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417545216 00000100:00100000:0.0:1789265402.889577:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876180417545856:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789265402.889587:0:6516:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789265402.889628:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789265402.889637:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1876180417545472:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789265402.889644:0:8460:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789265402.889691:0:7479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789265402.889699:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1876180417545472:12345-0@lo:400:kworker.0 Request processed in 60us (4229us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789265402.889700:0:7479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1876180417545216:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1789265402.889715:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00010000:00020000:2.0:1789265402.889726:0:7479:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789265402.889768:0:7479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1876180417545216:12345-0@lo:38:kworker.0 Request processed in 70us (4442us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789265402.889775:0:7479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789265402.889806:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417545728:0@lo:400:kworker.0 00010000:00080000:3.0:1789265402.890096:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9fcb83da9500 x1876180417545600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265402.890108:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417545600:0@lo:400:kworker.0 00000100:00100000:3.0:1789265402.890118:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417546112:0@lo:400:kworker.0 00000100:00080000:3.0:1789265402.890148:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789265402.890152:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9fcb8223f800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789265402.890156:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789265402.892152:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccbc578000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789265402.892163:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789265402.892168:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417545216:0@lo:38:kworker.0 00000100:00100000:0.0:1789265402.892932:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876180417545856:12345-0@lo:400:kworker.0 Request processed in 3352us (7503us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789265402.892944:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:0.0:1789265402.893110:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789265402.893117:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789265402.900601:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9fcb8223f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265402.900614:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 234 00000100:00080000:3.0:1789265402.900623:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fcb8223f800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:0.0:1789265402.900721:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fccbf612d80 x1876180417546240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265402.900762:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83daaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417545472:0@lo:400:kworker.0 00010000:00080000:0.0:1789265402.900795:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9fcb83da8e00 x1876180417545984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265402.900807:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417545984:0@lo:400:kworker.0 00000100:00080000:0.0:1789265402.900831:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789265402.900836:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9fccbd1b3000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789265402.900840:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789265402.900844:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9fccbd1b3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265402.900847:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 215 00000100:00080000:0.0:1789265402.900852:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9fccbd1b3000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:0.0:1789265402.900866:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fccbd3e4380 x1876180417546368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265402.900876:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417545344:0@lo:400:kworker.0 00000100:00080000:0.0:1789265402.900888:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789265402.900892:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9fcb83932800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789265402.900895:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789265402.900913:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9fcb83932800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265402.900917:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 253 00000100:00080000:0.0:1789265402.900921:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fcb83932800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:0.0:1789265402.900935:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fccbd3e4000 x1876180417546496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265402.900944:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83daa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417545856:0@lo:400:kworker.0 00000100:00100000:1.0:1789265402.901091:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1876180417546240:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789265402.901156:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265402.901191:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876180417546368:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789265402.901213:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265402.901231:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1876180417546496:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789265402.901252:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265402.901294:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417546240 00000100:00100000:1.0:1789265402.901301:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417546240 00000100:00100000:1.0:1789265402.901332:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417546368 00000100:00100000:1.0:1789265402.901335:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417546368 00000100:00100000:1.0:1789265402.901365:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417546496 00000100:00100000:1.0:1789265402.901368:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417546496 00000100:00100000:1.0:1789265402.901383:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789265402.901390:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1876180417546240:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1789265402.901411:0:6518:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789265402.901450:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1876180417546240:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 59us (294us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789265402.901468:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789265402.901487:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789265402.901491:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1876180417546368:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1789265402.901501:0:6518:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789265402.901541:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1876180417546368:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 48us (326us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789265402.901547:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789265402.901559:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789265402.901563:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1876180417546496:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1789265402.901573:0:6518:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789265402.901595:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1876180417546496:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 30us (341us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789265402.901601:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1789265402.901631:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb8223f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265402.901636:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789265402.901639:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1876180417546240:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1789265402.901648:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccbd1b3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265402.901651:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789265402.901654:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876180417546368:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1789265402.901662:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb83932800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265402.901665:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789265402.901668:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1876180417546496:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:2.0:1789265403.265438:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789265404.149975:0:15404:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1789265404.159769:0:15404:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1789265404.159824:0:15404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520a000/0x9272d942b4a9666c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96673 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.159837:0:15404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520a000/0x9272d942b4a9666c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96673 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.159844:0:15404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520a000/0x9272d942b4a9666c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a96673 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.159852:0:15404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fccb520a000/0x9272d942b4a9666c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a96673 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.159866:0:15404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789265404.159871:0:15404:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789265404.159892:0:15404:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789265404.159896:0:15404:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789265404.159902:0:15404:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789265404.159908:0:15404:0:(import.c:65:import_set_state_nolock()) ffff9fccbd1b3000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789265404.159913:0:15404:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789265404.159915:0:15404:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789265404.159918:0:15404:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789265404.160832:0:15404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520b000/0x9272d942b4a9667a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96681 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.160845:0:15404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520b000/0x9272d942b4a9667a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96681 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.160851:0:15404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520b000/0x9272d942b4a9667a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a96681 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.160875:0:15404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fccb520b000/0x9272d942b4a9667a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a96681 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.160898:0:15404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789265404.160904:0:15404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81490600/0x9272d942b4a96554 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9655b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.160911:0:15404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81490600/0x9272d942b4a96554 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9655b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.160917:0:15404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81490600/0x9272d942b4a96554 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a9655b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.160923:0:15404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcc81490600/0x9272d942b4a96554 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a9655b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.160935:0:15404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789265404.160940:0:15404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff600/0x9272d942b4a968f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a968f7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.160947:0:15404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff600/0x9272d942b4a968f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a968f7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.160953:0:15404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff600/0x9272d942b4a968f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a968f7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.160958:0:15404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff600/0x9272d942b4a968f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a968f7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.160976:0:15404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1789265404.160982:0:15404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f200/0x9272d942b4a96259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96260 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.160989:0:15404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f200/0x9272d942b4a96259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96260 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.160994:0:15404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f200/0x9272d942b4a96259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a96260 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.161000:0:15404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f200/0x9272d942b4a96259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a96260 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.161007:0:15404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:3.0:1789265404.161010:0:15404:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:2.0:1789265404.161162:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789265404.161169:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fccb520a000/0x9272d942b4a9666c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a96673 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.161176:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520a000 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265404.161179:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fccb520a000/0x9272d942b4a9666c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a96673 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.161198:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fccb520a000/0x9272d942b4a9666c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a96673 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265404.161206:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fccb520a000/0x9272d942b4a9666c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a96673 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265404.161212:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789265404.161215:0:7473:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789265404.161217:0:7473:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789265404.161251:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fccb520a000/0x9272d942b4a9666c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a96673 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.161257:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265404.161280:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fccb520a000/0x9272d942b4a9666c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a96673 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.161286:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fccb520a000/0x9272d942b4a9666c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a96673 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.161298:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789265404.161301:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fccb520b000/0x9272d942b4a9667a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a96681 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.161307:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520b000 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265404.161309:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fccb520b000/0x9272d942b4a9667a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a96681 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.161315:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fccb520b000/0x9272d942b4a9667a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a96681 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265404.161330:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fccb520b000/0x9272d942b4a9667a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a96681 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265404.161335:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789265404.161337:0:7473:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1789265404.161338:0:7473:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1789265404.161351:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fccb520b000/0x9272d942b4a9667a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a96681 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.161355:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265404.161368:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fccb520b000/0x9272d942b4a9667a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a96681 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.161374:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fccb520b000/0x9272d942b4a9667a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a96681 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.161382:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789265404.161384:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc81490600/0x9272d942b4a96554 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a9655b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.161388:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490600 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265404.161390:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81490600/0x9272d942b4a96554 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a9655b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.161396:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc81490600/0x9272d942b4a96554 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a9655b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265404.161401:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81490600/0x9272d942b4a96554 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a9655b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265404.161414:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789265404.161416:0:7473:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789265404.161417:0:7473:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789265404.161428:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc81490600/0x9272d942b4a96554 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a9655b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.161433:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265404.161438:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc81490600/0x9272d942b4a96554 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a9655b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.161443:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc81490600/0x9272d942b4a96554 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a9655b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.161455:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265404.161457:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff600/0x9272d942b4a968f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a968f7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.161463:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff600 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265404.161465:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff600/0x9272d942b4a968f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a968f7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.161471:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff600/0x9272d942b4a968f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a968f7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265404.161476:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff600/0x9272d942b4a968f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a968f7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265404.161481:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789265404.161482:0:7473:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789265404.161485:0:7473:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789265404.161516:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff600/0x9272d942b4a968f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a968f7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.161521:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265404.161527:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff600/0x9272d942b4a968f0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a968f7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.161532:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff600/0x9272d942b4a968f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a968f7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.161540:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265404.161543:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f200/0x9272d942b4a96259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a96260 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.161548:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc8152f200 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265404.161550:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f200/0x9272d942b4a96259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a96260 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.161556:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f200/0x9272d942b4a96259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a96260 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265404.161561:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f200/0x9272d942b4a96259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a96260 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265404.161566:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789265404.161568:0:7473:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789265404.161570:0:7473:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789265404.161579:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f200/0x9272d942b4a96259 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a96260 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.161584:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265404.161588:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f200/0x9272d942b4a96259 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a96260 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.161600:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f200/0x9272d942b4a96259 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a96260 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.161612:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265404.161614:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265404.161616:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265404.161624:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265404.161644:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417546624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265404.161708:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265404.161750:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83daaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417547136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265404.161771:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265404.161793:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265404.161798:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417547008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265404.161817:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265404.161851:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83daa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417546752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265404.161872:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265404.161891:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265404.161896:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417546880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265404.161914:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265404.161945:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417546624 00000100:00100000:2.0:1789265404.161952:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417546624 00000100:00100000:2.0:1789265404.161981:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417547136 00000100:00100000:2.0:1789265404.161984:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417547136 00000100:00100000:2.0:1789265404.161991:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417547008 00000100:00100000:2.0:1789265404.161994:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417547008 00000100:00100000:2.0:1789265404.162001:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417546752 00000100:00100000:2.0:1789265404.162009:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417546752 00000100:00100000:2.0:1789265404.163313:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417546880 00000100:00100000:2.0:1789265404.163327:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417546880 00000100:00100000:2.0:1789265404.163374:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789265404.163382:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3642:x1876180417546624:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789265404.163389:0:6501:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789265404 with bad export cookie 10552735757404561722 00010000:00010000:0.0:1789265404.164586:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789265404.165186:0:15404:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1789265404.165191:0:15404:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1789265404.165196:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265404.165202:0:15404:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1789265404.165210:0:15404:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9fcb83918800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789265404.165217:0:15404:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9fccaea51000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789265404.165222:0:15404:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9fccb09b0000) has exports, disconnecting them 00000020:00080000:3.0:1789265404.165226:0:15404:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9fcb83918800), last request at 1789265402 00000020:00000080:3.0:1789265404.165234:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a9651c 00000100:00080000:3.0:1789265404.165252:0:15404:0:(import.c:65:import_set_state_nolock()) ffff9fcb83919000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789265404.165299:0:15404:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fcb83918800): rc 0 00000020:00000080:3.0:1789265404.165301:0:15404:0:(genops.c:885:class_export_put()) final put ffff9fcb83918800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1789265404.165312:0:15404:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9fccaea51000), last request at 1789265402 00000020:00000080:3.0:1789265404.165330:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a963f6 00000100:00080000:3.0:1789265404.165336:0:15404:0:(import.c:65:import_set_state_nolock()) ffff9fccaea52800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789265404.165353:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb83918800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1789265404.165390:0:14028:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb83919000 for lustre-MDT0001 00000020:00080000:3.0:1789265404.165407:0:15404:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fccaea51000): rc 0 00000020:00000080:3.0:1789265404.165409:0:15404:0:(genops.c:885:class_export_put()) final put ffff9fccaea51000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1789265404.165419:0:15404:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbf45c1983ae0 00000020:00000080:3.0:1789265404.165430:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccaea51000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1789265404.165449:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccaea52800 for lustre-MDT0001 00000100:00080000:3.0:1789265404.165471:0:15404:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789265404.165481:0:15404:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9fcb84845180 x1876180417544576/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789265416 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265404.165507:0:15404:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00100000:0.0:1789265404.178180:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789265404.178194:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3642:x1876180417547136:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789265404.178203:0:6503:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789265404 with bad export cookie 10552735757404561722 00000100:00100000:0.0:1789265404.180176:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3642:x1876180417547136:12345-0@lo:103:ldlm_bl.0 Request processed in 1973us (18393us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789265404.180192:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789265404.180230:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789265404.180237:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3642:x1876180417547008:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789265404.180243:0:6503:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789265404 with bad export cookie 10552735757404561722 00000100:00100000:0.0:1789265404.180303:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3642:x1876180417547008:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (18485us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789265404.180309:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789265404.180323:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789265404.180327:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3643:x1876180417546752:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789265404.180332:0:6503:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789265404 with bad export cookie 10552735757404561722 00000100:00100000:0.0:1789265404.180369:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3643:x1876180417546752:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (18495us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789265404.180375:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789265404.180405:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789265404.180410:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3643:x1876180417546880:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789265404.180414:0:6503:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789265404 with bad export cookie 10552735757404561722 00000100:00100000:0.0:1789265404.180444:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3643:x1876180417546880:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (18528us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789265404.180450:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1789265404.180482:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265404.182706:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265404.182731:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417544576:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1789265404.183385:0:15404:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789265404.183394:0:15404:0:(import.c:65:import_set_state_nolock()) ffff9fccbc578000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789265404.184316:0:15404:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789265404.184322:0:15404:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1789265404.184342:0:15404:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789265404.184393:0:15404:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789265404.184424:0:15404:0:(import.c:65:import_set_state_nolock()) ffff9fccbc566000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789265404.184442:0:15404:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789265404.184444:0:15404:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:3.0:1789265404.184455:0:15404:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789265404.184517:0:15404:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789265404.184526:0:15404:0:(import.c:65:import_set_state_nolock()) ffff9fccbf422800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789265404.185130:0:15404:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9fccb09b0000) has no exports 00000100:00100000:1.0:1789265404.185522:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417547264:0@lo:9:umount.0 00000100:00100000:1.0:1789265404.185993:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265404.186061:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417547392:0@lo:9:umount.0 00000100:00100000:1.0:1789265404.186086:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265404.186127:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417547264 00000100:00100000:1.0:1789265404.186135:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417547264 00000100:00100000:1.0:1789265404.186181:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417547392 00000100:00100000:1.0:1789265404.186184:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417547392 00000100:00100000:1.0:1789265404.186208:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789265404.186216:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876180417547264:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789265404.186240:0:8435:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a96443 00000100:00080000:1.0:1789265404.186248:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9fccbf44f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789265404.186285:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1789265404.186417:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3640:x1876180417547264:12345-0@lo:9:umount.0 Request processed in 199us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265404.186429:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789265404.186449:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789265404.186459:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876180417547392:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789265404.186476:0:8435:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a96585 00000100:00080000:1.0:1789265404.186484:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9fcb83930800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789265404.186529:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1789265404.186748:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3640:x1876180417547392:12345-0@lo:9:umount.0 Request processed in 290us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265404.186755:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1789265404.186775:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265404.186779:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265404.186813:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccbc566000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789265404.186826:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789265404.186828:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789265404.186842:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417547264:0@lo:9:umount.0 00000100:00080000:1.0:1789265404.186858:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccbf422800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789265404.186862:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789265404.186863:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789265404.186866:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417547392:0@lo:9:umount.0 00010000:00010000:1.0:1789265404.186894:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265404.186900:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789265404.190751:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.149@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789265404.190759:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9fccacdac800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1789265404.190764:0:3642:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1789265404.193233:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.149@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1789265404.196194:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3642:x1876180417546624:12345-0@lo:103:ldlm_bl.0 Request processed in 32802us (34476us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789265404.196228:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789265404.200320:0:3642:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.149@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1789265404.200326:0:3642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789265404.200335:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83daad80 x1876180417545088/t0(0) o400->MGC192.168.203.149@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789265418 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265404.200350:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83dab480 x1876180417546624/t0(0) o103->MGC192.168.203.149@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789265420 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265404.200359:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83daaa00 x1876180417547136/t0(0) o103->MGC192.168.203.149@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789265420 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265404.200367:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83da8e00 x1876180417547008/t0(0) o103->MGC192.168.203.149@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789265420 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265404.200375:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83daa680 x1876180417546752/t0(0) o103->MGC192.168.203.149@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789265420 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265404.200384:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83dabb80 x1876180417546880/t0(0) o103->MGC192.168.203.149@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789265420 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789265404.200393:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789265404.200396:0:3642:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789265404.200397:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789265404.200670:0:3643:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9fccacdac800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1789265404.200697:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83daa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417546752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265404.200727:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c287aa82-1100-4c72-b927-3b8d47a88a15:3643:1876180417546880:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789265404.200785:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9fccacdac800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789265404.200807:0:3642:0:(import.c:510:import_select_connection()) MGC192.168.203.149@tcp: connect to NID 0@lo last attempt 198 00000100:00080000:1.0:1789265404.200815:0:3642:0:(import.c:624:import_select_connection()) MGC192.168.203.149@tcp: import ffff9fccacdac800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:1.0:1789265404.200844:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83e2ce00 x1876180417547520/t0(0) o250->MGC192.168.203.149@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265404.200904:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c287aa82-1100-4c72-b927-3b8d47a88a15:3640:1876180417547520:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1789265404.200951:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876180417547520 offset 0 length 520: 4 00000100:00100000:1.0:1789265404.201006:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417546624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265404.201015:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83daaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417547136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265404.201264:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83daad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417545088:0@lo:400:kworker.0 00000100:00100000:3.0:1789265404.201369:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c287aa82-1100-4c72-b927-3b8d47a88a15:3642:1876180417547008:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1789265404.208188:0:15404:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9fccb09b0000) has no exports 00000020:01000000:0.0:1789265404.250531:0:15404:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fcc887fc2a0 - data ffff9fcb8242dd80/ffff9fccadb57800 00000020:01000000:0.0:1789265404.250819:0:15404:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fccbd1f8ae0 - data ffff9fcc87a48438/ffff9fccbd219800 00000001:00000004:0.0:1789265404.260841:0:15404:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00010000:00010000:0.0:1789265404.289519:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789265404.325332:0:15404:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789265404.325342:0:15404:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1789265404.325351:0:15404:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789265404.328811:0:15404:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789265404.328819:0:15404:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1789265404.328838:0:15404:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789265404.328842:0:15404:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789265404.329159:0:8908:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789265404.329244:0:8908:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1789265404.329255:0:8908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789265404.330340:0:15404:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789265404.330347:0:15404:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:3.0:1789265404.330515:0:15404:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789265404.330518:0:15404:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789265404.330903:0:9996:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789265404.330908:0:9996:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1789265404.330920:0:9996:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1789265404.337127:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a9627c 00000020:00000080:3.0:1789265404.337143:0:15404:0:(genops.c:885:class_export_put()) final put ffff9fccbc57d000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789265404.338140:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbc57d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789265404.339543:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a96291 00000020:00000080:3.0:1789265404.339654:0:15404:0:(genops.c:885:class_export_put()) final put ffff9fccbc57b800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789265404.339708:0:15404:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1789265404.339714:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265404.339723:0:15404:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789265404.339727:0:15404:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9fccb09b4d28) has no exports 00000004:01000000:3.0:1789265404.340018:0:15404:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789265404.340050:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a9657e 00000020:00000080:3.0:1789265404.340055:0:15404:0:(genops.c:885:class_export_put()) final put ffff9fcb8391c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789265404.340190:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbc57b800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1789265404.340321:0:15404:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789265404.340326:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265404.340334:0:15404:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789265404.340336:0:15404:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9fccbf45cd28) has no exports 00000020:00000080:3.0:1789265404.340342:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a96577 00000020:00000080:3.0:1789265404.340346:0:15404:0:(genops.c:885:class_export_put()) final put ffff9fccbf424000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789265404.340372:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb8391c000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789265404.340435:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbf424000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1789265404.341332:0:15404:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789265404.341338:0:15404:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789265404.341343:0:15404:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1789265404.341350:0:15404:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789265404.341352:0:15404:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789265404.341470:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265404.341480:0:15404:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789265404.341488:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a9643c 00000020:00000080:3.0:1789265404.341502:0:15404:0:(genops.c:885:class_export_put()) final put ffff9fcc992fc000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789265404.341523:0:14028:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccbf422800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789265404.341529:0:14028:0:(genops.c:885:class_export_put()) final put ffff9fcc9950a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789265404.341531:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc9950a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1789265404.341540:0:14028:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789265404.341744:0:15404:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789265404.341750:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265404.341755:0:15404:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789265404.341759:0:15404:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9fccbd3799b8) has no exports 00000020:00000080:3.0:1789265404.341764:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a96435 00000020:00000080:3.0:1789265404.341768:0:15404:0:(genops.c:885:class_export_put()) final put ffff9fccbc562000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789265404.341784:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc992fc000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:3.0:1789265404.342396:0:15404:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789265404.342401:0:15404:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789265404.342403:0:15404:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1789265404.342408:0:15404:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789265404.342410:0:15404:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789265404.342515:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbc562000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789265404.342661:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265404.342669:0:15404:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1789265404.342684:0:15404:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789265404.342690:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a962d7 00000020:00000080:3.0:1789265404.342695:0:15404:0:(genops.c:885:class_export_put()) final put ffff9fccbd0d7000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789265404.342715:0:14028:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccbc566000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789265404.342732:0:14028:0:(genops.c:885:class_export_put()) final put ffff9fcc992fc800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789265404.342733:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc992fc800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1789265404.342737:0:14028:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789265404.342822:0:15404:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1789265404.342827:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265404.342895:0:15404:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789265404.342900:0:15404:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9fccbc583370) has no exports 00000020:00000080:3.0:1789265404.342905:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a962d0 00000020:00000080:3.0:1789265404.342909:0:15404:0:(genops.c:885:class_export_put()) final put ffff9fccbc579800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789265404.343673:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbd0d7000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789265404.343683:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbc579800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789265404.351128:0:15404:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789265404.351137:0:15404:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789265404.351142:0:15404:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789265404.351150:0:15404:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789265404.351206:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265404.351219:0:15404:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789265404.351241:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265404.351244:0:15404:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789265404.351249:0:15404:0:(genops.c:885:class_export_put()) final put ffff9fcc992fe000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789265404.351254:0:15404:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc992fe000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789265404.351260:0:15404:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789265404.351435:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a96298 00000020:00000080:0.0:1789265404.351441:0:15404:0:(genops.c:885:class_export_put()) final put ffff9fccbc579000/lustre-MDD0001_UUID 00000020:01000000:0.0:1789265404.351446:0:15404:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789265404.351449:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265404.351454:0:15404:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789265404.351457:0:15404:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9fccbc580000) has no exports 00000020:00000080:0.0:1789265404.351473:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265404.351476:0:15404:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789265404.351480:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a9629f 00000020:00000080:0.0:1789265404.351483:0:15404:0:(genops.c:885:class_export_put()) final put ffff9fccbc578800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789265404.351489:0:15404:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fccad90a000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789265404.351492:0:15404:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fccad90a000 2 00000020:01000004:0.0:1789265404.351504:0:15404:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fccad90a000 from lustre-MDT0001 00000020:00000080:0.0:1789265404.351520:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265404.351533:0:15404:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789265404.351536:0:15404:0:(genops.c:885:class_export_put()) final put ffff9fccbc57d800/lustre-MDT0001_UUID 00000020:00000080:0.0:1789265404.351538:0:15404:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbc57d800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789265404.351546:0:15404:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789265404.354004:0:15404:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789265404.354014:0:15404:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789265404.354018:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265404.354137:0:15404:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789265404.354145:0:15404:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9fccbd1b0800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789265404.354152:0:15404:0:(genops.c:1553:class_disconnect_exports()) OBD device 15 (ffff9fcc83f14d28) has exports, disconnecting them 00000020:00080000:0.0:1789265404.354157:0:15404:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9fccbd1b0800), last request at 1789265164 00000020:00000080:0.0:1789265404.354161:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a96316 00000020:00080000:0.0:1789265404.354178:0:15404:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fccbd1b0800): rc 0 00000020:00000080:0.0:1789265404.354182:0:15404:0:(genops.c:885:class_export_put()) final put ffff9fccbd1b0800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789265404.354302:0:14028:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccbc578000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789265404.354310:0:14028:0:(genops.c:885:class_export_put()) final put ffff9fcc992fe800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789265404.354312:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc992fe800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1789265404.354326:0:14028:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789265404.354647:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbc579000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1789265404.354653:0:14028:0:(genops.c:885:class_export_put()) final put ffff9fccbc57a000/lustre-MDD0001_UUID 00000020:00000080:1.0:1789265404.354654:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbc57a000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1789265404.354658:0:14028:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1789265404.354968:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbc578800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789265404.354974:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbd1b0800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1789265404.357327:0:15404:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1789265404.357335:0:15404:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789265404.357339:0:15404:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789265404.357345:0:15404:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789265404.357374:0:14028:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccbd1b3000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789265404.357701:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789265404.357710:0:15404:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1789265404.357715:0:15404:0:(genops.c:885:class_export_put()) final put ffff9fccbd1b7800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1789265404.357718:0:15404:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbd1b7800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1789265404.357725:0:15404:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1789265404.357796:0:15404:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fccad90a000 1 00000020:00000080:1.0:1789265404.357802:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a96213 00000020:00000080:1.0:1789265404.357809:0:15404:0:(genops.c:885:class_export_put()) final put ffff9fccad908000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1789265404.357818:0:15404:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1789265404.357828:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccad908000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789265404.357850:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265404.357855:0:15404:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789265404.357859:0:15404:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9fccb08b4d28) has no exports 00000020:00000080:1.0:1789265404.497411:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789265404.497425:0:15404:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1789265404.497430:0:15404:0:(genops.c:885:class_export_put()) final put ffff9fccad90d000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789265404.497435:0:15404:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccad90d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1789265404.497448:0:15404:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1789265404.497606:0:15404:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fccad909800 00000020:01000000:1.0:1789265404.497626:0:15404:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1789265404.497631:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265404.497636:0:15404:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789265404.497640:0:15404:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9fccb08b19b8) has no exports 00000100:00100000:1.0:1789265404.497745:0:6516:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9fccaa382a00:6516] 0 exiting: rc = 1 00000100:00100000:1.0:1789265404.497856:0:8460:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9fcb821bca00:8460] 4 exiting: rc = 0 00000100:00100000:1.0:1789265404.497959:0:8459:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9fccad9a3c00:8459] 3 exiting: rc = 0 00000100:00100000:2.0:1789265404.498348:0:6518:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9fccaa228000:6518] 2 exiting: rc = 0 00000100:00100000:0.0:1789265404.498965:0:6517:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9fccaa228c00:6517] 1 exiting: rc = 0 00000100:00100000:1.0:1789265404.499159:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499169:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499174:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499181:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499186:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499205:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499210:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499215:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499221:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499228:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499234:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499241:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499246:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499250:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499256:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499261:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499268:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499273:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499279:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499284:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499290:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499296:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499301:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499307:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499323:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499330:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499337:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499355:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499362:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499368:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499373:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499379:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499384:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499390:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499396:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499403:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499408:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499414:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499419:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499435:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499451:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499457:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499463:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499469:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499474:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499479:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499485:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499491:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499505:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499511:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499516:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499522:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499527:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499532:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499538:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499543:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499560:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499565:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499571:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499577:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499588:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499595:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499603:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.499610:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.502247:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9fcca1ba2800:6520] 1 exiting: rc = 0 00000100:00100000:2.0:1789265404.502486:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9fcc9953b000:6519] 0 exiting: rc = 1 00000100:00100000:0.0:1789265404.532466:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.532480:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.532487:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.532503:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.532510:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.532517:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.532522:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.532526:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.532532:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.532537:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.532545:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538492:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538515:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538520:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538526:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538531:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538565:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538571:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538576:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538581:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538586:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538591:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538596:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538601:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538606:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538612:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538618:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538623:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538627:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538633:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538638:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538643:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538648:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538653:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538658:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538663:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538669:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538673:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538678:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538683:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538688:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538693:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538698:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538703:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538708:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538713:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538719:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538724:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538729:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538735:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538740:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538754:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538760:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538765:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538769:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538774:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538779:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538784:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538790:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538795:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538800:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538804:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538809:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.538823:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265404.545331:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9fccaa29ea00:6522] 1 exiting: rc = 0 00000100:00100000:2.0:1789265404.547257:0:7479:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9fccad81c600:7479] 2 exiting: rc = 0 00000100:00100000:1.0:1789265404.548434:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9fccaa29e400:6521] 0 exiting: rc = 1 00000100:00100000:1.0:1789265404.548538:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548562:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548572:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548581:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548588:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548595:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548609:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548615:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548621:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548627:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548648:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548655:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548660:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548666:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548672:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548678:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548684:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548690:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548712:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548719:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548726:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548732:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548737:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548743:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548749:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548755:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548760:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548766:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548771:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548777:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548796:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548803:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548809:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548814:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548820:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548826:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548832:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548839:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548845:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548851:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548858:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548864:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548885:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548893:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548899:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548912:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548917:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548924:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548930:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548936:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548941:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548947:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548952:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548958:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548978:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548985:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548992:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.548997:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.549003:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.549008:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.549013:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.549257:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.549269:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265404.549284:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.575012:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9fcc83e1a600:6524] 1 exiting: rc = 0 00000100:00100000:3.0:1789265404.575287:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9fcc83e1b600:6523] 0 exiting: rc = 1 00000100:00100000:2.0:1789265404.579539:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579551:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579557:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579561:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579567:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579573:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579579:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579584:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579589:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579594:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579600:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579605:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579610:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579631:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579635:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579641:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579646:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579652:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579657:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579663:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579668:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579672:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579677:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579681:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579686:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579691:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579696:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579700:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579705:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579710:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579715:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579720:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579724:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579730:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579735:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579741:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579746:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579751:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579757:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579761:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579766:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579771:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579775:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579780:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579784:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579788:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579793:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579798:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579810:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579815:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579820:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579824:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579829:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579834:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579839:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579843:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579848:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579853:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579859:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579864:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579869:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579874:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579879:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.579885:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.580770:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9fcc83e1be00:6525] 0 exiting: rc = 1 00000100:00100000:1.0:1789265404.580911:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9fcc83e1a800:6526] 1 exiting: rc = 0 00000100:00100000:2.0:1789265404.581002:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.581009:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.581015:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.581377:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.581387:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.581392:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.581397:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.581402:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.581407:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.581412:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.581416:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.581421:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.581426:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.581430:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.581435:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.581440:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.581444:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.581449:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.581454:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.581471:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.581476:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.581481:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.581487:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.581491:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582017:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582263:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582268:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582280:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582285:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582289:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582294:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582298:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582302:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582307:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582312:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582317:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582323:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582328:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582333:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582337:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582349:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582354:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582359:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582365:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582369:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582374:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582378:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582382:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582387:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582392:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582397:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582403:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582408:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582413:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582429:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582434:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582439:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582444:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582449:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582455:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582461:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582466:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582471:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.582477:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265404.587100:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9fccb0eace00:6528] 1 exiting: rc = 0 00000100:00100000:1.0:1789265404.587260:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9fccb0eac000:6527] 0 exiting: rc = 1 00000100:00100000:2.0:1789265404.587457:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587464:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587470:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587475:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587479:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587483:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587488:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587561:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587569:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587575:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587580:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587585:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587589:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587593:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587598:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587602:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587616:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587621:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587627:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587631:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587749:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587758:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587764:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587768:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587773:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587793:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587798:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587803:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587807:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587812:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587817:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587822:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587827:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587833:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587839:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587844:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587849:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587855:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587862:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587867:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587872:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587877:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587882:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587888:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587893:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587900:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587907:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587914:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587920:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587930:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587938:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587945:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587951:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587956:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587961:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587967:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587972:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587977:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587983:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.587987:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.588001:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.588005:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.588010:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.588015:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265404.597113:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9fccacd9d200:6531] 2 exiting: rc = 0 00000100:00100000:3.0:1789265404.597356:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9fccacd9ce00:6529] 0 exiting: rc = 1 00000100:00100000:2.0:1789265404.599174:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9fccacd9c000:6530] 1 exiting: rc = 0 00000100:00100000:2.0:1789265404.603194:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603205:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603211:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603217:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603224:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603229:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603235:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603240:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603245:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603250:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603255:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603340:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603348:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603354:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603360:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603365:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603371:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603376:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603382:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603387:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603392:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603397:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603402:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603408:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603412:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603418:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603423:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603429:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603435:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603440:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603458:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603464:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603469:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603474:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603481:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603561:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603568:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603573:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603578:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603583:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603589:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603595:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603600:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603718:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603725:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603730:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603735:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603741:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603746:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603751:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603757:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603763:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603768:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603774:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603780:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603785:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603790:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603796:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603800:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603806:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603812:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603818:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603823:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265404.603829:0:15404:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789265404.611766:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789265404.611791:0:15404:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1789265404.611797:0:15404:0:(genops.c:885:class_export_put()) final put ffff9fcc99508000/MDS_uuid 00000020:00000080:2.0:1789265404.611801:0:15404:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc99508000/MDS_uuid for MDS 00000020:01000000:2.0:1789265404.611808:0:15404:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1789265404.611970:0:15404:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1789265405.313265:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265406.338154:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265407.362700:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789265408.009304:0:14028:0:(pinger.c:229:ptlrpc_pinger_process_import()) c287aa82-1100-4c72-b927-3b8d47a88a15->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789265408.009314:0:14028:0:(pinger.c:247:ptlrpc_pinger_process_import()) c287aa82-1100-4c72-b927-3b8d47a88a15->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265408.009316:0:14028:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789265408.009320:0:14028:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789265408.009324:0:14028:0:(import.c:65:import_set_state_nolock()) ffff9fcb8223f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789265408.009333:0:14028:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 454 00000100:00080000:1.0:1789265408.009349:0:14028:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789265408.009357:0:14028:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fcb8223f800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:1.0:1789265408.009397:0:14028:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83e2df80 x1876180417547648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265408.009468:0:14028:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789265408.009482:0:14028:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789265408.009484:0:14028:0:(import.c:65:import_set_state_nolock()) ffff9fcb83932800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789265408.009488:0:14028:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 454 00000100:00080000:1.0:1789265408.009490:0:14028:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789265408.009494:0:14028:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fcb83932800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:1.0:1789265408.009507:0:14028:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83e2f100 x1876180417547904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265408.009607:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1876180417547648:0@lo:38:kworker.0 00000400:00000100:0.0:1789265408.009662:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180417547648 offset 0 length 520: 4 00000100:00100000:0.0:1789265408.009708:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1876180417547904:0@lo:38:kworker.0 00000400:00000100:0.0:1789265408.009725:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180417547904 offset 0 length 520: 4 00000100:00100000:0.0:1789265408.009754:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180417548032:0@lo:400:kworker.0 00000400:00000100:0.0:1789265408.009775:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180417548032 offset 0 length 224: 4 00000100:00100000:0.0:1789265408.009789:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265408.009795:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417547776:0@lo:400:kworker.0 00000400:00000100:0.0:1789265408.009811:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180417547776 offset 0 length 224: 4 00010000:00010000:1.0:1789265408.387867:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789265408.737941:0:15605:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1789265408.755340:0:15605:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789265408.755398:0:15605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96650 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96657 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265408.755430:0:15605:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96650 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96657 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265408.755437:0:15605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96650 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a96657 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265408.755444:0:15605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a96657 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265408.755474:0:15605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789265408.755479:0:15605:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789265408.755505:0:15605:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789265408.755516:0:15605:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83e2df80 x1876180417547648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789265423 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265408.755534:0:15605:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789265408.755539:0:15605:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789265408.755545:0:15605:0:(import.c:65:import_set_state_nolock()) ffff9fcb8223f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789265408.755550:0:15605:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789265408.755553:0:15605:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83e2df80 x1876180417547648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789265423 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265408.755560:0:15605:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789265408.755563:0:15605:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789265408.755664:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265408.755672:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a96657 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265408.755681:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb520b400 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:1.0:1789265408.755685:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a96657 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265408.755695:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a96657 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265408.755703:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a96657 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265408.755708:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789265408.755711:0:7473:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789265408.755713:0:7473:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789265408.755726:0:7473:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fccacdac800 00010000:00010000:1.0:1789265408.755735:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96650 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a96657 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265408.755742:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fccb520b400/0x9272d942b4a96650 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a96657 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265408.755752:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265408.755754:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265408.755755:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265408.755888:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1876180417547648:0@lo:38:kworker.0 00000100:00080000:0.0:1789265408.756905:0:15605:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789265408.756919:0:15605:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83e2e300 x1876180417547776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265424 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265408.756946:0:15605:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789265408.756951:0:15605:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789265408.756981:0:15605:0:(import.c:65:import_set_state_nolock()) ffff9fcb8223e000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789265408.757202:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417547776:0@lo:400:kworker.0 00000100:00100000:3.0:1789265408.757310:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1876180417548160:0@lo:39:umount.0 00000400:00000100:3.0:1789265408.757362:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180417548160 offset 0 length 224: 4 00000100:00080000:2.0:1789265409.025293:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c287aa82-1100-4c72-b927-3b8d47a88a15->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789265409.025304:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c287aa82-1100-4c72-b927-3b8d47a88a15->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265409.025307:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789265409.025311:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789265409.025527:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417548288:0@lo:400:kworker.0 00000400:00000100:3.0:1789265409.025581:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180417548288 offset 0 length 224: 4 00010000:00010000:2.0:1789265409.409424:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789265409.539740:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789265409.539750:0:9515:0:(genops.c:885:class_export_put()) final put ffff9fcb83931000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789265409.539833:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb83931000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789265409.539896:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb83930800 for lustre-OST0001 00000001:00100000:2.0:1789265409.540267:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789265409.540272:0:8428:0:(genops.c:885:class_export_put()) final put ffff9fcc837f2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789265409.543234:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc837f2800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789265409.543724:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccbf44f000 for lustre-OST0000 00010000:00010000:1.0:1789265410.433279:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265411.460684:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265412.481970:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789265413.057247:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c287aa82-1100-4c72-b927-3b8d47a88a15->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789265413.057258:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c287aa82-1100-4c72-b927-3b8d47a88a15->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265413.057261:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789265413.057264:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789265413.057476:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417548416:0@lo:400:kworker.0 00000400:00000100:0.0:1789265413.057535:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180417548416 offset 0 length 224: 4 00010000:00010000:2.0:1789265413.505258:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265414.531163:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265414.913633:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265404/real 1789265404] req@ffff9fcb83e2ce00 x1876180417547520/t0(0) o250->MGC192.168.203.149@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789265414 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265414.913676:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb83e2ce00 x1876180417547520/t0(0) o250->MGC192.168.203.149@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789265414 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789265414.913698:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccacdac800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789265414.913732:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1789265414.913737:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c287aa82-1100-4c72-b927-3b8d47a88a15:3640:1876180417547520:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:1.0:1789265414.913777:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c287aa82-1100-4c72-b927-3b8d47a88a15->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789265414.913783:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1789265414.913786:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fccacdac800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789265414.913792:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.149@tcp: connect to NID 0@lo last attempt 455 00000100:00080000:1.0:1789265414.913797:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.149@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789265414.913802:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.149@tcp: import ffff9fccacdac800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:1.0:1789265414.913834:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83e2dc00 x1876180417548544/t0(0) o250->MGC192.168.203.149@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265414.913862:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789265414.913880:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789265414.914002:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417548672:0@lo:400:kworker.0 00000400:00000100:2.0:1789265414.914079:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180417548672 offset 0 length 224: 4 00000100:00100000:3.0:1789265414.914211:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c287aa82-1100-4c72-b927-3b8d47a88a15:3640:1876180417548544:0@lo:250:kworker.0 00000400:00000100:3.0:1789265414.914234:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876180417548544 offset 0 length 520: 4 00010000:00010000:2.0:1789265415.553267:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265416.578002:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265417.601318:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265418.625822:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265419.009242:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265408/real 1789265408] req@ffff9fccbd3e5180 x1876180417548160/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789265418 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265419.009278:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fccbd3e5180 x1876180417548160/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789265418 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789265419.009297:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb8223e000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789265419.009322:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1876180417548160:0@lo:39:umount.0 00000100:00080000:0.0:1789265419.009435:0:15605:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789265419.009440:0:15605:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789265419.009445:0:15605:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789265419.010316:0:15605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc80031e00/0x9272d942b4a9665e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96665 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265419.010332:0:15605:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc80031e00/0x9272d942b4a9665e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96665 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265419.010339:0:15605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc80031e00/0x9272d942b4a9665e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a96665 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265419.010346:0:15605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcc80031e00/0x9272d942b4a9665e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a96665 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265419.010374:0:15605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265419.010382:0:15605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a968e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a968e9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265419.010388:0:15605:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a968e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a968e9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265419.010425:0:15605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a968e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a968e9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265419.010432:0:15605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a968e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a968e9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265419.010454:0:15605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789265419.010459:0:15605:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789265419.010486:0:15605:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789265419.010491:0:15605:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789265419.010496:0:15605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265419.010502:0:15605:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00010000:00010000:1.0:1789265419.010506:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00080000:0.0:1789265419.010507:0:15605:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9fccb08b3370) has no exports 00010000:00010000:1.0:1789265419.010516:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc80031e00/0x9272d942b4a9665e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a96665 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265419.010527:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc80031e00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:1.0:1789265419.010531:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc80031e00/0x9272d942b4a9665e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a96665 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789265419.010533:0:15605:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9fccb08b3370) has no exports 00010000:00010000:1.0:1789265419.010544:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc80031e00/0x9272d942b4a9665e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a96665 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265419.010552:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc80031e00/0x9272d942b4a9665e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a96665 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265419.010558:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789265419.010560:0:7473:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789265419.010563:0:7473:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789265419.010575:0:7473:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fccacdac800 00010000:00010000:1.0:1789265419.010578:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc80031e00/0x9272d942b4a9665e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a96665 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265419.010584:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc80031e00/0x9272d942b4a9665e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a96665 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265419.010598:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265419.010601:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a968e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a968e9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265419.010617:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81693800 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:1.0:1789265419.010620:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a968e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a968e9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265419.010628:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a968e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a968e9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265419.010634:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a968e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a968e9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265419.010639:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789265419.010641:0:7473:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789265419.010643:0:7473:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789265419.010648:0:7473:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fccacdac800 00010000:00010000:1.0:1789265419.010652:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a968e2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a968e9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265419.010659:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc81693800/0x9272d942b4a968e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a968e9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265419.010667:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265419.010669:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265419.010671:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265419.011135:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789265419.012117:0:15605:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fcc887fc900 - data ffff9fcc87acabd0/ffff9fccadb54800 00000020:01000000:0.0:1789265419.012244:0:15605:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fccbd345420 - data ffff9fcc87a84a20/ffff9fccb5e25400 00100000:10000000:0.0:1789265419.020995:0:15605:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789265419.031048:0:15605:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a963b0 00000020:00000080:1.0:1789265419.031060:0:15605:0:(genops.c:885:class_export_put()) final put ffff9fcc9950e000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1789265419.031077:0:15605:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fccbd2a9800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1789265419.031081:0:15605:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fccbd2a9800 2 00000020:01000004:1.0:1789265419.031085:0:15605:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fccbd2a9800 from lustre-OST0000 00000020:00000080:2.0:1789265419.031101:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc9950e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789265419.031127:0:15605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789265419.031146:0:15605:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1789265419.031150:0:15605:0:(genops.c:885:class_export_put()) final put ffff9fccae77b000/lustre-OST0000_UUID 00000020:00000080:1.0:1789265419.031152:0:15605:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccae77b000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1789265419.031158:0:15605:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1789265419.031381:0:15605:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1789265419.031387:0:15605:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789265419.031392:0:15605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265419.031467:0:15605:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789265419.031474:0:15605:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9fcb8223c800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789265419.031480:0:15605:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9fccbc584d28) has exports, disconnecting them 00000020:00080000:1.0:1789265419.031486:0:15605:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9fcb8223c800), last request at 1789265182 00000020:00000080:1.0:1789265419.031489:0:15605:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a963da 00000020:00080000:1.0:1789265419.031501:0:15605:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fcb8223c800): rc 0 00000020:00000080:1.0:1789265419.031510:0:15605:0:(genops.c:885:class_export_put()) final put ffff9fcb8223c800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789265419.032349:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb8223c800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789265419.042683:0:15605:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789265419.042708:0:15605:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789265419.042712:0:15605:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789265419.042719:0:15605:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789265419.042924:0:15605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789265419.042933:0:15605:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1789265419.042940:0:15605:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789265419.042945:0:15605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789265419.042949:0:15605:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789265419.042955:0:15605:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9fcb8223a000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789265419.042962:0:15605:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9fcb829f8000) has exports, disconnecting them 00000020:00080000:2.0:1789265419.042967:0:15605:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9fcb8223a000), last request at 1789265182 00000020:00000080:2.0:1789265419.042971:0:15605:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a963e8 00000020:00080000:2.0:1789265419.042987:0:15605:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fcb8223a000): rc 0 00000020:00000080:2.0:1789265419.042993:0:15605:0:(genops.c:885:class_export_put()) final put ffff9fcb8223a000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789265419.043149:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb8223f800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789265419.043163:0:38:0:(genops.c:885:class_export_put()) final put ffff9fcb8223c000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789265419.043165:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb8223c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789265419.043176:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789265419.043236:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb8223a000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1789265419.044181:0:15605:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789265419.044186:0:15605:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789265419.044189:0:15605:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789265419.044195:0:15605:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789265419.044215:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb8223e000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789265419.044386:0:15605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265419.044408:0:15605:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1789265419.044413:0:15605:0:(genops.c:885:class_export_put()) final put ffff9fcb8223a800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1789265419.044416:0:15605:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb8223a800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1789265419.044421:0:15605:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1789265419.044466:0:15605:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fccbd2a9800 1 00000020:00000080:3.0:1789265419.044471:0:15605:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a96378 00000020:00000080:3.0:1789265419.044477:0:15605:0:(genops.c:885:class_export_put()) final put ffff9fccbc7ef800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1789265419.044485:0:15605:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1789265419.044492:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbc7ef800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789265419.044502:0:15605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265419.044506:0:15605:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789265419.044508:0:15605:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9fccbc5819b8) has no exports 00000020:00000080:3.0:1789265419.171448:0:15605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265419.171463:0:15605:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1789265419.171469:0:15605:0:(genops.c:885:class_export_put()) final put ffff9fccbd2af800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1789265419.171474:0:15605:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbd2af800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1789265419.171488:0:15605:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1789265419.171795:0:15605:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fccbd2ac000 00000020:02000400:3.0:1789265419.171842:0:15605:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1789265419.651190:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789265420.291238:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c287aa82-1100-4c72-b927-3b8d47a88a15->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789265420.291249:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c287aa82-1100-4c72-b927-3b8d47a88a15->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265420.291252:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789265420.291255:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789265420.291312:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265420.291329:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417548800:0@lo:400:kworker.0 00000400:00000100:1.0:1789265420.291383:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180417548800 offset 0 length 224: 4 00010000:00010000:1.0:1789265420.673301:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265421.699628:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265422.728722:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789265423.056124:0:15807:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1789265423.073760:0:15807:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789265423.073847:0:15807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc8152e200/0x9272d942b4a96634 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9663b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265423.073862:0:15807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc8152e200/0x9272d942b4a96634 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9663b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265423.073882:0:15807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc8152e200/0x9272d942b4a96634 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a9663b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265423.073889:0:15807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcc8152e200/0x9272d942b4a96634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a9663b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265423.074333:0:15807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789265423.074339:0:15807:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789265423.074362:0:15807:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789265423.074385:0:15807:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83e2f100 x1876180417547904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789265423 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265423.074398:0:15807:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789265423.074404:0:15807:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789265423.074410:0:15807:0:(import.c:65:import_set_state_nolock()) ffff9fcb83932800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789265423.074414:0:15807:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789265423.074418:0:15807:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83e2f100 x1876180417547904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789265423 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265423.074424:0:15807:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789265423.074427:0:15807:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1789265423.075149:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1876180417547904:0@lo:38:kworker.0 00010000:00010000:0.0:1789265423.076482:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265423.076494:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc8152e200/0x9272d942b4a96634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a9663b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265423.076578:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc8152e200 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:0.0:1789265423.076582:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc8152e200/0x9272d942b4a96634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a9663b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265423.076592:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc8152e200/0x9272d942b4a96634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a9663b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265423.076600:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc8152e200/0x9272d942b4a96634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a9663b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265423.076620:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789265423.076623:0:7473:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789265423.076746:0:7473:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789265423.076763:0:7473:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fccacdac800 00010000:00010000:0.0:1789265423.076768:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc8152e200/0x9272d942b4a96634 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a9663b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265423.076775:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc8152e200/0x9272d942b4a96634 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a9663b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265423.076790:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265423.076792:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265423.076794:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789265423.077184:0:15807:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789265423.077195:0:15807:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83e2f480 x1876180417548032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265424 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265423.077216:0:15807:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83f31880 x1876180417548288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265425 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265423.077239:0:15807:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83e2c000 x1876180417548416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265429 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265423.077253:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180417548032:0@lo:400:kworker.0 00000100:00100000:1.0:1789265423.077262:0:15807:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83e2fb80 x1876180417548672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265430 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265423.077304:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417548288:0@lo:400:kworker.0 00000100:00100000:2.0:1789265423.077625:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417548416:0@lo:400:kworker.0 00000100:00100000:1.0:1789265423.077670:0:15807:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83e2c700 x1876180417548800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265436 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265423.077677:0:15807:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789265423.077683:0:15807:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789265423.078211:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417548800:0@lo:400:kworker.0 00000100:00100000:2.0:1789265423.078220:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417548672:0@lo:400:kworker.0 00000100:00080000:1.0:1789265423.078279:0:15807:0:(import.c:65:import_set_state_nolock()) ffff9fcb83937800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789265423.078321:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1876180417548928:0@lo:39:umount.0 00000400:00000100:3.0:1789265423.078361:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180417548928 offset 0 length 224: 4 00010000:00010000:1.0:1789265423.746918:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265424.769372:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789265425.409319:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c287aa82-1100-4c72-b927-3b8d47a88a15->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789265425.409330:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c287aa82-1100-4c72-b927-3b8d47a88a15->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1789265425.794394:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265426.817315:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265427.841466:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265428.865419:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265429.249188:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265414/real 1789265414] req@ffff9fcb83e2dc00 x1876180417548544/t0(0) o250->MGC192.168.203.149@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789265429 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265429.249230:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb83e2dc00 x1876180417548544/t0(0) o250->MGC192.168.203.149@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789265429 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789265429.249250:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccacdac800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265429.249258:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1789265429.249263:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c287aa82-1100-4c72-b927-3b8d47a88a15:3640:1876180417548544:0@lo:250:kworker.0 00000100:00080000:2.0:1789265429.249513:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c287aa82-1100-4c72-b927-3b8d47a88a15->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789265429.249518:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1789265429.249521:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fccacdac800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265429.249542:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.149@tcp: connect to NID 0@lo last attempt 466 00000100:00080000:2.0:1789265429.249547:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.149@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789265429.249554:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.149@tcp: import ffff9fccacdac800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265429.249582:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83f30000 x1876180417549056/t0(0) o250->MGC192.168.203.149@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789265429.250601:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c287aa82-1100-4c72-b927-3b8d47a88a15:3640:1876180417549056:0@lo:250:kworker.0 00000400:00000100:3.0:1789265429.250651:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876180417549056 offset 0 length 520: 4 00010000:00010000:1.0:1789265429.889511:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265430.913330:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265431.937511:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265432.961296:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265433.345681:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265423/real 1789265423] req@ffff9fcb83e2c380 x1876180417548928/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789265433 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265433.345717:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb83e2c380 x1876180417548928/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789265433 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789265433.345736:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb83937800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789265433.345762:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1876180417548928:0@lo:39:umount.0 00000100:00080000:3.0:1789265433.345932:0:15807:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789265433.345936:0:15807:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789265433.345941:0:15807:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789265433.347013:0:15807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f600/0x9272d942b4a96642 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a96649 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265433.347154:0:15807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f600/0x9272d942b4a96642 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a96649 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265433.347164:0:15807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f600/0x9272d942b4a96642 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a96649 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265433.347171:0:15807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f600/0x9272d942b4a96642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a96649 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265433.347253:0:15807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265433.347262:0:15807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4800/0x9272d942b4a968d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a968db expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265433.347270:0:15807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4800/0x9272d942b4a968d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a968db expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265433.347286:0:15807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4800/0x9272d942b4a968d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a968db expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265433.347293:0:15807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4800/0x9272d942b4a968d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a968db expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265433.349763:0:15807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789265433.349776:0:15807:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1789265433.349813:0:15807:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1789265433.349817:0:15807:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1789265433.349826:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265433.349832:0:15807:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789265433.349837:0:15807:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9fcb829fb370) has no exports 00000020:00080000:3.0:1789265433.349864:0:15807:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9fcb829fb370) has no exports 00010000:00010000:1.0:1789265433.351812:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265433.351826:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f600/0x9272d942b4a96642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a96649 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265433.351838:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc8152f600 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:1.0:1789265433.351843:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f600/0x9272d942b4a96642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a96649 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265433.351853:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f600/0x9272d942b4a96642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a96649 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265433.351861:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f600/0x9272d942b4a96642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a96649 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265433.351867:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789265433.351870:0:7473:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1789265433.351873:0:7473:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1789265433.351892:0:7473:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fccacdac800 00010000:00010000:1.0:1789265433.351895:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f600/0x9272d942b4a96642 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a96649 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265433.351902:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f600/0x9272d942b4a96642 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a96649 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265433.351919:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265433.351923:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4800/0x9272d942b4a968d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a968db expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265433.351929:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4800 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:1.0:1789265433.351932:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4800/0x9272d942b4a968d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a968db expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265433.351955:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4800/0x9272d942b4a968d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a968db expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265433.351961:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4800/0x9272d942b4a968d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a968db expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265433.351966:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789265433.351968:0:7473:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789265433.351970:0:7473:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789265433.351976:0:7473:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fccacdac800 00010000:00010000:1.0:1789265433.351979:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4800/0x9272d942b4a968d4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a968db expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265433.351985:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4800/0x9272d942b4a968d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a968db expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265433.351998:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265433.352000:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265433.352002:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265433.352378:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789265433.362243:0:15807:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fccbd345480 - data ffff9fcb825861b0/ffff9fccbf40bc00 00000020:01000000:3.0:1789265433.362391:0:15807:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fcb83a24b40 - data ffff9fcc87ac5d80/ffff9fcb82c7cc00 00100000:10000000:3.0:1789265433.369732:0:15807:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789265433.381803:0:15807:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a964d6 00000020:00000080:1.0:1789265433.381816:0:15807:0:(genops.c:885:class_export_put()) final put ffff9fcb8223f000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1789265433.381926:0:15807:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fccbf44d000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1789265433.381931:0:15807:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fccbf44d000 2 00000020:01000004:1.0:1789265433.381934:0:15807:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fccbf44d000 from lustre-OST0001 00000020:00000080:1.0:1789265433.381962:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789265433.381971:0:15807:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1789265433.381975:0:15807:0:(genops.c:885:class_export_put()) final put ffff9fcb8223d000/lustre-OST0001_UUID 00000020:00000080:1.0:1789265433.381978:0:15807:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb8223d000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1789265433.381985:0:15807:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1789265433.382138:0:15807:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import c287aa82-1100-4c72-b927-3b8d47a88a15->MGS 00010000:00010000:1.0:1789265433.382161:0:15807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f400/0x9272d942b4a96244 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a96252 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265433.382173:0:15807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f400/0x9272d942b4a96244 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a96252 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265433.382180:0:15807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1789265433.382182:0:15807:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1789265433.382185:0:15807:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1789265433.382203:0:15807:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fccacdac800 00010000:00010000:1.0:1789265433.382207:0:15807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc8152f400/0x9272d942b4a96244 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a96252 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265433.382223:0:15807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff000/0x9272d942b4a966a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a966ab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265433.382230:0:15807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff000/0x9272d942b4a966a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a966ab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265433.382235:0:15807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789265433.382238:0:15807:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1789265433.382239:0:15807:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1789265433.382256:0:15807:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fccacdac800 00010000:00010000:1.0:1789265433.382260:0:15807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff000/0x9272d942b4a966a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a966ab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789265433.382276:0:15807:0:(import.c:65:import_set_state_nolock()) ffff9fccacdac800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1789265433.382280:0:15807:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789265433.382282:0:15807:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789265433.382284:0:15807:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789265433.382288:0:15807:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789265433.382309:0:15807:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83f30000 x1876180417549056/t0(0) o250->MGC192.168.203.149@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789265449 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789265433.382332:0:15807:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789265433.382335:0:15807:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:3.0:1789265433.382414:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c287aa82-1100-4c72-b927-3b8d47a88a15:3640:1876180417549056:0@lo:250:kworker.0 10000000:01000000:1.0:1789265433.382481:0:15807:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789265433.382488:0:15807:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a9612c 00000020:00000080:1.0:1789265433.382493:0:15807:0:(genops.c:885:class_export_put()) final put ffff9fcc9950e800/c287aa82-1100-4c72-b927-3b8d47a88a15 00000020:00000080:2.0:1789265433.382596:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb8223f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789265433.382714:0:15807:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.149@tcp (flags='') 00000020:00000080:1.0:1789265433.382719:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265433.382725:0:15807:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.149@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789265433.382729:0:15807:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9fcc83f119b8) has no exports 10000000:01000000:2.0:1789265433.382788:0:6513:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1789265433.382922:0:15807:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.149@tcp: client import never connected 00000100:00080000:1.0:1789265433.382925:0:15807:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1789265433.382927:0:15807:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789265433.382929:0:15807:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1789265433.382930:0:15807:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789265433.382963:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789265433.382968:0:15807:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.149@tcp (uuid c287aa82-1100-4c72-b927-3b8d47a88a15) 00000020:01000000:1.0:1789265433.382974:0:15807:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789265433.382977:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265433.382980:0:15807:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789265433.382984:0:15807:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9fcb83935800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789265433.382990:0:15807:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9fcb839399b8) has exports, disconnecting them 00000020:00080000:1.0:1789265433.382994:0:15807:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9fcb83935800), last request at 1789265202 00000020:00000080:1.0:1789265433.382997:0:15807:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a96500 00000020:00080000:1.0:1789265433.383009:0:15807:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fcb83935800): rc 0 00000020:00000080:1.0:1789265433.383013:0:15807:0:(genops.c:885:class_export_put()) final put ffff9fcb83935800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789265433.383672:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc9950e800/c287aa82-1100-4c72-b927-3b8d47a88a15 for MGC192.168.203.149@tcp 00000020:00000080:2.0:1789265433.383682:0:14028:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccacdac800 for MGC192.168.203.149@tcp 00000020:00000080:2.0:1789265433.383689:0:14028:0:(genops.c:885:class_export_put()) final put ffff9fccacda9800/c287aa82-1100-4c72-b927-3b8d47a88a15 00000020:00000080:2.0:1789265433.383691:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccacda9800/c287aa82-1100-4c72-b927-3b8d47a88a15 for MGC192.168.203.149@tcp 00000020:01000000:2.0:1789265433.383695:0:14028:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.149@tcp (c287aa82-1100-4c72-b927-3b8d47a88a15) 00000020:00000080:2.0:1789265433.384046:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb83935800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1789265433.385164:0:15807:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789265433.385170:0:15807:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789265433.385174:0:15807:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789265433.385182:0:15807:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789265433.385358:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789265433.385367:0:15807:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1789265433.385373:0:15807:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789265433.385379:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789265433.385383:0:15807:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789265433.385390:0:15807:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9fcb83934800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789265433.385396:0:15807:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9fcb8393cd28) has exports, disconnecting them 00000020:00080000:2.0:1789265433.385409:0:15807:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9fcb83934800), last request at 1789265202 00000020:00000080:2.0:1789265433.385413:0:15807:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a96515 00000020:00080000:2.0:1789265433.385429:0:15807:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fcb83934800): rc 0 00000020:00000080:2.0:1789265433.385435:0:15807:0:(genops.c:885:class_export_put()) final put ffff9fcb83934800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1789265433.385661:0:14028:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb83932800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789265433.385669:0:14028:0:(genops.c:885:class_export_put()) final put ffff9fcb83937000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789265433.385672:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb83937000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789265433.385681:0:14028:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789265433.385735:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb83934800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1789265433.387089:0:15807:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789265433.387096:0:15807:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789265433.387102:0:15807:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789265433.387107:0:15807:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789265433.387141:0:14028:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb83937800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1789265433.387198:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1789265433.387359:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1789265433.387422:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1789265433.387563:0:10338:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9fccbd3bbc00:10338] 2 exiting: rc = 0 00000100:00100000:3.0:1789265433.387810:0:6500:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9fcc992f7600:6500] 1 exiting: rc = 0 00000100:00100000:3.0:1789265433.388039:0:6499:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9fcc992f7000:6499] 0 exiting: rc = 1 00000100:00100000:3.0:1789265433.388093:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.388341:0:6501:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9fcc992f6200:6501] 0 exiting: rc = 1 00000100:00100000:3.0:1789265433.388398:0:6503:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9fcc992f6600:6503] 2 exiting: rc = 0 00000100:00100000:3.0:1789265433.388453:0:6502:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9fcc992f7800:6502] 1 exiting: rc = 0 00000100:00100000:3.0:1789265433.388525:0:7926:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9fccbd2bba00:7926] 3 exiting: rc = 0 00000100:00100000:3.0:1789265433.388691:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.388698:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.388705:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.388711:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.388721:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.388727:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.388733:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.388738:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.388744:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.388750:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.388755:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.388760:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389345:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389355:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389361:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389366:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389371:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389376:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389382:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389388:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389393:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389407:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389412:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389416:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389422:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389426:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389431:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389435:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389440:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389444:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389449:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389453:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389457:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389461:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389465:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389469:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389473:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389478:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389482:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389487:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389492:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389497:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389502:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389507:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389512:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389517:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389522:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389527:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389531:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389537:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389542:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389546:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389552:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389557:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.389563:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.390983:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.391014:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.391034:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.391042:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.391048:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.391053:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.391058:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.391063:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.391076:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789265433.391849:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265433.391859:0:15807:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1789265433.391869:0:15807:0:(genops.c:885:class_export_put()) final put ffff9fcb83933000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1789265433.391874:0:15807:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb83933000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1789265433.391880:0:15807:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1789265433.392124:0:15807:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fccbf44d000 1 00000020:00000080:3.0:1789265433.392130:0:15807:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a964a5 00000020:00000080:3.0:1789265433.392136:0:15807:0:(genops.c:885:class_export_put()) final put ffff9fcb821f5800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789265433.392146:0:15807:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789265433.392156:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb821f5800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789265433.392165:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265433.392170:0:15807:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789265433.392173:0:15807:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9fccbd37cd28) has no exports 00000020:00000080:0.0:1789265433.475457:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265433.475471:0:15807:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789265433.475477:0:15807:0:(genops.c:885:class_export_put()) final put ffff9fccbf44c000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789265433.475481:0:15807:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbf44c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789265433.475488:0:15807:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789265433.475788:0:15807:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fccbf44a000 00000020:01000000:0.0:1789265433.475810:0:15807:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789265433.475814:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265433.475819:0:15807:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789265433.475823:0:15807:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9fcc83f10000) has no exports 00000020:00000080:0.0:1789265433.475842:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265433.475848:0:15807:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789265433.475851:0:15807:0:(genops.c:885:class_export_put()) final put ffff9fccbc7ec800/OSS_uuid 00000020:00000080:0.0:1789265433.475853:0:15807:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbc7ec800/OSS_uuid for OSS 00000020:01000000:0.0:1789265433.475856:0:15807:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1789265433.476056:0:6512:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789265433.477625:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9fccbd261c00:8434] 1 exiting: rc = 0 00000100:00100000:1.0:1789265433.477710:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9fccbd26e800:8435] 2 exiting: rc = 0 00000100:00100000:2.0:1789265433.478001:0:8914:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9fccbd3bac00:8914] 3 exiting: rc = 0 00000100:00100000:3.0:1789265433.478213:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9fccbc4d0800:8433] 0 exiting: rc = 1 00000100:00100000:1.0:1789265433.478295:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478315:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478334:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478340:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478347:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478352:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478357:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478362:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478367:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478372:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478377:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478382:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478387:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478392:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478397:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478402:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478406:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478411:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478416:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478422:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478426:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478431:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478436:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478441:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478447:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478452:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478457:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478462:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478467:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478473:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478478:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478483:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478488:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478494:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478498:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478504:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478509:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478522:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478527:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478532:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478538:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478543:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478548:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478553:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478557:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478563:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478567:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478572:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478577:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478582:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478587:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478592:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478598:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478603:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478608:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478613:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478618:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478622:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478627:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478632:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478636:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478641:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478645:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.478650:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.479815:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9fccbd26da00:8436] 0 exiting: rc = 1 00000100:00100000:0.0:1789265433.480198:0:9135:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9fccadb6c800:9135] 2 exiting: rc = 0 00000100:00100000:3.0:1789265433.480471:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9fccad9a7200:8437] 1 exiting: rc = 0 00000100:00100000:1.0:1789265433.480591:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480599:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480604:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480609:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480614:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480619:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480624:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480628:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480646:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480651:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480656:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480661:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480665:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480670:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480675:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480680:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480685:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480690:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480695:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480700:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480705:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480709:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480714:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480719:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480724:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480728:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480733:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480738:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480743:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480748:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480753:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480759:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480764:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480769:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480774:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480779:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480784:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480790:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480795:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480800:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480807:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480811:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480815:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480828:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480833:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480968:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480976:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480981:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480986:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480991:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.480997:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.481003:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.481008:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.481013:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.481019:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.481359:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.481365:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.481370:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.481377:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.481382:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.481388:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.481393:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.481398:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265433.481410:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.482652:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9fcc992f6e00:8439] 1 exiting: rc = 0 00000100:00100000:2.0:1789265433.482823:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9fccaa383e00:8440] 2 exiting: rc = 0 00000100:00100000:0.0:1789265433.483210:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9fcc837df000:8438] 0 exiting: rc = 1 00000100:00100000:2.0:1789265433.483376:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483382:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483388:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483394:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483400:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483408:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483414:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483420:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483426:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483432:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483438:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483444:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483449:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483455:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483461:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483467:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483473:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483479:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483485:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483492:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483498:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483506:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483524:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483531:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483536:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483552:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483558:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483565:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483570:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483575:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483581:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483586:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483591:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483596:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483602:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483608:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483613:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483618:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483623:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483628:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483635:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483641:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483647:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483653:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483658:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483663:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483668:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483673:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483679:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483693:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483700:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483706:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483718:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483725:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483731:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483737:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483757:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483764:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483770:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483776:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483788:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483794:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483799:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265433.483803:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265433.489141:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9fccadbcee00:8441] 0 exiting: rc = 1 00000100:00100000:0.0:1789265433.489248:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9fccadbcf000:8442] 1 exiting: rc = 0 00000100:00100000:3.0:1789265433.489341:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489348:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489353:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489358:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489364:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489369:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489375:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489380:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489385:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489390:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489406:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489411:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489416:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489421:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489426:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489433:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489459:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489465:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489471:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489476:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489481:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489486:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489491:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489496:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489501:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489505:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489510:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489514:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489519:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489524:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489528:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489533:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489538:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489543:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489547:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489552:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489557:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489561:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489566:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489570:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489574:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489579:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489583:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489588:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489592:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489601:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489606:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489611:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489616:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489621:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489625:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489630:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489636:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489641:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489646:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489651:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489655:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489659:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489664:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489668:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489674:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489679:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489684:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.489690:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265433.490522:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9fccb5e0d600:8443] 0 exiting: rc = 1 00000100:00100000:0.0:1789265433.490592:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9fccadbce800:8444] 1 exiting: rc = 0 00000100:00100000:3.0:1789265433.490673:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.490687:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.490694:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.490700:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.490705:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.490710:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.490731:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.490738:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.490744:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.490749:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.490755:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.490760:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.490767:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.490773:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.490778:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.490783:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.490799:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.490804:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.490824:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.490831:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.490962:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.490972:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.490978:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.490984:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.490990:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.490996:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491002:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491007:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491013:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491020:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491065:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491073:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491079:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491085:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491091:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491097:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491103:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491109:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491115:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491120:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491126:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491132:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491153:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491160:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491166:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491171:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491177:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491183:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491187:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491193:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491198:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491211:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491216:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491222:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491243:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491250:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491256:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491261:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491267:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491273:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491278:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491284:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491291:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265433.491314:0:15807:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789265433.504831:0:15807:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1789265452.381417:0:16572:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg349-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789265462.636301:0:17171:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789265462.636307:0:17171:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1789265462.636309:0:17171:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789265462.636420:0:17171:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fcb83933000 00000020:01000004:2.0:1789265462.636436:0:17171:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1789265462.636444:0:17171:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789265462.636458:0:17171:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9fcb83938000) 00000020:00000080:2.0:1789265462.636472:0:17171:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789265462.701369:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789265462.703991:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789265462.707249:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1789265462.708500:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789265462.709064:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789265462.709417:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789265462.709678:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1789265462.709975:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789265462.710239:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1789265462.710510:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1789265462.710728:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1789265462.710977:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1789265462.713305:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789265462.713601:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789265462.713908:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789265462.714481:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1789265462.714688:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1789265462.716558:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1789265462.717613:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1789265462.717923:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1789265462.718201:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1789265462.718461:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1789265462.718632:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1789265462.718883:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1789265462.719126:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1789265462.719334:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1789265462.719595:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1789265462.719914:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1789265462.720526:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1789265462.720840:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1789265462.721359:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1789265462.721611:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1789265462.721942:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1789265462.723151:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1789265462.723530:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1789265462.723858:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1789265462.724296:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1789265462.728708:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1789265462.730600:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1789265462.731480:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1789265462.731892:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1789265462.732565:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1789265462.732936:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1789265462.733373:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1789265462.733588:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1789265462.733870:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1789265462.734384:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1789265462.736833:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1789265462.737478:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1789265462.737667:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1789265462.738325:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1789265462.738571:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1789265462.738828:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:1.0:1789265462.741415:0:17171:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789265462.741656:0:17171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789265462.741664:0:17171:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789265462.741677:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9272d942b4a976e9 00000020:01000004:1.0:1789265462.741684:0:17171:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1789265462.741690:0:17171:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789265462.741696:0:17171:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fcb83933000 from MGS 00000020:01000004:1.0:1789265462.741700:0:17171:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789265462.741710:0:17171:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9fcb829fb370) 00000020:00000080:1.0:1789265462.741720:0:17171:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789265462.741775:0:17171:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fcb83933000 from MGS, refs=2 00080000:01000000:1.0:1789265462.741780:0:17171:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789265462.741786:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9272d942b4a976f7 00000100:00100000:1.0:1789265462.741880:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789265462.742006:0:17171:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789265462.742012:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789265462.742993:0:17171:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789265462.743002:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789265462.743701:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789265462.743889:0:17171:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789265462.743895:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789265462.744737:0:17171:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789265462.744757:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789265462.745363:0:17171:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789265462.745370:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789265462.746611:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265462.746615:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265462.746617:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265462.747433:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265462.747436:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265462.747438:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265462.748059:0:17171:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789265462.749601:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789265462.756907:0:17171:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1789265462.757944:0:17183:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789265462.757991:0:17171:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789265462.758088:0:17171:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789265462.759322:0:17171:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789265462.759708:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265462.760360:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789265462.760367:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789265462.773206:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789265462.773228:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789265462.773857:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789265462.773865:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789265462.777954:0:17171:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789265462.777976:0:17171:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.149@tcp' 00000020:01000004:1.0:1789265462.777978:0:17171:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:2.0:1789265462.778193:0:17188:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:1.0:1789265462.778379:0:17171:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.149@tcp (typ=mgc) 00000020:00000080:1.0:1789265462.778393:0:17171:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.149@tcp (ffff9fcb829f99b8) 00000020:00000080:1.0:1789265462.778409:0:17171:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789265462.778488:0:17171:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fccb0e1d000@MGC192.168.203.149@tcp: add connection 192.168.203.149@tcp at head 00010000:00010000:1.0:1789265462.778661:0:17171:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.149@tcp-0 is initialized 00000040:01000000:1.0:1789265462.778668:0:17171:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.149@tcp ctxt 1 is initialized 10000000:01000000:1.0:1789265462.780981:0:17189:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789265462.781134:0:17171:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.149@tcp (uuid a57aa04c-0472-45c4-bafc-6983957e249b) 00000020:00000080:3.0:1789265462.781160:0:17171:0:(genops.c:1385:class_connect()) connect: client a57aa04c-0472-45c4-bafc-6983957e249b, cookie 0x9272d942b4a97705 00000100:00080000:3.0:1789265462.781173:0:17171:0:(import.c:510:import_select_connection()) MGC192.168.203.149@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789265462.781179:0:17171:0:(import.c:624:import_select_connection()) MGC192.168.203.149@tcp: import ffff9fccb0e1d000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:3.0:1789265462.781226:0:17171:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb84847100 x1876180417549184/t0(0) o250->MGC192.168.203.149@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265462.781256:0:17171:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a57aa04c-0472-45c4-bafc-6983957e249b->MGS 00000020:01000004:3.0:1789265462.781281:0:17171:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789265462.781287:0:17171:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789265462.781301:0:17171:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9fccbd37b370) 00000020:00000080:3.0:1789265462.781313:0:17171:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789265462.783617:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a57aa04c-0472-45c4-bafc-6983957e249b:3640:1876180417549184:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789265462.783707:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265462.784364:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417549184 00000100:00100000:0.0:1789265462.784372:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417549184 00000100:00100000:0.0:1789265462.784409:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265462.784417:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc9b089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3640:x1876180417549184:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789265462.784443:0:17184:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a57aa04c-0472-45c4-bafc-6983957e249b@0@lo t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:0.0:1789265462.784470:0:17184:0:(genops.c:1385:class_connect()) connect: client a57aa04c-0472-45c4-bafc-6983957e249b, cookie 0x9272d942b4a97713 00000100:00080000:0.0:1789265462.784592:0:17184:0:(import.c:65:import_set_state_nolock()) ffff9fccbf551000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265462.784661:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc9b089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+5:3640:x1876180417549184:12345-0@lo:250:mount.lustre.0 Request processed in 243us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265462.784669:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265462.785121:0:3640:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.149@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789265462.785131:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.149@tcp: connect to target with instance 0 00000100:00080000:1.0:1789265462.785139:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.149@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789265462.785143:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789265462.785146:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccb0e1d000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789265462.785148:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789265462.785159:0:3640:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789265462.785164:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a57aa04c-0472-45c4-bafc-6983957e249b:3640:1876180417549184:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789265462.799891:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789265462.800117:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789265462.800124:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789265462.800992:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789265462.801000:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789265462.801568:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789265462.801575:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789265462.807455:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789265462.808305:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789265462.808315:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789265462.809761:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789265462.809772:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789265462.861604:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265462.861852:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789265462.861859:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789265462.865364:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789265462.865381:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789265462.866413:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265462.866601:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789265462.866607:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789265462.867474:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789265462.867483:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789265462.868316:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265462.868490:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789265462.868497:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789265462.871287:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789265462.871301:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789265462.872219:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265462.872382:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789265462.872387:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789265462.872946:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789265462.872953:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789265462.918935:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789265462.919328:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789265462.919335:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789265462.923327:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789265462.923342:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789265462.924480:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789265462.924490:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789265462.937150:0:17171:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789265462.937184:0:17171:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1789265462.937190:0:17171:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.149@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789265462.937292:0:17171:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.149@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789265462.937335:0:17171:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.149@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789265462.937339:0:17171:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789265462.937340:0:17171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789265462.937342:0:17171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265462.937343:0:17171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265462.937344:0:17171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265462.937345:0:17171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265462.937347:0:17171:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789265462.937348:0:17171:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789265462.937350:0:17171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265462.937356:0:17171:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789265462.937358:0:17171:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789265462.937360:0:17171:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789265462.937361:0:17171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789265462.937362:0:17171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265462.937363:0:17171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265462.937363:0:17171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265462.937364:0:17171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265462.937365:0:17171:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789265462.937366:0:17171:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789265462.937367:0:17171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265462.937368:0:17171:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789265462.937392:0:17171:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789265462.937413:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417549312:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789265462.937478:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265462.937515:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc839510c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265462.937768:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417549312 00000100:00100000:2.0:1789265462.937775:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417549312 00000100:00100000:2.0:1789265462.937862:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265462.937872:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc9b08b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+5:17171:x1876180417549312:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789265462.937916:0:17187:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789265462.937918:0:17187:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789265462.937921:0:17187:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1789265462.940387:0:17208:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789265462.941152:0:17187:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1789265462.944375:0:17209:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789265462.944383:0:17209:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1789265462.944387:0:17209:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789265462.944390:0:17209:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789265462.944625:0:17209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1789265462.945211:0:17187:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789265462.945222:0:17187:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789265462.948563:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc9b08b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+5:17171:x1876180417549312:12345-0@lo:253:mount.lustre.0 Request processed in 10684us (11076us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265462.948582:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265462.948861:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417549312:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789265462.948877:0:17171:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789265462.948881:0:17171:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789265462.948882:0:17171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789265462.948884:0:17171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265462.948885:0:17171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265462.948886:0:17171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265462.948887:0:17171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265462.948889:0:17171:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789265462.948890:0:17171:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789265462.948892:0:17171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265462.948893:0:17171:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789265462.948912:0:17171:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fcb83933000 from lustre-MDT0000 10000000:01000000:1.0:1789265462.948943:0:17171:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789265462.948946:0:17171:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789265462.948951:0:17171:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9fcb829f99b8 10000000:01000000:1.0:1789265462.948955:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789265462.948962:0:17171:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fcb829f99b8 from 1 10000000:01000000:1.0:1789265462.949842:0:17171:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789265462.949891:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53a00/0x9272d942b4a9771a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265462.949914:0:17171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53a00/0x9272d942b4a9771a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265462.949925:0:17171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53a00/0x9272d942b4a9771a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265462.949946:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417549440:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265462.950000:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265462.950446:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc839519c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265462.950522:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417549440 00000100:00100000:2.0:1789265462.950530:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417549440 00000100:00100000:2.0:1789265462.950679:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265462.950689:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc9b08b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+5:17171:x1876180417549440:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265462.950703:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265462.950719:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb84a2ea00/0x9272d942b4a97721 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9771a expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265462.950754:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb84a2ea00/0x9272d942b4a97721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9771a expref: 6 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265462.950765:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb84a2ea00/0x9272d942b4a97721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9771a expref: 6 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265462.950774:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2ea00, rc 0) 00000100:00100000:2.0:1789265462.950822:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc9b08b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+6:17171:x1876180417549440:12345-0@lo:101:mount.lustre.0 Request processed in 135us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265462.950836:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265462.950905:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417549440:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265462.950915:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53a00/0x9272d942b4a9771a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97721 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265462.950921:0:17171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53a00/0x9272d942b4a9771a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97721 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265462.950964:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417549568:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265462.950988:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265462.953383:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc839519c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265462.954729:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417549568 00000100:00100000:0.0:1789265462.954741:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417549568 00000100:00100000:0.0:1789265462.954797:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789265462.954806:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+6:17171:x1876180417549568:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265462.955784:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+6:17171:x1876180417549568:12345-0@lo:501:mount.lustre.0 Request processed in 975us (4790us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789265462.955796:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265462.955890:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417549568:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789265462.955930:0:17171:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789265462.956079:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53a00/0x9272d942b4a9771a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97721 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265462.956090:0:17171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53a00/0x9272d942b4a9771a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97721 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265462.956129:0:17171:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fcb83933000 10000000:01000000:1.0:1789265462.956134:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789265462.956138:0:17171:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fcb83933000 10000000:01000000:1.0:1789265462.956141:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789265462.956145:0:17171:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fcb83933000 from 1 10000000:01000000:1.0:1789265462.956148:0:17171:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789265462.956182:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52a00/0x9272d942b4a97728 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265462.956190:0:17171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52a00/0x9272d942b4a97728 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265462.956200:0:17171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52a00/0x9272d942b4a97728 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265462.956220:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417549696:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265462.956262:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265462.956292:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc839519c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265462.956690:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417549696 00000100:00100000:2.0:1789265462.956696:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417549696 00000100:00100000:1.0:1789265462.958127:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265462.958139:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+6:17171:x1876180417549696:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265462.958155:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265462.958173:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83f53200/0x9272d942b4a9772f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a97728 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265462.958198:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83f53200/0x9272d942b4a9772f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a97728 expref: 7 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265462.958209:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83f53200/0x9272d942b4a9772f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a97728 expref: 7 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265462.958231:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f53200, rc 0) 00000100:00100000:1.0:1789265462.958291:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+7:17171:x1876180417549696:12345-0@lo:101:mount.lustre.0 Request processed in 154us (2029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265462.958298:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265462.958352:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417549696:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265462.958368:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52a00/0x9272d942b4a97728 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9772f expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265462.958528:0:17171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52a00/0x9272d942b4a97728 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9772f expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265462.958548:0:17171:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789265462.958553:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52a00/0x9272d942b4a97728 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9772f expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265462.958560:0:17171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52a00/0x9272d942b4a97728 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9772f expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265462.958567:0:17171:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789265462.958571:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789265462.958576:0:17171:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fcb83933000 10000000:01000000:1.0:1789265462.958579:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789265462.958582:0:17171:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789265462.958585:0:17171:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789265462.958603:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53c00/0x9272d942b4a97736 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265462.958621:0:17171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53c00/0x9272d942b4a97736 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265462.958629:0:17171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53c00/0x9272d942b4a97736 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265462.958657:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417549824:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265462.958690:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265462.958714:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417549824 00000100:00100000:1.0:1789265462.958719:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417549824 00000100:00100000:1.0:1789265462.958741:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265462.958747:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+7:17171:x1876180417549824:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265462.958754:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265462.958761:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83f53000/0x9272d942b4a9773d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a97736 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265462.958774:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83f53000/0x9272d942b4a9773d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a97736 expref: 8 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265462.958781:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83f53000/0x9272d942b4a9773d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a97736 expref: 8 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265462.958787:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f53000, rc 0) 00000100:00100000:1.0:1789265462.958809:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+8:17171:x1876180417549824:12345-0@lo:101:mount.lustre.0 Request processed in 62us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265462.958815:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265462.961313:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc839519c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265462.961474:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417549824:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265462.961499:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53c00/0x9272d942b4a97736 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9773d expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265462.961512:0:17171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53c00/0x9272d942b4a97736 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9773d expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265462.961614:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417549952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265462.961888:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265462.961982:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc839519c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265462.962146:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417549952 00000100:00100000:0.0:1789265462.962153:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417549952 00000100:00100000:0.0:1789265462.962229:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265462.962239:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+8:17171:x1876180417549952:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265462.962571:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+9:17171:x1876180417549952:12345-0@lo:501:mount.lustre.0 Request processed in 332us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265462.962579:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265462.962723:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417549952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265462.962758:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417550080:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265462.962798:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265462.962864:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc839519c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265462.962900:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417550080 00000100:00100000:0.0:1789265462.962905:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417550080 00000100:00100000:0.0:1789265462.963050:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265462.963058:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+9:17171:x1876180417550080:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789265462.965574:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+9:17171:x1876180417550080:12345-0@lo:503:mount.lustre.0 Request processed in 2510us (2768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265462.965588:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265462.967433:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417550080:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265462.968462:0:17210:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f30a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a57aa04c-0472-45c4-bafc-6983957e249b:17210:1876180417550208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265462.968603:0:17210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265462.968739:0:17210:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccadbf0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265462.968830:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417550208 00000100:00100000:1.0:1789265462.968837:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417550208 00000100:00100000:1.0:1789265462.968883:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265462.968892:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+9:17210:x1876180417550208:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265462.970353:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+9:17210:x1876180417550208:12345-0@lo:502:llog_process_th.0 Request processed in 1457us (1745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265462.970364:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789265462.970510:0:17210:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f30a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a57aa04c-0472-45c4-bafc-6983957e249b:17210:1876180417550208:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789265462.970609:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265462.970620:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265462.970622:0:17210:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789265462.970628:0:17210:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789265462.970631:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789265462.970703:0:17210:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9fcb8393b370) 00000020:00000080:2.0:1789265462.970721:0:17210:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789265462.970728:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789265462.970819:0:17210:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789265462.970828:0:17210:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9272d942b4a9774b 00000020:00000080:2.0:1789265462.971221:0:17210:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789265462.971226:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265462.971230:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265462.971232:0:17210:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789265462.971235:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265462.971238:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265462.971240:0:17210:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789265462.971243:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789265462.971251:0:17210:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9fcb8393cd28) 00000020:00000080:2.0:1789265462.971261:0:17210:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789265462.971266:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789265462.971273:0:17210:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789265462.971276:0:17210:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789265462.971282:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789265462.971336:0:17210:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fcb83933000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789265462.971351:0:17210:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9fcb839399b8) 00000020:00000080:2.0:1789265462.971362:0:17210:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789265462.971472:0:17210:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789265462.971479:0:17210:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9272d942b4a97760 00000020:00000080:2.0:1789265462.971700:0:17210:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789265462.971707:0:17210:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789265462.971714:0:17210:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9272d942b4a97767 00080000:01000000:2.0:1789265462.971719:0:17210:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789265462.971723:0:17210:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9272d942b4a9776e 00010000:00010000:0.0:1789265463.124582:0:17210:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1789265463.125367:0:17210:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:0.0:1789265463.126226:0:17210:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789265463.127407:0:17210:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9fccbf45cd28) 00000020:00000080:0.0:1789265463.127428:0:17210:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789265463.127516:0:17210:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789265463.127523:0:17210:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9272d942b4a9777c 00000020:00000080:0.0:1789265463.134899:0:17210:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789265463.146384:0:17210:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9272d942b4a97783 00000020:00000080:3.0:1789265463.148323:0:17210:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789265463.148337:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265463.148343:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265463.148346:0:17210:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789265463.148348:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789265463.148351:0:17210:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1789265463.148353:0:17210:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789265463.148355:0:17210:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789265463.148356:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789265463.148359:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265463.148360:0:17210:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789265463.148375:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265463.148380:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265463.148382:0:17210:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789265463.148386:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789265463.148433:0:17210:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789265463.148464:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265463.148468:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265463.148470:0:17210:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789265463.148472:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265463.148476:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265463.148477:0:17210:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1789265463.148480:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789265463.148484:0:17210:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.149@tcp to nid 0x20000c0a8cb95 (192.168.203.149@tcp) 00000020:00000080:3.0:1789265463.148512:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265463.148528:0:17210:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9fccbd37cd28) 00000020:00000080:3.0:1789265463.148543:0:17210:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789265463.148549:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789265463.148617:0:17210:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1789265463.148622:0:17210:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789265463.148628:0:17210:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9272d942b4a97791 00010000:00080000:3.0:1789265463.148668:0:17210:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fcb84943800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.149@tcp at head 00010000:00010000:3.0:1789265463.154843:0:17210:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1789265463.160591:0:17210:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789265463.160605:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789265463.160708:0:17210:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789265463.160728:0:17210:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9272d942b4a97798 00000100:00080000:0.0:1789265463.160738:0:17210:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789265463.160744:0:17210:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fcb84943800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:0.0:1789265463.160845:0:17210:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fccbd3e7800 x1876180417550336/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265463.160925:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417550336:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789265463.161001:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265463.161132:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417550336 00000100:00100000:3.0:1789265463.161139:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417550336 00000100:00100000:3.0:1789265463.161168:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265463.161174:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1876180417550336:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1789265463.161189:0:17197:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1789265463.164338:0:17210:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1789265463.164501:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265463.164508:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265463.164511:0:17210:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1789265463.164514:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789265463.164517:0:17210:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1789265463.164531:0:17210:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789265463.164533:0:17210:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789265463.164534:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789265463.164537:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265463.164538:0:17210:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789265463.164540:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789265463.164545:0:17210:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789265463.164548:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265463.164550:0:17210:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789265463.164553:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789265463.164556:0:17210:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.149@tcp to nid 0x20000c0a8cb95 (192.168.203.149@tcp) 00000020:01000000:0.0:1789265463.164580:0:17210:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789265463.164583:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789265463.164600:0:17210:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9fccbf4599b8) 00000020:00000080:0.0:1789265463.164619:0:17210:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1789265463.164624:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789265463.164710:0:17210:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789265463.164716:0:17210:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789265463.164722:0:17210:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9272d942b4a977a6 00010000:00080000:0.0:1789265463.164765:0:17210:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fccbf44b800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.149@tcp at head 00010000:00010000:0.0:1789265463.165834:0:17210:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1789265463.170150:0:17210:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789265463.170517:0:17210:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789265463.174721:0:17210:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265463.175278:0:17210:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1789265463.187734:0:17210:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00100000:3.0:1789265463.195537:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1876180417550336:12345-0@lo:38:llog_process_th.0 Request processed in 34353us (34526us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789265463.195551:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789265463.195678:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb84943800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789265463.195684:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789265463.195688:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417550336:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789265463.202778:0:17216:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789265463.202784:0:17216:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789265463.203653:0:17210:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789265463.203665:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789265463.203701:0:17210:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789265463.203937:0:17210:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9272d942b4a977ad 00000100:00080000:0.0:1789265463.203948:0:17210:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789265463.203954:0:17210:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fccbf44b800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:0.0:1789265463.203990:0:17210:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fccbd3e7800 x1876180417550464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789265463.204018:0:17210:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1789265463.204133:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417550464:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789265463.204187:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180417550464 offset 0 length 520: 4 00000020:01000000:0.0:1789265463.204746:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265463.204751:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265463.204753:0:17210:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789265463.204756:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789265463.204758:0:17210:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1789265463.204760:0:17210:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789265463.204762:0:17210:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789265463.204763:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789265463.204765:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265463.204767:0:17210:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789265463.204769:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789265463.204773:0:17210:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789265463.204777:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265463.204779:0:17210:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789265463.204782:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789265463.204785:0:17210:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.149@tcp to nid 0x20000c0a8cb95 (192.168.203.149@tcp) 00000020:01000000:0.0:1789265463.204806:0:17210:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789265463.204808:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789265463.204822:0:17210:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9fccbf458000) 00000020:00000080:0.0:1789265463.204835:0:17210:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1789265463.204841:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789265463.204906:0:17210:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789265463.204913:0:17210:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1789265463.204919:0:17210:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9272d942b4a977bb 00010000:00080000:0.0:1789265463.204949:0:17210:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fcb8391e800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.149@tcp at head 00010000:00010000:0.0:1789265463.205200:0:17210:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789265463.205288:0:17210:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789265463.205304:0:17210:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789265463.208952:0:17210:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265463.209593:0:17210:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1789265463.209745:0:17210:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1789265463.210549:0:17218:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789265463.210554:0:17218:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789265463.211548:0:17210:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789265463.211572:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789265463.211609:0:17210:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789265463.211628:0:17210:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9272d942b4a977c2 00000100:00080000:2.0:1789265463.211742:0:17210:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789265463.211748:0:17210:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fcb8391e800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265463.211780:0:17210:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83f30a80 x1876180417550592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265463.211851:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417550592:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789265463.211906:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180417550592 offset 0 length 520: 4 00000100:00080000:2.0:1789265463.211959:0:17210:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789265463.212052:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265463.212056:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265463.212067:0:17210:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789265463.212071:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265463.212075:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265463.212076:0:17210:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789265463.212079:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789265463.212081:0:17210:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789265463.212084:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265463.212086:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265463.212087:0:17210:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789265463.212089:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265463.212092:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265463.212106:0:17210:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789265463.212112:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789265463.212140:0:17210:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f32300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a57aa04c-0472-45c4-bafc-6983957e249b:17210:1876180417550720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265463.212188:0:17210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265463.212203:0:17210:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc99446600 going to sleep for 11 seconds 00000100:00100000:0.0:1789265463.214379:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417550720 00000100:00100000:0.0:1789265463.214412:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417550720 00000100:00100000:0.0:1789265463.214469:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265463.214479:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+9:17210:x1876180417550720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265463.214785:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+9:17210:x1876180417550720:12345-0@lo:502:llog_process_th.0 Request processed in 306us (2595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265463.214794:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789265463.214957:0:17210:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f32300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a57aa04c-0472-45c4-bafc-6983957e249b:17210:1876180417550720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789265463.214988:0:17210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265463.214994:0:17210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265463.214996:0:17210:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789265463.215001:0:17210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1789265463.215548:0:17171:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1789265463.215571:0:17171:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789265463.215595:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53c00/0x9272d942b4a97736 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9773d expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265463.215607:0:17171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53c00/0x9272d942b4a97736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9773d expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265463.215615:0:17171:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fcb83933000 from 1 10000000:01000000:1.0:1789265463.215618:0:17171:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789265463.215658:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a977c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265463.215666:0:17171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a977c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265463.215675:0:17171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a977c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265463.215695:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417550848:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265463.215736:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265463.215773:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc83951000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265463.216482:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417550848 00000100:00100000:2.0:1789265463.216489:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417550848 00000100:00100000:2.0:1789265463.216578:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789265463.216588:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+9:17171:x1876180417550848:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265463.216599:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265463.216613:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb84a2f400/0x9272d942b4a977d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a977c9 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265463.216635:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb84a2f400/0x9272d942b4a977d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a977c9 expref: 10 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265463.216671:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb84a2f400/0x9272d942b4a977d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a977c9 expref: 10 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265463.216679:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2f400, rc 0) 00000100:00100000:2.0:1789265463.216727:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+10:17171:x1876180417550848:12345-0@lo:101:mount.lustre.0 Request processed in 140us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265463.216733:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265463.216784:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417550848:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265463.216798:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a977c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a977d0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265463.216817:0:17171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a977c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a977d0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265463.217409:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417550976:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789265463.217457:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265463.218919:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc83951000 going to sleep for 11 seconds 00000100:00100000:3.0:1789265463.220975:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417550976 00000100:00100000:3.0:1789265463.220987:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417550976 00000100:00100000:1.0:1789265463.222922:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265463.222935:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+10:17171:x1876180417550976:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789265463.222961:0:17187:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789265463.222967:0:17187:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789265463.223123:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+10:17171:x1876180417550976:12345-0@lo:256:mount.lustre.0 Request processed in 190us (5666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265463.223131:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789265463.223202:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417550976:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789265463.224227:0:17171:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789265463.224245:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a977c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a977d0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265463.224262:0:17171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a977c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a977d0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265463.224270:0:17171:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fcb83933000 from 1 10000000:01000000:3.0:1789265463.224276:0:17171:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789265463.224314:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81490000/0x9272d942b4a977d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265463.224323:0:17171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc81490000/0x9272d942b4a977d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265463.224333:0:17171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc81490000/0x9272d942b4a977d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265463.224353:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417551104:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789265463.224403:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265463.224445:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc91732d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265463.225437:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417551104 00000100:00100000:1.0:1789265463.225447:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417551104 00000100:00100000:1.0:1789265463.225504:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789265463.225513:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+10:17171:x1876180417551104:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265463.225526:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265463.225542:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83f52800/0x9272d942b4a977de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a977d7 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265463.225564:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83f52800/0x9272d942b4a977de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a977d7 expref: 11 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265463.225575:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83f52800/0x9272d942b4a977de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a977d7 expref: 11 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265463.225639:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f52800, rc 0) 00000100:00100000:1.0:1789265463.225706:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+11:17171:x1876180417551104:12345-0@lo:101:mount.lustre.0 Request processed in 194us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265463.225714:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265463.225746:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417551104:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789265463.225762:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc81490000/0x9272d942b4a977d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a977de expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265463.225771:0:17171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc81490000/0x9272d942b4a977d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a977de expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265463.225835:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417551232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265463.225944:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265463.225979:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c48c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265463.226058:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417551232 00000100:00100000:2.0:1789265463.226071:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417551232 00000100:00100000:2.0:1789265463.226113:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789265463.226121:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+11:17171:x1876180417551232:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265463.226255:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+11:17171:x1876180417551232:12345-0@lo:501:mount.lustre.0 Request processed in 135us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265463.226262:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789265463.226673:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417551232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265463.226701:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417551360:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789265463.226743:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265463.226773:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c48c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265463.226912:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417551360 00000100:00100000:1.0:1789265463.226918:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417551360 00000100:00100000:1.0:1789265463.226954:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789265463.226962:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+11:17171:x1876180417551360:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265463.227161:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+11:17171:x1876180417551360:12345-0@lo:503:mount.lustre.0 Request processed in 199us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265463.227169:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789265463.227192:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417551360:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265463.230889:0:17220:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a57aa04c-0472-45c4-bafc-6983957e249b:17220:1876180417551488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265463.230970:0:17220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265463.231060:0:17220:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc91732840 going to sleep for 11 seconds 00000100:00100000:2.0:1789265463.231588:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417551488 00000100:00100000:2.0:1789265463.231596:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417551488 00000100:00100000:2.0:1789265463.231647:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789265463.231656:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8a56e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+11:17220:x1876180417551488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265463.235769:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8a56e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+11:17220:x1876180417551488:12345-0@lo:502:llog_process_th.0 Request processed in 4104us (4789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265463.235784:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789265463.235947:0:17220:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a57aa04c-0472-45c4-bafc-6983957e249b:17220:1876180417551488:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789265463.235986:0:17220:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265463.235996:0:17220:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265463.235998:0:17220:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789265463.236005:0:17220:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fcb83933000 00000020:00000080:3.0:1789265463.236008:0:17220:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789265463.236016:0:17220:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265463.236019:0:17220:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265463.236038:0:17220:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789265463.236042:0:17220:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265463.236045:0:17220:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265463.236046:0:17220:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789265463.236049:0:17220:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fcb83933000 00000020:00000080:3.0:1789265463.236051:0:17220:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789265463.236113:0:17220:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265463.236118:0:17220:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265463.236119:0:17220:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789265463.236122:0:17220:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265463.236125:0:17220:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265463.236126:0:17220:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789265463.236130:0:17220:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fcb83933000 00000020:00000080:3.0:1789265463.236132:0:17220:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789265463.236151:0:17220:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265463.236154:0:17220:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265463.236156:0:17220:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789265463.236158:0:17220:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265463.236161:0:17220:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265463.236162:0:17220:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789265463.236166:0:17220:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fcb83933000 00000020:00000080:3.0:1789265463.236168:0:17220:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789265463.236226:0:17220:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a57aa04c-0472-45c4-bafc-6983957e249b:17220:1876180417551616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265463.236274:0:17220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265463.236315:0:17220:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc91732840 going to sleep for 11 seconds 00000100:00100000:0.0:1789265463.236382:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417551616 00000100:00100000:0.0:1789265463.236389:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417551616 00000100:00100000:0.0:1789265463.236434:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789265463.236443:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8a56e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+11:17220:x1876180417551616:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265463.236573:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8a56e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+11:17220:x1876180417551616:12345-0@lo:502:llog_process_th.0 Request processed in 131us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265463.236580:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789265463.236619:0:17220:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a57aa04c-0472-45c4-bafc-6983957e249b:17220:1876180417551616:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265463.236648:0:17220:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265463.236653:0:17220:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265463.236655:0:17220:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789265463.236659:0:17220:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789265463.236718:0:17171:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789265463.236735:0:17171:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789265463.236748:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81490000/0x9272d942b4a977d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a977de expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265463.236758:0:17171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc81490000/0x9272d942b4a977d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a977de expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265463.236799:0:17171:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789265463.236803:0:17171:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fcb83933000 10000000:01000000:0.0:1789265463.236806:0:17171:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fcb83933000 10000000:01000000:0.0:1789265463.236810:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789265463.236815:0:17171:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fcb83933000 from 1 10000000:01000000:0.0:1789265463.236818:0:17171:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789265463.236843:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4200/0x9272d942b4a977e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265463.236851:0:17171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4200/0x9272d942b4a977e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265463.236860:0:17171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4200/0x9272d942b4a977e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265463.236878:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417551744:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789265463.236902:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265463.236919:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c48c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265463.237139:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417551744 00000100:00100000:3.0:1789265463.237144:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417551744 00000100:00100000:3.0:1789265463.237178:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789265463.237186:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+11:17171:x1876180417551744:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265463.237195:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265463.237209:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc81491800/0x9272d942b4a977ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a977e5 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265463.237229:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81491800/0x9272d942b4a977ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a977e5 expref: 12 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265463.237238:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc81491800/0x9272d942b4a977ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a977e5 expref: 12 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265463.237246:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81491800, rc 0) 00000100:00100000:3.0:1789265463.237275:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+12:17171:x1876180417551744:12345-0@lo:101:mount.lustre.0 Request processed in 90us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265463.237280:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789265463.237352:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417551744:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789265463.237364:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4200/0x9272d942b4a977e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a977ec expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265463.237374:0:17171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4200/0x9272d942b4a977e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a977ec expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265463.237422:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417551872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265463.237448:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265463.237474:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c48c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265463.237520:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417551872 00000100:00100000:3.0:1789265463.237524:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417551872 00000100:00100000:3.0:1789265463.237553:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789265463.237560:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+12:17171:x1876180417551872:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265463.237755:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+12:17171:x1876180417551872:12345-0@lo:501:mount.lustre.0 Request processed in 195us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265463.237763:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789265463.237836:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417551872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265463.237861:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417552000:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789265463.237894:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265463.237914:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c48c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265463.237961:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417552000 00000100:00100000:3.0:1789265463.237965:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417552000 00000100:00100000:3.0:1789265463.238043:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789265463.238050:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+12:17171:x1876180417552000:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265463.238143:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+12:17171:x1876180417552000:12345-0@lo:503:mount.lustre.0 Request processed in 93us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265463.238149:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789265463.238225:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417552000:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265463.247066:0:17222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84846d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a57aa04c-0472-45c4-bafc-6983957e249b:17222:1876180417552128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265463.247163:0:17222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265463.247209:0:17222:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc91732d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265463.247271:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417552128 00000100:00100000:1.0:1789265463.247279:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417552128 00000100:00100000:1.0:1789265463.247325:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789265463.247335:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+12:17222:x1876180417552128:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265463.247465:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+12:17222:x1876180417552128:12345-0@lo:502:llog_process_th.0 Request processed in 132us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265463.247473:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789265463.248934:0:17222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84846d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a57aa04c-0472-45c4-bafc-6983957e249b:17222:1876180417552128:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789265463.249009:0:17222:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789265463.249052:0:17222:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9fccbc9c19b8) 00000020:00000080:2.0:1789265463.249076:0:17222:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1789265463.249190:0:17222:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fcb83933000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789265463.249195:0:17222:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fcb83933000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789265463.249197:0:17222:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fcb83933000 4 00010000:00080000:2.0:1789265463.249224:0:17222:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fccbf4ee000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.149@tcp at head 00010000:00010000:2.0:1789265463.252389:0:17222:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1789265463.252694:0:17222:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789265463.252738:0:17222:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789265463.252752:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9272d942b4a977fa 00000100:00080000:2.0:1789265463.252762:0:17222:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789265463.252768:0:17222:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9fccbf4ee000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265463.252804:0:17222:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83f32300 x1876180417552256/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265463.252840:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876180417552256:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789265463.252908:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789265463.252966:0:17222:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789265463.256773:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417552256 00000100:00100000:1.0:1789265463.256787:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417552256 00000100:00100000:1.0:1789265463.256825:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265463.256834:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1876180417552256:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789265463.258972:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1876180417552256:12345-0@lo:38:llog_process_th.0 Request processed in 2005us (5930us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789265463.258991:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265463.259077:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789265463.259087:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccbf4ee000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265463.259092:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789265463.259106:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876180417552256:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789265463.262900:0:17222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a57aa04c-0472-45c4-bafc-6983957e249b:17222:1876180417552384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265463.262982:0:17222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265463.263045:0:17222:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdb6240 going to sleep for 11 seconds 00000100:00100000:1.0:1789265463.263140:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417552384 00000100:00100000:1.0:1789265463.263150:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417552384 00000100:00100000:1.0:1789265463.263196:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789265463.263206:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+12:17222:x1876180417552384:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265463.263334:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+12:17222:x1876180417552384:12345-0@lo:502:llog_process_th.0 Request processed in 129us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265463.263341:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789265463.264773:0:17222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a57aa04c-0472-45c4-bafc-6983957e249b:17222:1876180417552384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265463.264844:0:17222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a57aa04c-0472-45c4-bafc-6983957e249b:17222:1876180417552512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265463.264900:0:17222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265463.264933:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417552512 00000100:00100000:3.0:1789265463.264939:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417552512 00000100:00100000:3.0:1789265463.264981:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789265463.264989:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+12:17222:x1876180417552512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265463.265111:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+12:17222:x1876180417552512:12345-0@lo:502:llog_process_th.0 Request processed in 122us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265463.265119:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789265463.265162:0:17222:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdb6240 going to sleep for 11 seconds 00000100:00100000:3.0:1789265463.265175:0:17222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a57aa04c-0472-45c4-bafc-6983957e249b:17222:1876180417552512:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789265463.265196:0:17222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789265463.265355:0:17171:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789265463.265380:0:17171:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789265463.265397:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4200/0x9272d942b4a977e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a977ec expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265463.265407:0:17171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4200/0x9272d942b4a977e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a977ec expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789265463.265454:0:17171:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789265463.265456:0:17171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789265463.265458:0:17171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265463.265459:0:17171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265463.265460:0:17171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265463.265461:0:17171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265463.265463:0:17171:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789265463.265464:0:17171:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789265463.265466:0:17171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265463.265471:0:17171:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789265463.265476:0:17171:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1789265463.265478:0:17171:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789265463.265479:0:17171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789265463.265480:0:17171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265463.265481:0:17171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265463.265482:0:17171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265463.265483:0:17171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265463.265484:0:17171:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789265463.265485:0:17171:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789265463.265485:0:17171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265463.265486:0:17171:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789265463.265499:0:17171:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789265463.265508:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417552640:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789265463.265540:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265463.265557:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc839510c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265463.265576:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417552640 00000100:00100000:1.0:1789265463.265580:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417552640 00000100:00100000:1.0:1789265463.265612:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789265463.265619:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+12:17171:x1876180417552640:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789265463.266790:0:17187:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789265463.266806:0:17187:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789265463.272922:0:17187:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789265463.272936:0:17187:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789265463.273038:0:17208:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789265463.273043:0:17208:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789265463.273064:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fcb84a2e800/0x9272d942b4a97801 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265463.273082:0:17208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcb84a2f400/0x9272d942b4a977d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a977c9 expref: 12 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265463.273090:0:17208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fcb84a2e800/0x9272d942b4a97801 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265463.273133:0:17208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcb84a2f400/0x9272d942b4a977d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a977c9 expref: 12 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265463.273157:0:17208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcb84a2f400/0x9272d942b4a977d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a977c9 expref: 12 pid: 17186 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265463.273171:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f30380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1876180417552768:0@lo:104: 00000100:00100000:2.0:1789265463.273231:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265463.273266:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada13180 going to sleep for 11 seconds 00000100:00100000:2.0:1789265463.273301:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417552768 00000100:00100000:2.0:1789265463.273307:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417552768 00000100:00100000:2.0:1789265463.273345:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265463.273353:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a57aa04c-0472-45c4-bafc-6983957e249b+3:17208:x1876180417552768:12345-0@lo:104: 00010000:00010000:2.0:1789265463.273365:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a977c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a977d0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265463.273619:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265463.273627:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a57aa04c-0472-45c4-bafc-6983957e249b+3:17208:x1876180417552768:12345-0@lo:104: Request processed in 274us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265463.273699:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265463.273769:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+12:17171:x1876180417552640:12345-0@lo:253:mount.lustre.0 Request processed in 8149us (8227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265463.273778:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265463.273827:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f30380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1876180417552768:0@lo:104: 00010000:00010000:2.0:1789265463.273847:0:17208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fcb84a2e800/0x9272d942b4a97801 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265463.275035:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265463.275047:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a977c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a977d0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265463.275057:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f53400 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:1.0:1789265463.275061:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a977c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a977d0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265463.275069:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a977c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a977d0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265463.275088:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a977c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a977d0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265463.275103:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789265463.275150:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a977c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a977d0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265463.275157:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265463.275181:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a977c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a977d0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265463.275189:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a977c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a977d0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265463.275205:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265463.275208:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265463.275209:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265463.275242:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17171:1876180417552640:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789265463.275255:0:17171:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789265463.275258:0:17171:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789265463.275260:0:17171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789265463.275261:0:17171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265463.275262:0:17171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265463.275263:0:17171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265463.275265:0:17171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265463.275266:0:17171:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789265463.275267:0:17171:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789265463.275269:0:17171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265463.275270:0:17171:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789265463.275282:0:17171:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789265463.276143:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a57aa04c-0472-45c4-bafc-6983957e249b:3641:1876180417552896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265463.276203:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265463.276270:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417552896 00000100:00100000:2.0:1789265463.276277:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417552896 00010000:00010000:2.0:1789265463.276304:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcb84a2f400/0x9272d942b4a977d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a977c9 expref: 12 pid: 17186 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265463.276350:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265463.276358:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a57aa04c-0472-45c4-bafc-6983957e249b+12:3641:x1876180417552896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265463.276370:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265463.277482:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcb84a2f400/0x9272d942b4a977d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a977c9 expref: 12 pid: 17186 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265463.277499:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcb84a2f400/0x9272d942b4a977d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a977c9 expref: 12 pid: 17186 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265463.277518:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb84a2f400/0x9272d942b4a977d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a977c9 expref: 12 pid: 17186 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265463.277535:0:17177:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fcb84a2e800/0x9272d942b4a97801 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265463.277544:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb84a2e800/0x9272d942b4a97801 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789265463.277563:0:17177:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004520911s 00010000:00010000:2.0:1789265463.277567:0:17177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fcb84a2e800/0x9272d942b4a97801 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265463.277575:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fcb84a2e800/0x9272d942b4a97801 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265463.277582:0:17177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fcb84a2e800/0x9272d942b4a97801 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265463.277589:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fcb84a2e800/0x9272d942b4a97801 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265463.277603:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e800 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265463.277608:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fcb84a2e800/0x9272d942b4a97801 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265463.277617:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fcb84a2e800/0x9272d942b4a97801 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265463.277641:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fcb84a2e800/0x9272d942b4a97801 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265463.277653:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265463.277715:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a57aa04c-0472-45c4-bafc-6983957e249b+11:3641:x1876180417552896:12345-0@lo:103:ldlm_bl.0 Request processed in 1356us (1509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265463.277723:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265463.277778:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a57aa04c-0472-45c4-bafc-6983957e249b:3641:1876180417552896:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265463.280797:0:17208:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fcb84a2e800/0x9272d942b4a97801 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265463.280818:0:17208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fcb84a2e800/0x9272d942b4a97801 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265463.280847:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb84a2e800/0x9272d942b4a97801 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789265463.309293:0:17171:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1789265463.309595:0:17171:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789265463.309874:0:17232:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1789265463.309879:0:17232:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1789265463.309924:0:17233:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789265463.310212:0:17171:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:3.0:1789265463.310519:0:17234:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9fcb84847800 x1876180417553024/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265463.310531:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccadb6a240 going to sleep for 0 seconds 00000040:00080000:0.0:1789265463.310976:0:17233:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1789265463.312579:0:17171:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789265463.312619:0:17171:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789265463.314396:0:17171:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789265463.314411:0:17171:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789265463.314476:0:17171:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265463.318885:0:17171:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789265463.319296:0:17233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789265463.319356:0:17233:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1789265463.320248:0:17171:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789265463.320303:0:17171:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789265463.324491:0:17171:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:3.0:1789265463.325270:0:17171:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1789265463.337863:0:17171:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789265463.341687:0:17171:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789265463.341730:0:17171:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbf45c1c63988 00100000:10000000:3.0:1789265463.341738:0:17171:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789265463.344411:0:17171:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789265463.344428:0:17171:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.149@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789265463.344449:0:17171:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789265463.344471:0:17171:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1789265463.363001:0:17171:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265463.366707:0:17171:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789265463.810216:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265464.321789:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccadb6a240 going to sleep for 0 seconds 00000040:00080000:1.0:1789265464.340268:0:17228:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265464.340276:0:17228:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265464.347487:0:17228:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:0.0:1789265464.347503:0:17228:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:1.0:1789265464.385317:0:17189:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789265464.385324:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fcb83933000 from 7 10000000:01000000:1.0:1789265464.385329:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789265464.385376:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a97808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265464.385388:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a97808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265464.385399:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a97808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265464.385423:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417553152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789265464.385490:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265464.385540:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0abb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265464.385589:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417553152 00000100:00100000:2.0:1789265464.385596:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417553152 00000100:00100000:2.0:1789265464.385654:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789265464.385664:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+11:17189:x1876180417553152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265464.385677:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265464.385691:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb84a2e000/0x9272d942b4a9780f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a97808 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265464.385715:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb84a2e000/0x9272d942b4a9780f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a97808 expref: 12 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265464.385744:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb84a2e000/0x9272d942b4a9780f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a97808 expref: 12 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265464.385754:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2e000, rc 0) 00000100:00100000:2.0:1789265464.385793:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+12:17189:x1876180417553152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265464.385800:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789265464.385884:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417553152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265464.385898:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a97808 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9780f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265464.385907:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a97808 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9780f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265464.385959:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417553280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789265464.385990:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265464.386012:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0abb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265464.386095:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417553280 00000100:00100000:2.0:1789265464.386100:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417553280 00000100:00100000:2.0:1789265464.386131:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789265464.386138:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+12:17189:x1876180417553280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789265464.386150:0:17187:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789265464.386166:0:17187:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789265464.386169:0:17187:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789265464.386243:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+12:17189:x1876180417553280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265464.386250:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789265464.386310:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417553280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789265464.386348:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789265464.386354:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a97808 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9780f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265464.386362:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a97808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9780f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265464.833520:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265465.347683:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccadb6a240 going to sleep for 0 seconds 00000040:00080000:0.0:1789265465.409475:0:17228:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265465.409484:0:17228:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265465.409634:0:17228:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1789265465.409677:0:17228:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265465.409872:0:17228:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:1.0:1789265465.861673:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265466.375607:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccadb6a240 going to sleep for 0 seconds 00010000:00010000:1.0:1789265466.881579:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265467.393529:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccadb6a240 going to sleep for 0 seconds 00010000:00010000:1.0:1789265467.905929:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789265468.215871:0:17478:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg349-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1789265468.417153:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789265468.417159:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789265468.417163:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fcb84943800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265468.417171:0:17249:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 514 00000100:00080000:2.0:1789265468.417176:0:17249:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789265468.417183:0:17249:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fcb84943800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265468.417207:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83f32a00 x1876180417553536/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789265468.417223:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265468.417238:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265468.417241:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265468.417243:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265468.417246:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789265468.417249:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789265468.417251:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fccbf4ee000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265468.417256:0:17249:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9fccbf4ee000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265468.417270:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83f33100 x1876180417553664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265468.417370:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265468.417386:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a57aa04c-0472-45c4-bafc-6983957e249b:3641:1876180417553408:0@lo:400:kworker.0 00000100:00100000:1.0:1789265468.417452:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265468.417506:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417553536:0@lo:38:kworker.0 00000100:00100000:1.0:1789265468.417532:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265468.417552:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876180417553664:0@lo:38:kworker.0 00000100:00100000:1.0:1789265468.417575:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265468.417630:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417553536 00000100:00100000:1.0:1789265468.417637:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417553536 00000100:00100000:1.0:1789265468.417668:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265468.417675:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1876180417553536:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789265468.417703:0:17198:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789265468.421076:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417553408 00000100:00100000:2.0:1789265468.421091:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417553408 00000100:00100000:2.0:1789265468.421153:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265468.421163:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+12:3641:x1876180417553408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265468.421257:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+12:3641:x1876180417553408:12345-0@lo:400:kworker.0 Request processed in 96us (3805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265468.421265:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265468.421522:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccadb6a240 going to sleep for 0 seconds 00000100:00100000:0.0:1789265468.422134:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417553664 00000100:00100000:0.0:1789265468.422141:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417553664 00000100:00100000:0.0:1789265468.422179:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265468.422185:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1876180417553664:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789265468.422211:0:17194:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:0.0:1789265468.422258:0:17194:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9272d942b4a97816 00000004:00100000:0.0:1789265468.422273:0:17194:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789265468.422407:0:17194:0:(import.c:65:import_set_state_nolock()) ffff9fccb0929000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265468.422476:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876180417553664:12345-0@lo:38:kworker.0 Request processed in 290us (4900us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265468.422483:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789265468.422532:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fcb83f33100 x1876180417553664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789265468.422547:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789265468.422555:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789265468.422559:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789265468.422562:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccbf4ee000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789265468.422568:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876180417553664:0@lo:38:kworker.0 00000100:00100000:1.0:1789265468.434868:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a57aa04c-0472-45c4-bafc-6983957e249b:3641:1876180417553408:0@lo:400:kworker.0 00000100:00100000:1.0:1789265468.435044:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1876180417553536:12345-0@lo:38:kworker.0 Request processed in 17343us (17486us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789265468.435056:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789265468.435802:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb84943800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265468.435809:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789265468.435813:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417553536:0@lo:38:kworker.0 00010000:00010000:1.0:1789265468.930340:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789265469.184592:0:17530:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789265469.184785:0:17530:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789265469.442191:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccadb6a240 going to sleep for 0 seconds 00010000:00010000:2.0:1789265469.956155:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789265470.105514:0:17580:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265470.105735:0:17580:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789265470.467330:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccadb6a240 going to sleep for 0 seconds 00010000:00010000:0.0:1789265470.978709:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265471.489236:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccadb6a240 going to sleep for 0 seconds 00010000:00010000:2.0:1789265472.001325:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265472.513733:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccadb6a240 going to sleep for 0 seconds 00010000:00010000:0.0:1789265473.028511:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265473.546330:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265463/real 1789265463] req@ffff9fcb83f30a80 x1876180417550592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265473 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265473.546380:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb83f30a80 x1876180417550592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265473 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265473.546392:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265463/real 1789265463] req@ffff9fccbd3e7800 x1876180417550464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265473 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265473.546407:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fccbd3e7800 x1876180417550464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265473 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789265473.546430:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb8391e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789265473.546440:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789265473.546443:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417550592:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789265473.546449:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccbf44b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789265473.546454:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789265473.546457:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417550464:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789265473.546550:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789265473.546555:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789265473.546558:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fcb84943800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265473.546564:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 519 00000100:00080000:2.0:1789265473.546570:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789265473.546577:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fcb84943800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265473.546601:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83f33800 x1876180417553920/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789265473.546615:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265473.546618:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789265473.546626:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fccbf44b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265473.546629:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 514 00000100:00080000:2.0:1789265473.546632:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789265473.546635:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fccbf44b800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265473.546649:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83f32d80 x1876180417554048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789265473.546658:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265473.546661:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789265473.546662:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fcb8391e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265473.546665:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 514 00000100:00080000:2.0:1789265473.546668:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789265473.546671:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fcb8391e800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265473.546683:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83f31c00 x1876180417554176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265473.546718:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccadb6a240 going to sleep for 0 seconds 00000100:00100000:2.0:1789265473.546767:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a57aa04c-0472-45c4-bafc-6983957e249b:3643:1876180417553792:0@lo:400:kworker.0 00000100:00100000:2.0:1789265473.546850:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265473.547087:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265473.547095:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417554304:0@lo:400:kworker.0 00000100:00100000:2.0:1789265473.547141:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265473.547200:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417553792 00000100:00100000:2.0:1789265473.547209:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417553792 00000100:00100000:2.0:1789265473.547366:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789265473.547379:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+12:3643:x1876180417553792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265473.547433:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+12:3643:x1876180417553792:12345-0@lo:400:kworker.0 Request processed in 57us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265473.547448:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789265473.547493:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417554304 00000100:00100000:2.0:1789265473.547496:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417554304 00000100:00100000:2.0:1789265473.547522:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265473.547528:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417554304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265473.547559:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417554304:12345-0@lo:400:kworker.0 Request processed in 32us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265473.547565:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265473.547591:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417553920:0@lo:38:kworker.0 00000100:00100000:2.0:1789265473.547619:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265473.547641:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417554048:0@lo:8:kworker.0 00000400:00000100:2.0:1789265473.547660:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180417554048 offset 0 length 520: 4 00000100:00100000:2.0:1789265473.547671:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417554176:0@lo:8:kworker.0 00000400:00000100:2.0:1789265473.547708:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180417554176 offset 0 length 520: 4 00000100:00100000:2.0:1789265473.547735:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417553920 00000100:00100000:2.0:1789265473.547739:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417553920 00000100:00100000:2.0:1789265473.547759:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265473.547764:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1876180417553920:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789265473.547783:0:17197:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1789265473.555311:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fcb83f33b80 x1876180417554304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265473.555337:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417554304:0@lo:400:kworker.0 00000100:00100000:1.0:1789265473.555354:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a57aa04c-0472-45c4-bafc-6983957e249b:3643:1876180417553792:0@lo:400:kworker.0 00000100:00100000:2.0:1789265473.571334:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1876180417553920:12345-0@lo:38:kworker.0 Request processed in 23559us (23704us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789265473.571361:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789265473.572842:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb84943800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789265473.572853:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789265473.572874:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417553920:0@lo:38:kworker.0 00010000:00010000:1.0:1789265474.053245:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265474.562354:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccadb6a240 going to sleep for 0 seconds 00010000:00010000:1.0:1789265475.073361:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265475.585245:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccadb6a240 going to sleep for 0 seconds 00000040:00080000:0.0:1789265475.649688:0:17228:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789265476.106521:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265476.612624:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccadb6a240 going to sleep for 0 seconds 00010000:00010000:1.0:1789265477.127099:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789265477.284976:0:17925:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789265477.284981:0:17925:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789265477.284982:0:17925:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789265477.285687:0:17925:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fccaa073800 00000020:01000004:0.0:1789265477.285705:0:17925:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1789265477.285717:0:17925:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789265477.285730:0:17925:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9fccbf45b370) 00000020:00000080:0.0:1789265477.285759:0:17925:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789265477.353411:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789265477.354047:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1789265477.354481:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1789265477.356422:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789265477.361970:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789265477.362299:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789265477.363129:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789265477.363331:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789265477.363797:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1789265477.364069:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1789265477.364300:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789265477.364603:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789265477.364826:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1789265477.365066:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789265477.368733:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1789265477.368937:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789265477.369292:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789265477.370015:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789265477.374553:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1789265477.374945:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789265477.375181:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789265477.376668:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789265477.377663:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789265477.378068:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1789265477.378533:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1789265477.378818:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1789265477.379467:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1789265477.379819:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1789265477.380506:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1789265477.380922:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789265477.381189:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789265477.381461:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1789265477.381748:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1789265477.381933:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1789265477.382178:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1789265477.382489:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1789265477.382822:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1789265477.383010:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789265477.383293:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1789265477.383684:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1789265477.383899:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1789265477.384187:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789265477.384597:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789265477.384775:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1789265477.384947:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789265477.385486:0:17925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00080000:01000000:3.0:1789265477.386284:0:17925:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789265477.386500:0:17925:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789265477.386512:0:17925:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789265477.386523:0:17925:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9272d942b4a97824 00000020:01000004:3.0:1789265477.386529:0:17925:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789265477.386563:0:17925:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.149@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789265477.386567:0:17925:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.149@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789265477.386573:0:17925:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789265477.386597:0:17925:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789265477.386602:0:17925:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.149@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1789265477.392789:0:17925:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.149@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789265477.392841:0:17925:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.149@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1789265477.392846:0:17925:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789265477.392847:0:17925:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789265477.392849:0:17925:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265477.392850:0:17925:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265477.392851:0:17925:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265477.392852:0:17925:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265477.392854:0:17925:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789265477.392856:0:17925:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265477.392857:0:17925:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789265477.392861:0:17925:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1789265477.392863:0:17925:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789265477.392864:0:17925:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789265477.392865:0:17925:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265477.392866:0:17925:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265477.392867:0:17925:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265477.392868:0:17925:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265477.392869:0:17925:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789265477.392870:0:17925:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265477.392871:0:17925:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789265477.392900:0:17925:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789265477.392925:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417554432:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789265477.392993:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265477.393081:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb094ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265477.393415:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417554432 00000100:00100000:2.0:1789265477.393422:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417554432 00000100:00100000:2.0:1789265477.393524:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789265477.393534:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+12:17925:x1876180417554432:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789265477.393572:0:17187:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789265477.393576:0:17187:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1789265477.393583:0:17187:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1789265477.393940:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+12:17925:x1876180417554432:12345-0@lo:253:mount.lustre.0 Request processed in 407us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265477.393949:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789265477.394064:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417554432:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789265477.394074:0:17925:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789265477.394077:0:17925:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789265477.394079:0:17925:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789265477.394080:0:17925:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265477.394082:0:17925:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265477.394083:0:17925:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265477.394084:0:17925:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265477.394086:0:17925:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789265477.394087:0:17925:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265477.394088:0:17925:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789265477.394114:0:17925:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fccaa073800 from lustre-MDT0001 10000000:01000000:3.0:1789265477.394139:0:17925:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1789265477.394142:0:17925:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789265477.394149:0:17925:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fcb829f99b8 local copy 00010000:00010000:3.0:1789265477.394158:0:17925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53a00/0x9272d942b4a9771a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97721 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265477.394241:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417554560:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265477.394285:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265477.395063:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb094ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265477.395141:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417554560 00000100:00100000:1.0:1789265477.395147:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417554560 00000100:00100000:1.0:1789265477.395181:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789265477.395190:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+12:17925:x1876180417554560:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265477.395285:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+12:17925:x1876180417554560:12345-0@lo:501:mount.lustre.0 Request processed in 96us (999us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789265477.395293:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789265477.395534:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417554560:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789265477.395561:0:17925:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.149@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789265477.395583:0:17925:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.149@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789265477.395589:0:17925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53a00/0x9272d942b4a9771a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97721 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265477.395599:0:17925:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53a00/0x9272d942b4a9771a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97721 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265477.395624:0:17925:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fccaa073800 10000000:01000000:3.0:1789265477.395630:0:17925:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789265477.395635:0:17925:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9fcb829f99b8 10000000:01000000:3.0:1789265477.395638:0:17925:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789265477.395641:0:17925:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9fcb829f99b8 from 1 10000000:01000000:3.0:1789265477.395644:0:17925:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789265477.395669:0:17925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81491600/0x9272d942b4a9782b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265477.395678:0:17925:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc81491600/0x9272d942b4a9782b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265477.395698:0:17925:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc81491600/0x9272d942b4a9782b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265477.395714:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417554688:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789265477.395745:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265477.395769:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb094ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265477.395870:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417554688 00000100:00100000:1.0:1789265477.395874:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417554688 00000100:00100000:1.0:1789265477.395895:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789265477.395902:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+12:17925:x1876180417554688:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265477.395917:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265477.395931:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83f53600/0x9272d942b4a97832 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9782b expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265477.395952:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83f53600/0x9272d942b4a97832 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9782b expref: 13 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265477.395963:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83f53600/0x9272d942b4a97832 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9782b expref: 13 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265477.395972:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f53600, rc 0) 00000100:00100000:1.0:1789265477.396016:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+13:17925:x1876180417554688:12345-0@lo:101:mount.lustre.0 Request processed in 115us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265477.396044:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789265477.396134:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417554688:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265477.396146:0:17925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc81491600/0x9272d942b4a9782b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97832 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265477.396155:0:17925:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc81491600/0x9272d942b4a9782b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97832 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265477.396169:0:17925:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789265477.396175:0:17925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81491600/0x9272d942b4a9782b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97832 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265477.396181:0:17925:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc81491600/0x9272d942b4a9782b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97832 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265477.396187:0:17925:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fccaa073800 10000000:01000000:3.0:1789265477.396191:0:17925:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789265477.396194:0:17925:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fccaa073800 from 1 10000000:01000000:3.0:1789265477.396196:0:17925:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789265477.396209:0:17925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a97839 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265477.396215:0:17925:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a97839 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265477.396227:0:17925:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a97839 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265477.396239:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417554816:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789265477.396273:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265477.396291:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb094ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265477.396474:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417554816 00000100:00100000:1.0:1789265477.396479:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417554816 00000100:00100000:1.0:1789265477.396498:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789265477.396504:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8ade3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+13:17925:x1876180417554816:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265477.396511:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265477.396519:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83f52600/0x9272d942b4a97840 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a97839 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265477.396533:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83f52600/0x9272d942b4a97840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a97839 expref: 14 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265477.396552:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83f52600/0x9272d942b4a97840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a97839 expref: 14 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265477.396559:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f52600, rc 0) 00000100:00100000:1.0:1789265477.396600:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8ade3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+14:17925:x1876180417554816:12345-0@lo:101:mount.lustre.0 Request processed in 96us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265477.396606:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789265477.397197:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417554816:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265477.397212:0:17925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a97839 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97840 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265477.397222:0:17925:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a97839 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97840 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265477.397236:0:17925:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789265477.397252:0:17925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a97839 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97840 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265477.397260:0:17925:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a97839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97840 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265477.397267:0:17925:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789265477.397272:0:17925:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789265477.397277:0:17925:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fccaa073800 10000000:01000000:3.0:1789265477.397280:0:17925:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789265477.397283:0:17925:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1789265477.397285:0:17925:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789265477.397299:0:17925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81491e00/0x9272d942b4a97847 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265477.397312:0:17925:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc81491e00/0x9272d942b4a97847 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265477.397321:0:17925:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc81491e00/0x9272d942b4a97847 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265477.397335:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417554944:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789265477.397367:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265477.397617:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb094ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265477.397962:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417554944 00000100:00100000:1.0:1789265477.397969:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417554944 00000100:00100000:1.0:1789265477.398361:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789265477.398383:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+14:17925:x1876180417554944:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265477.398395:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265477.398408:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83f52000/0x9272d942b4a9784e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a97847 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265477.398429:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83f52000/0x9272d942b4a9784e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a97847 expref: 15 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265477.398439:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83f52000/0x9272d942b4a9784e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a97847 expref: 15 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265477.398447:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f52000, rc 0) 00000100:00100000:1.0:1789265477.398498:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+15:17925:x1876180417554944:12345-0@lo:101:mount.lustre.0 Request processed in 128us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265477.398504:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789265477.399615:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417554944:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265477.399636:0:17925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc81491e00/0x9272d942b4a97847 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9784e expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265477.399646:0:17925:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc81491e00/0x9272d942b4a97847 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9784e expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265477.401217:0:17925:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1789265477.403525:0:17925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265477.411960:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789265477.412080:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1789265477.412101:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1789265477.412114:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1789265477.412126:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1789265477.412138:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1789265477.412150:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1789265477.412161:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1789265477.412173:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1789265477.412185:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1789265477.412209:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1789265477.412222:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1789265477.412525:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1789265477.412615:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1789265477.412634:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1789265477.412647:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1789265477.412661:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1789265477.412674:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1789265477.412689:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1789265477.412702:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1789265477.412715:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1789265477.412727:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1789265477.412739:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1789265477.412766:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1789265477.412771:0:17925:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1789265477.412872:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417555072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265477.412938:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265477.412981:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb094ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265477.413061:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417555072 00000100:00100000:1.0:1789265477.413068:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417555072 00000100:00100000:1.0:1789265477.413260:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789265477.413271:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+15:17925:x1876180417555072:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265477.413566:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+15:17925:x1876180417555072:12345-0@lo:501:mount.lustre.0 Request processed in 296us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265477.413574:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789265477.413652:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417555072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265477.413683:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417555200:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265477.413722:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265477.413859:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb094ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265477.413889:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417555200 00000100:00100000:2.0:1789265477.413894:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417555200 00000100:00100000:2.0:1789265477.413917:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789265477.413924:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+15:17925:x1876180417555200:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265477.414832:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+15:17925:x1876180417555200:12345-0@lo:503:mount.lustre.0 Request processed in 905us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265477.414841:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789265477.414963:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417555200:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789265477.415822:0:17925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789265477.415907:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f33800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417555328:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265477.416686:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265477.416731:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b29000 going to sleep for 11 seconds 00000100:00100000:1.0:1789265477.416868:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417555328 00000100:00100000:1.0:1789265477.416876:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417555328 00000100:00100000:1.0:1789265477.416922:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789265477.416931:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+15:17925:x1876180417555328:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265477.417668:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+15:17925:x1876180417555328:12345-0@lo:502:mount.lustre.0 Request processed in 736us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265477.417678:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789265477.417827:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f33800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417555328:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265477.418086:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789265477.418119:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1789265477.418137:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1789265477.418153:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1789265477.418180:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1789265477.418192:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1789265477.418205:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1789265477.418218:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1789265477.418230:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1789265477.418317:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1789265477.418340:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1789265477.418352:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1789265477.418446:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1789265477.418464:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1789265477.418475:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1789265477.418488:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1789265477.418500:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1789265477.418511:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1789265477.418524:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1789265477.418537:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:2.0:1789265477.418812:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:2.0:1789265477.418831:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:2.0:1789265477.418843:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:2.0:1789265477.418855:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:2.0:1789265477.418865:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:2.0:1789265477.418876:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:2.0:1789265477.418886:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:2.0:1789265477.418899:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:2.0:1789265477.418911:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1789265477.418923:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1789265477.418935:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1789265477.418961:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1789265477.418976:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:2.0:1789265477.418989:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:2.0:1789265477.419014:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1789265477.419143:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1789265477.419160:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1789265477.419173:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1789265477.419186:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1789265477.419197:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1789265477.419209:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1789265477.419219:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1789265477.419229:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1789265477.419327:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1789265477.419612:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f31500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417555456:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265477.419689:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265477.419782:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b29cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265477.419911:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417555456 00000100:00100000:1.0:1789265477.419919:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417555456 00000100:00100000:1.0:1789265477.420009:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789265477.420019:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+15:17925:x1876180417555456:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265477.420156:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+15:17925:x1876180417555456:12345-0@lo:502:mount.lustre.0 Request processed in 137us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265477.420164:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789265477.420261:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f31500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417555456:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789265477.420315:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1789265477.420324:0:17925:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1789265477.421183:0:17929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265477.421194:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265477.421197:0:17929:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789265477.421202:0:17929:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1789265477.421205:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789265477.421219:0:17929:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9fccbc9c4d28) 00000020:00000080:2.0:1789265477.421237:0:17929:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1789265477.421252:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789265477.421330:0:17929:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789265477.421340:0:17929:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9272d942b4a9785c 00000020:00000080:2.0:1789265477.421671:0:17929:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789265477.421676:0:17929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265477.421679:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265477.421681:0:17929:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789265477.421684:0:17929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265477.421688:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265477.421689:0:17929:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1789265477.421692:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789265477.421700:0:17929:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9fccbc9c0000) 00000020:00000080:2.0:1789265477.421711:0:17929:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1789265477.421714:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789265477.421717:0:17929:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1789265477.421719:0:17929:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1789265477.421724:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789265477.421781:0:17929:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fccaa073800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1789265477.421794:0:17929:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9fccbc9c3370) 00000020:00000080:2.0:1789265477.421804:0:17929:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1789265477.421876:0:17929:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789265477.421883:0:17929:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9272d942b4a97871 00000020:00000080:2.0:1789265477.421973:0:17929:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1789265477.421980:0:17929:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789265477.421984:0:17929:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x9272d942b4a97878 00080000:01000000:2.0:1789265477.421990:0:17929:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789265477.421994:0:17929:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9272d942b4a9787f 00010000:00010000:2.0:1789265477.519419:0:17929:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1789265477.519830:0:17929:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:0.0:1789265477.520433:0:17929:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789265477.521536:0:17929:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1789265477.521661:0:17929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265477.521668:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265477.521670:0:17929:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1789265477.521674:0:17929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265477.521679:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265477.521680:0:17929:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1789265477.521683:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789265477.521689:0:17929:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.149@tcp to nid 0x20000c0a8cb95 (192.168.203.149@tcp) 00000020:00000080:0.0:1789265477.521716:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789265477.521732:0:17929:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9fcc837e99b8) 00000020:00000080:0.0:1789265477.521753:0:17929:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1789265477.521758:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789265477.521823:0:17929:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1789265477.521830:0:17929:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789265477.521836:0:17929:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9272d942b4a9788d 00010000:00080000:0.0:1789265477.521880:0:17929:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fccbc7ed000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.149@tcp at head 00010000:00010000:0.0:1789265477.530433:0:17929:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1789265477.543153:0:17929:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789265477.543169:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789265477.543210:0:17929:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789265477.543230:0:17929:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9272d942b4a97894 00000100:00080000:2.0:1789265477.543256:0:17929:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789265477.543262:0:17929:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9fccbc7ed000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265477.543294:0:17929:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83f31500 x1876180417555584/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789265477.543318:0:17929:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1789265477.543369:0:17929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265477.543373:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265477.543375:0:17929:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1789265477.543378:0:17929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789265477.543380:0:17929:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1789265477.543381:0:17929:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789265477.543383:0:17929:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789265477.543384:0:17929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789265477.543398:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265477.543399:0:17929:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789265477.543402:0:17929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265477.543418:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265477.543420:0:17929:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1789265477.543424:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789265477.543454:0:17929:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789265477.543468:0:17929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265477.543471:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265477.543472:0:17929:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1789265477.543475:0:17929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789265477.543477:0:17929:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1789265477.543478:0:17929:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789265477.543480:0:17929:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789265477.543481:0:17929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789265477.543484:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265477.543485:0:17929:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789265477.543487:0:17929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789265477.543490:0:17929:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789265477.543493:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265477.543495:0:17929:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789265477.543497:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789265477.543500:0:17929:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.149@tcp to nid 0x20000c0a8cb95 (192.168.203.149@tcp) 00000020:01000000:2.0:1789265477.543524:0:17929:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789265477.543527:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789265477.543757:0:17929:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9fcc8428b370) 00000020:00000080:2.0:1789265477.543772:0:17929:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1789265477.543778:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789265477.543834:0:17929:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1789265477.543841:0:17929:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789265477.543846:0:17929:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9272d942b4a978a2 00010000:00080000:2.0:1789265477.543875:0:17929:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fcb83c79800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.149@tcp at head 00010000:00010000:2.0:1789265477.544118:0:17929:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1789265477.544978:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417555584:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789265477.545084:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265477.545153:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417555584 00000100:00100000:3.0:1789265477.545161:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417555584 00000100:00100000:3.0:1789265477.545198:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265477.545206:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1876180417555584:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789265477.545232:0:17198:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:3.0:1789265477.545290:0:17198:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9272d942b4a978a9 00000004:00100000:3.0:1789265477.545305:0:17198:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789265477.545311:0:17198:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:2.0:1789265477.545897:0:17929:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00080000:0.0:1789265477.546112:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789265477.546118:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789265477.546122:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fcb84943800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265477.546135:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 524 00000100:00080000:0.0:1789265477.546140:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789265477.546145:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fcb84943800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:0.0:1789265477.546170:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fccbd3e4700 x1876180417555712/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789265477.546191:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265477.546195:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789265477.546197:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265477.546199:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789265477.546235:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417555840:0@lo:400:kworker.0 00000100:00100000:0.0:1789265477.546289:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265477.546338:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417555840 00000100:00100000:0.0:1789265477.546343:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417555840 00000100:00100000:0.0:1789265477.546376:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265477.546384:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417555840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265477.546429:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417555840:12345-0@lo:400:kworker.0 Request processed in 46us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265477.546436:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789265477.546473:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fccbd3e6a00 x1876180417555840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265477.546486:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417555840:0@lo:400:kworker.0 00000040:01000000:2.0:1789265477.546748:0:17929:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1789265477.547872:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417555712:0@lo:38:kworker.0 00000100:00100000:3.0:1789265477.547928:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265477.547977:0:17197:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1789265477.547992:0:17197:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1789265477.548148:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417555712 00000100:00100000:3.0:1789265477.548155:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417555712 00000100:00100000:3.0:1789265477.548379:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789265477.548386:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1876180417555712:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1789265477.548442:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1876180417555712:12345-0@lo:38:kworker.0 Request processed in 55us (514us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789265477.548449:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789265477.548479:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789265477.548486:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb84943800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789265477.548490:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789265477.548493:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417555712:0@lo:38:kworker.0 00000040:00080000:3.0:1789265477.550479:0:17929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1789265477.551098:0:17198:0:(import.c:65:import_set_state_nolock()) ffff9fcc992fa000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265477.551369:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1876180417555584:12345-0@lo:38:llog_process_th.0 Request processed in 6037us (6158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265477.551380:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:2.0:1789265477.551460:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789265477.551639:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000020:00000080:1.0:1789265477.552957:0:17929:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789265477.552970:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789265477.553047:0:17929:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789265477.553071:0:17929:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9272d942b4a978b0 00000100:00080000:1.0:1789265477.553079:0:17929:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789265477.553084:0:17929:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9fcb83c79800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:1.0:1789265477.553118:0:17929:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83e2f800 x1876180417555968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265477.553133:0:17929:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789265477.553190:0:17929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265477.553194:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265477.553196:0:17929:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789265477.553199:0:17929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789265477.553202:0:17929:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1789265477.553211:0:17929:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789265477.553213:0:17929:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789265477.553214:0:17929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789265477.553217:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265477.553218:0:17929:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789265477.553220:0:17929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789265477.553224:0:17929:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789265477.553227:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265477.553228:0:17929:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789265477.553231:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789265477.553234:0:17929:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.149@tcp to nid 0x20000c0a8cb95 (192.168.203.149@tcp) 00000020:01000000:1.0:1789265477.553385:0:17929:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789265477.553388:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789265477.553399:0:17929:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9fcb829fcd28) 00000020:00000080:1.0:1789265477.553411:0:17929:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1789265477.553416:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789265477.553477:0:17929:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1789265477.553483:0:17929:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789265477.553489:0:17929:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9272d942b4a978be 00010000:00080000:1.0:1789265477.553518:0:17929:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fccad90f000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.149@tcp at head 00010000:00010000:1.0:1789265477.553809:0:17929:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1789265477.553875:0:17929:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789265477.553889:0:17929:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1789265477.554059:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265477.554064:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265477.554067:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265477.554069:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1789265477.554800:0:17935:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789265477.554806:0:17935:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1789265477.556402:0:17929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265477.558442:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789265477.558658:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00100000:0.0:1789265477.558961:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789265477.558973:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789265477.558982:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789265477.558994:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789265477.559009:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccbc7ed000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789265477.559038:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417555584:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789265477.559108:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417556096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265477.559170:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265477.559229:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417556096 00000100:00100000:0.0:1789265477.559235:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417556096 00000100:00100000:1.0:1789265477.559422:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417555968:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789265477.559449:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180417555968 offset 0 length 520: 4 00000100:00100000:0.0:1789265477.559618:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265477.559627:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1876180417556096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789265477.559657:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789265477.559707:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1876180417556096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265477.559714:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265477.559881:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417556096:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1789265477.560421:0:17937:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789265477.560426:0:17937:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789265477.561217:0:17929:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789265477.561230:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789265477.561390:0:17929:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789265477.561413:0:17929:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9272d942b4a978c5 00000100:00080000:1.0:1789265477.561422:0:17929:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789265477.561428:0:17929:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fccad90f000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:1.0:1789265477.561459:0:17929:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83e2ca80 x1876180417556224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789265477.561509:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417556224:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789265477.561571:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180417556224 offset 0 length 520: 4 00000100:00080000:1.0:1789265477.561657:0:17929:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789265477.561717:0:17929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265477.561721:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265477.561723:0:17929:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789265477.561725:0:17929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265477.561729:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265477.561730:0:17929:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789265477.561732:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789265477.561734:0:17929:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789265477.561736:0:17929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265477.561738:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265477.561739:0:17929:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789265477.561741:0:17929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265477.561744:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265477.561745:0:17929:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789265477.561748:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789265477.561774:0:17929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265477.561785:0:17929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265477.561787:0:17929:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789265477.561790:0:17929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:1.0:1789265477.561846:0:17925:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1789265477.561875:0:17925:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789265477.561889:0:17925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81491e00/0x9272d942b4a97847 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9784e expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265477.561901:0:17925:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc81491e00/0x9272d942b4a97847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9784e expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265477.561910:0:17925:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fccaa073800 from 1 10000000:01000000:1.0:1789265477.561913:0:17925:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789265477.561937:0:17925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a978cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265477.561945:0:17925:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a978cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265477.561955:0:17925:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a978cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265477.561969:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417556352:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265477.562015:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265477.562061:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da0480 going to sleep for 11 seconds 00000100:00100000:2.0:1789265477.562258:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417556352 00000100:00100000:2.0:1789265477.562264:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417556352 00000100:00100000:2.0:1789265477.562309:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789265477.562318:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+15:17925:x1876180417556352:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265477.562329:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265477.562341:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a978d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a978cc expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.562362:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a978d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a978cc expref: 16 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.562372:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a978d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a978cc expref: 16 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.562381:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2f800, rc 0) 00000100:00100000:2.0:1789265477.562414:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+16:17925:x1876180417556352:12345-0@lo:101:mount.lustre.0 Request processed in 98us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265477.562420:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789265477.562720:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417556352:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265477.562733:0:17925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a978cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a978d3 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265477.562741:0:17925:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a978cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a978d3 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265477.563355:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417556480:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789265477.563397:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265477.563427:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da0480 going to sleep for 11 seconds 00000100:00080000:0.0:1789265477.563547:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265477.563552:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789265477.563555:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265477.563558:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789265477.563737:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417556480 00000100:00100000:2.0:1789265477.563744:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417556480 00000100:00100000:2.0:1789265477.563785:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789265477.563793:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+16:17925:x1876180417556480:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789265477.563809:0:17186:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789265477.563874:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789265477.563877:0:17186:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789265477.563971:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+16:17925:x1876180417556480:12345-0@lo:256:mount.lustre.0 Request processed in 179us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265477.563987:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789265477.564138:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417556480:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789265477.564948:0:17925:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789265477.564973:0:17925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a978cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a978d3 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265477.564984:0:17925:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a978cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a978d3 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265477.564993:0:17925:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fccaa073800 from 1 10000000:01000000:1.0:1789265477.564995:0:17925:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789265477.565145:0:17925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a978da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265477.565154:0:17925:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a978da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265477.565164:0:17925:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a978da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265477.565181:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417556608:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265477.565220:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265477.565422:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da0480 going to sleep for 11 seconds 00000100:00100000:0.0:1789265477.566851:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417556608 00000100:00100000:0.0:1789265477.566865:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417556608 00000100:00100000:2.0:1789265477.567007:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789265477.567017:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+16:17925:x1876180417556608:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265477.567162:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265477.567233:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc81490600/0x9272d942b4a978e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a978da expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265477.567367:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81490600/0x9272d942b4a978e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a978da expref: 17 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265477.567378:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc81490600/0x9272d942b4a978e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a978da expref: 17 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265477.567399:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81490600, rc 0) 00000100:00100000:3.0:1789265477.567470:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+17:17925:x1876180417556608:12345-0@lo:101:mount.lustre.0 Request processed in 455us (2249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265477.567477:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789265477.567672:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417556608:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265477.567699:0:17925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a978da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a978e1 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265477.567708:0:17925:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a978da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a978e1 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265477.567834:0:17925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789265477.567873:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417556736:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265477.567906:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265477.567983:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da0240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265477.568189:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417556736 00000100:00100000:0.0:1789265477.568194:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417556736 00000100:00100000:0.0:1789265477.568262:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789265477.568270:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+17:17925:x1876180417556736:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265477.568365:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+17:17925:x1876180417556736:12345-0@lo:501:mount.lustre.0 Request processed in 96us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265477.568385:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789265477.568552:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417556736:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265477.568603:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84846680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417556864:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265477.568638:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265477.568663:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb094e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265477.568748:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417556864 00000100:00100000:2.0:1789265477.568753:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417556864 00000100:00100000:2.0:1789265477.568785:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789265477.568792:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+17:17925:x1876180417556864:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265477.568883:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+17:17925:x1876180417556864:12345-0@lo:503:mount.lustre.0 Request processed in 91us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265477.568890:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789265477.569493:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84846680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417556864:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789265477.569858:0:17925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265477.569937:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84846680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417556992:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265477.569979:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265477.570015:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb094e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265477.570121:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417556992 00000100:00100000:2.0:1789265477.570127:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417556992 00000100:00100000:2.0:1789265477.570163:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789265477.570171:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+17:17925:x1876180417556992:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265477.570270:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+17:17925:x1876180417556992:12345-0@lo:502:mount.lustre.0 Request processed in 99us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265477.570276:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789265477.570558:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84846680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417556992:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789265477.570906:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789265477.570934:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1789265477.570948:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1789265477.570961:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1789265477.570973:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1789265477.570986:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1789265477.571176:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1789265477.571199:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1789265477.571213:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789265477.571227:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1789265477.571360:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1789265477.571395:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417557120:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265477.571446:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265477.571521:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0a7e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265477.571783:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417557120 00000100:00100000:2.0:1789265477.571789:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417557120 00000100:00100000:2.0:1789265477.571859:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789265477.571869:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+17:17925:x1876180417557120:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265477.571965:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+17:17925:x1876180417557120:12345-0@lo:502:mount.lustre.0 Request processed in 97us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265477.571972:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789265477.572065:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417557120:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789265477.572112:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1789265477.572120:0:17925:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789265477.573072:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265477.573083:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265477.573086:0:17939:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789265477.573094:0:17939:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fccaa073800 00000020:00000080:0.0:1789265477.573097:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789265477.573106:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265477.573109:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265477.573110:0:17939:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789265477.573113:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265477.573115:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265477.573122:0:17939:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789265477.573127:0:17939:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fccaa073800 00000020:00000080:0.0:1789265477.573130:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789265477.573184:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265477.573188:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265477.573190:0:17939:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789265477.573192:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265477.573195:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265477.573196:0:17939:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789265477.573200:0:17939:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fccaa073800 00000020:00000080:0.0:1789265477.573202:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789265477.573218:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265477.573221:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265477.573223:0:17939:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789265477.573225:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265477.573227:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265477.573229:0:17939:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789265477.573232:0:17939:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fccaa073800 00000020:00000080:0.0:1789265477.573234:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789265477.573272:0:17939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265477.573276:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265477.573277:0:17939:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789265477.573280:0:17939:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1789265477.577423:0:17925:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789265477.577480:0:17925:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789265477.577503:0:17925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a978da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a978e1 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265477.577515:0:17925:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a978da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a978e1 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265477.577576:0:17925:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789265477.577580:0:17925:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fccaa073800 10000000:01000000:0.0:1789265477.577589:0:17925:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fccaa073800 10000000:01000000:0.0:1789265477.577593:0:17925:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789265477.577599:0:17925:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fccaa073800 from 1 10000000:01000000:0.0:1789265477.577602:0:17925:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789265477.577637:0:17925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5600/0x9272d942b4a978e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265477.577645:0:17925:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5600/0x9272d942b4a978e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265477.577656:0:17925:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5600/0x9272d942b4a978e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265477.577678:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417557248:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789265477.577744:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265477.577788:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0a7e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265477.578374:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417557248 00000100:00100000:3.0:1789265477.578383:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417557248 00000100:00100000:3.0:1789265477.578436:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789265477.578446:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+17:17925:x1876180417557248:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265477.578459:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265477.578581:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc81490e00/0x9272d942b4a978ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a978e8 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265477.578609:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81490e00/0x9272d942b4a978ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a978e8 expref: 18 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265477.578621:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc81490e00/0x9272d942b4a978ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a978e8 expref: 18 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265477.578637:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81490e00, rc 0) 00000100:00100000:3.0:1789265477.578682:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+18:17925:x1876180417557248:12345-0@lo:101:mount.lustre.0 Request processed in 238us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265477.578688:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789265477.580459:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417557248:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789265477.580495:0:17925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5600/0x9272d942b4a978e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a978ef expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265477.580509:0:17925:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5600/0x9272d942b4a978e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a978ef expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265477.592438:0:17925:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1789265477.592771:0:17925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265477.592980:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1789265477.593059:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1789265477.593078:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1789265477.593095:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1789265477.593112:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1789265477.593127:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1789265477.593141:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1789265477.593160:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1789265477.593184:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1789265477.593202:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1789265477.593220:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1789265477.593240:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1789265477.593605:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1789265477.593620:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1789265477.593632:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1789265477.593644:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1789265477.593656:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1789265477.593682:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1789265477.593696:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1789265477.593717:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1789265477.593732:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1789265477.593743:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1789265477.593754:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1789265477.593765:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1789265477.593778:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1789265477.593789:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1789265477.593801:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1789265477.593813:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1789265477.593834:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1789265477.593840:0:17925:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1789265477.593936:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417557376:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265477.594014:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265477.594085:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacd3c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265477.595733:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417557376 00000100:00100000:2.0:1789265477.595745:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417557376 00000100:00100000:2.0:1789265477.596222:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789265477.596237:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+18:17925:x1876180417557376:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265477.596434:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+18:17925:x1876180417557376:12345-0@lo:501:mount.lustre.0 Request processed in 200us (2417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265477.599763:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417557376:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265477.599829:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417557504:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789265477.599910:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265477.599955:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417557504 00000100:00100000:0.0:1789265477.599961:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417557504 00000100:00100000:2.0:1789265477.600114:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789265477.603196:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0a7e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265477.605592:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789265477.605613:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+18:17925:x1876180417557504:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789265477.605791:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+18:17925:x1876180417557504:12345-0@lo:503:mount.lustre.0 Request processed in 185us (5880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265477.605799:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789265477.605944:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417557504:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789265477.607935:0:17925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265477.608041:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417557632:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265477.608165:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265477.608200:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417557632 00000100:00100000:3.0:1789265477.608206:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417557632 00000100:00100000:3.0:1789265477.608236:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789265477.608243:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+18:17925:x1876180417557632:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265477.608627:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+18:17925:x1876180417557632:12345-0@lo:502:mount.lustre.0 Request processed in 383us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265477.608635:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789265477.608680:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccae763180 going to sleep for 11 seconds 00000100:00100000:3.0:1789265477.608699:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417557632:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265477.608859:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1789265477.608883:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1789265477.608897:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1789265477.608909:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1789265477.608922:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1789265477.608947:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1789265477.608960:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1789265477.608971:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1789265477.608992:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1789265477.609019:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1789265477.609813:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1789265477.609837:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1789265477.609848:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1789265477.609858:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1789265477.609869:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1789265477.609881:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1789265477.609894:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1789265477.609906:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1789265477.609919:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1789265477.609932:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1789265477.609945:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1789265477.609970:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1789265477.609984:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1789265477.610007:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1789265477.610120:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1789265477.610136:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1789265477.610148:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1789265477.610159:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1789265477.610170:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1789265477.610182:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1789265477.610193:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1789265477.610204:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1789265477.610217:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1789265477.610230:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1789265477.610244:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1789265477.610267:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1789265477.610280:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1789265477.610938:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1789265477.610964:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1789265477.610978:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1789265477.610991:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1789265477.611064:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1789265477.611081:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1789265477.611094:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1789265477.611106:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1789265477.611119:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1789265477.611132:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1789265477.611144:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1789265477.611193:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417557760:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265477.611951:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265477.612012:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccae763180 going to sleep for 11 seconds 00000100:00100000:1.0:1789265477.612094:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417557760 00000100:00100000:1.0:1789265477.612102:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417557760 00000100:00100000:1.0:1789265477.613362:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789265477.613378:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+18:17925:x1876180417557760:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265477.613555:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+18:17925:x1876180417557760:12345-0@lo:502:mount.lustre.0 Request processed in 181us (1605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265477.613562:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789265477.613605:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417557760:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265477.613793:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1789265477.613820:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1789265477.613853:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417557888:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265477.613893:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265477.618764:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417557888 00000100:00100000:2.0:1789265477.618779:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417557888 00000100:00100000:2.0:1789265477.618850:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789265477.618859:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+18:17925:x1876180417557888:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265477.619053:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+18:17925:x1876180417557888:12345-0@lo:502:mount.lustre.0 Request processed in 194us (5159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265477.619062:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789265477.620768:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccae763180 going to sleep for 11 seconds 00000100:00100000:2.0:1789265477.620808:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417557888:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789265477.620910:0:17925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1789265477.620926:0:17925:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789265477.635602:0:17946:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1789265477.635620:0:17946:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9fccbd3799b8) 00000020:00000080:3.0:1789265477.635644:0:17946:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1789265477.635734:0:17946:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fccaa073800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789265477.635739:0:17946:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fccaa073800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789265477.635742:0:17946:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fccaa073800 3 00010000:00080000:3.0:1789265477.635772:0:17946:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fcc842c7800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.149@tcp at head 00000100:00100000:2.0:1789265477.635782:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccadb6a240 going to sleep for 0 seconds 00010000:00010000:3.0:1789265477.637931:0:17946:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1789265477.639141:0:17946:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1789265477.639191:0:17946:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789265477.639218:0:17946:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x9272d942b4a978fd 00000100:00080000:3.0:1789265477.639228:0:17946:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789265477.639234:0:17946:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9fcc842c7800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:3.0:1789265477.639275:0:17946:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb84847480 x1876180417558016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265477.639344:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876180417558016:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789265477.639424:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265477.639569:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417558016 00000100:00100000:2.0:1789265477.639576:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417558016 00000100:00100000:2.0:1789265477.639612:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265477.639619:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1876180417558016:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789265477.639641:0:17194:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:2.0:1789265477.639668:0:17194:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x9272d942b4a97904 00000004:00100000:2.0:1789265477.639681:0:17194:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789265477.639708:0:17194:0:(import.c:65:import_set_state_nolock()) ffff9fcc85809000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1789265477.639871:0:17946:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789265477.640466:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265477.640471:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789265477.640474:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265477.640477:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1789265477.643854:0:17946:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000100:00100000:2.0:1789265477.645962:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876180417558016:12345-0@lo:38:llog_process_th.0 Request processed in 6334us (6539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265477.645976:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789265477.647713:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fcb84847480 x1876180417558016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265477.647726:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789265477.647737:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789265477.647757:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789265477.647762:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789265477.647766:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcc842c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789265477.647774:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876180417558016:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1789265477.647820:0:17925:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789265477.647858:0:17925:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789265477.647881:0:17925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5600/0x9272d942b4a978e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a978ef expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265477.647891:0:17925:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5600/0x9272d942b4a978e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a978ef expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789265477.647942:0:17925:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789265477.647944:0:17925:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789265477.647945:0:17925:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265477.647947:0:17925:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265477.647948:0:17925:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265477.647950:0:17925:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265477.647951:0:17925:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789265477.647953:0:17925:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265477.647954:0:17925:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789265477.647958:0:17925:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1789265477.647960:0:17925:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789265477.647961:0:17925:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789265477.647963:0:17925:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265477.647964:0:17925:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265477.647965:0:17925:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265477.647966:0:17925:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265477.647967:0:17925:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789265477.647968:0:17925:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265477.647969:0:17925:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789265477.647990:0:17925:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789265477.648018:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417558144:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789265477.648099:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265477.648133:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacd3c780 going to sleep for 11 seconds 00000100:00100000:2.0:1789265477.648978:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417558144 00000100:00100000:2.0:1789265477.648987:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417558144 00000100:00100000:2.0:1789265477.649280:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789265477.649290:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+18:17925:x1876180417558144:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789265477.649315:0:17187:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789265477.649328:0:17187:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1789265477.654895:0:17172:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1789265477.656775:0:17187:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789265477.656795:0:17187:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1789265477.657045:0:17208:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789265477.657050:0:17208:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789265477.657138:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fcb83da4800/0x9272d942b4a9790b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265477.657158:0:17208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcb84a2e000/0x9272d942b4a9780f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a97808 expref: 18 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265477.657166:0:17208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a978d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a978cc expref: 18 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265477.657173:0:17208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fcb83da4800/0x9272d942b4a9790b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265477.657213:0:17208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a978d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a978cc expref: 18 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265477.657228:0:17208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a978d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a978cc expref: 18 pid: 17187 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265477.657526:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1876180417558272:0@lo:104: 00000100:00100000:0.0:1789265477.657590:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789265477.657691:0:17208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcb84a2e000/0x9272d942b4a9780f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a97808 expref: 18 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265477.657701:0:17208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcb84a2e000/0x9272d942b4a9780f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a97808 expref: 18 pid: 17186 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265477.657709:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1876180417558400:0@lo:104: 00000100:00100000:2.0:1789265477.657710:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+18:17925:x1876180417558144:12345-0@lo:253:mount.lustre.0 Request processed in 8420us (9610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265477.657720:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789265477.657729:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265477.661655:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417558272 00000100:00100000:2.0:1789265477.661668:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417558272 00000100:00100000:2.0:1789265477.661711:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417558400 00000100:00100000:2.0:1789265477.661714:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417558400 00000100:00100000:2.0:1789265477.661730:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265477.661739:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a57aa04c-0472-45c4-bafc-6983957e249b+4:17208:x1876180417558272:12345-0@lo:104: 00010000:00010000:2.0:1789265477.661756:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a978cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a978d3 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.661848:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265477.661854:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a57aa04c-0472-45c4-bafc-6983957e249b+4:17208:x1876180417558272:12345-0@lo:104: Request processed in 117us (4264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265477.661861:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265477.661878:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265477.661885:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a57aa04c-0472-45c4-bafc-6983957e249b+3:17208:x1876180417558400:12345-0@lo:104: 00010000:00010000:2.0:1789265477.661906:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a97808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9780f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.661944:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789265477.661950:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a57aa04c-0472-45c4-bafc-6983957e249b+3:17208:x1876180417558400:12345-0@lo:104: Request processed in 66us (4220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265477.661956:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789265477.662241:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265477.662257:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a978cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a978d3 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.662266:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f52c00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265477.662271:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a978cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a978d3 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.662280:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a978cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a978d3 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265477.662288:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a978cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a978d3 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265477.662294:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265477.662555:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a978cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a978d3 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.662563:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265477.662585:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a978cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a978d3 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.662591:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a978cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a978d3 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.662613:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265477.662617:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a97808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9780f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.662622:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f52e00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265477.662625:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a97808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a9780f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.662632:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a97808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a9780f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265477.662638:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a97808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a9780f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265477.662643:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265477.662659:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a97808 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9780f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.662664:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265477.662671:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a97808 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9780f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.662677:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a97808 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9780f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.662689:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265477.662691:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265477.662692:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265477.662708:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a57aa04c-0472-45c4-bafc-6983957e249b:3644:1876180417558656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265477.662752:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265477.662786:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265477.662791:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a57aa04c-0472-45c4-bafc-6983957e249b:3644:1876180417558528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265477.662807:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265477.662832:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417558656 00000100:00100000:2.0:1789265477.662835:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417558656 00010000:00010000:2.0:1789265477.662855:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcb84a2e000/0x9272d942b4a9780f lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a97808 expref: 18 pid: 17186 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265477.662874:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417558528 00000100:00100000:2.0:1789265477.662878:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417558528 00010000:00010000:2.0:1789265477.662887:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a978d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a978cc expref: 19 pid: 17187 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265477.662900:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265477.662906:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a57aa04c-0472-45c4-bafc-6983957e249b+19:3644:x1876180417558656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265477.662916:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265477.662920:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcb84a2e000/0x9272d942b4a9780f lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a97808 expref: 19 pid: 17186 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.662929:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcb84a2e000/0x9272d942b4a9780f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a97808 expref: 19 pid: 17186 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.662944:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265477.662971:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a57aa04c-0472-45c4-bafc-6983957e249b+19:3644:x1876180417558656:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265477.662977:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265477.662989:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265477.662994:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a57aa04c-0472-45c4-bafc-6983957e249b+18:3644:x1876180417558528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265477.663018:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265477.663043:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a978d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a978cc expref: 18 pid: 17187 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.663053:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a978d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a978cc expref: 18 pid: 17187 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.663075:0:17177:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fcb83da4800/0x9272d942b4a9790b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.663083:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83da4800/0x9272d942b4a9790b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789265477.663097:0:17177:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006048022s 00010000:00010000:2.0:1789265477.663102:0:17177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fcb83da4800/0x9272d942b4a9790b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.663109:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fcb83da4800/0x9272d942b4a9790b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.663116:0:17177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fcb83da4800/0x9272d942b4a9790b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.663123:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fcb83da4800/0x9272d942b4a9790b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.663129:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4800 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265477.663133:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fcb83da4800/0x9272d942b4a9790b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.663140:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fcb83da4800/0x9272d942b4a9790b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.663155:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fcb83da4800/0x9272d942b4a9790b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265477.663165:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265477.663191:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a57aa04c-0472-45c4-bafc-6983957e249b+18:3644:x1876180417558528:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265477.663197:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265477.663230:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a57aa04c-0472-45c4-bafc-6983957e249b:3644:1876180417558528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265477.663239:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a57aa04c-0472-45c4-bafc-6983957e249b:3644:1876180417558656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265477.663572:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:17925:1876180417558144:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789265477.663583:0:17925:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789265477.663586:0:17925:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789265477.663588:0:17925:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789265477.663589:0:17925:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265477.663590:0:17925:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265477.663592:0:17925:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265477.663593:0:17925:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265477.663595:0:17925:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789265477.663596:0:17925:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265477.663597:0:17925:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789265477.663608:0:17925:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1789265477.664332:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265477.665193:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0a7e6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789265477.665219:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a978d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a978cc expref: 17 pid: 17187 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265477.665234:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1876180417558272:0@lo:104: 00010000:00010000:0.0:1789265477.665246:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb84a2e000/0x9272d942b4a9780f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a97808 expref: 16 pid: 17186 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265477.665504:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1876180417558400:0@lo:104: 00010000:00010000:0.0:1789265477.665527:0:17208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fcb83da4800/0x9272d942b4a9790b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265477.665536:0:17208:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fcb83da4800/0x9272d942b4a9790b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265477.665542:0:17208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fcb83da4800/0x9272d942b4a9790b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265477.665567:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb83da4800/0x9272d942b4a9790b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:3.0:1789265477.673953:0:17925:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1789265477.674194:0:17951:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1789265477.674198:0:17951:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789265477.674287:0:17952:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789265477.674664:0:17925:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1789265477.674884:0:17952:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789265477.675216:0:17953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e4e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17953:1876180417558784:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789265477.675292:0:17953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265477.675492:0:17953:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc98ed5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265477.675568:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417558784 00000100:00100000:1.0:1789265477.675575:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417558784 00000100:00100000:1.0:1789265477.675625:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265477.675635:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17953:x1876180417558784:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789265477.675708:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17953:x1876180417558784:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 75us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265477.675715:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265477.675754:0:17953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e4e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17953:1876180417558784:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1789265477.675794:0:17953:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789265477.675823:0:17953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17953:1876180417558912:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789265477.675855:0:17953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265477.675879:0:17953:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacd3c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789265477.676138:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417558912 00000100:00100000:0.0:1789265477.676143:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417558912 00000100:00100000:0.0:1789265477.676168:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265477.676174:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17953:x1876180417558912:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789265477.676280:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17953:x1876180417558912:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 106us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265477.676286:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789265477.676322:0:17953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17953:1876180417558912:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789265477.676375:0:17953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17953:1876180417559040:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789265477.676403:0:17953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265477.676427:0:17953:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacd3c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265477.676571:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417559040 00000100:00100000:0.0:1789265477.676576:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417559040 00000100:00100000:0.0:1789265477.676612:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265477.676618:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17953:x1876180417559040:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789265477.676654:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17953:x1876180417559040:12345-0@lo:900:lod0001_rec0000.0 Request processed in 36us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265477.676660:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789265477.676768:0:17953:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fcb83e2ed80 x1876180417559040/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789265493 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265477.676780:0:17953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17953:1876180417559040:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789265477.676815:0:17953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17953:1876180417559168:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789265477.676840:0:17953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265477.676862:0:17953:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacd3c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789265477.677043:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417559168 00000100:00100000:0.0:1789265477.677048:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417559168 00000040:01000000:3.0:1789265477.677061:0:17925:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1789265477.677101:0:17925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789265477.677146:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789265477.677153:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17953:x1876180417559168:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789265477.677199:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17953:x1876180417559168:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 47us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265477.677210:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265477.677587:0:17953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17953:1876180417559168:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1789265477.677629:0:17953:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265477.680731:0:17953:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789265477.680815:0:17953:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1789265477.683104:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789265477.683191:0:17952:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789265477.683197:0:17952:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000004:00000080:3.0:1789265477.683819:0:17925:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789265477.683837:0:17925:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1789265477.683935:0:17925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265477.684965:0:17925:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789265477.685771:0:17925:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789265477.685810:0:17925:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1789265477.685985:0:17925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789265477.688866:0:17925:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:0.0:1789265477.695776:0:17925:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1789265477.707627:0:17925:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789265477.707666:0:17925:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbf45c1c63988 00100000:10000000:0.0:1789265477.707675:0:17925:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1789265477.708127:0:17925:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789265477.708159:0:17925:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.149@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789265477.708175:0:17925:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789265477.708191:0:17925:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1789265477.713774:0:17925:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789265477.713973:0:17925:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789265478.149396:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789265478.657873:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789265478.666837:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccadb6a240 going to sleep for 0 seconds 00010000:00010000:3.0:1789265479.169712:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789265479.361109:0:17189:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789265479.361117:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fccaa073800 from 8 10000000:01000000:0.0:1789265479.361123:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789265479.361171:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a97912 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.361182:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a97912 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.361193:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a97912 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265479.361220:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417559296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265479.361301:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265479.361347:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdb6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265479.361465:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417559296 00000100:00100000:3.0:1789265479.361473:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417559296 00000100:00100000:3.0:1789265479.361526:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789265479.361534:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+16:17189:x1876180417559296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265479.361548:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265479.361561:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc81490400/0x9272d942b4a97919 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a97912 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265479.361583:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81490400/0x9272d942b4a97919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a97912 expref: 17 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265479.361594:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc81490400/0x9272d942b4a97919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a97912 expref: 17 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265479.361603:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81490400, rc 0) 00000100:00100000:3.0:1789265479.361788:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+17:17189:x1876180417559296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 254us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265479.361812:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789265479.361882:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417559296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265479.361903:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a97912 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97919 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.361913:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a97912 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97919 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265479.361961:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417559424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789265479.362007:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265479.362068:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdb6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265479.362306:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417559424 00000100:00100000:2.0:1789265479.362312:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417559424 00000100:00100000:2.0:1789265479.362345:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789265479.362353:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+17:17189:x1876180417559424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789265479.362368:0:17187:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789265479.362383:0:17187:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789265479.362386:0:17187:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789265479.362470:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+17:17189:x1876180417559424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265479.362478:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789265479.362658:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417559424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789265479.362704:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789265479.362711:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a97912 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97919 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.362719:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a97912 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97919 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265479.362728:0:17189:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789265479.362730:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fcb83933000 from 8 10000000:01000000:0.0:1789265479.362733:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789265479.362751:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a97920 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.362757:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a97920 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.362764:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a97920 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265479.362786:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417559552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265479.362812:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265479.362833:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdb6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265479.362953:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417559552 00000100:00100000:3.0:1789265479.362958:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417559552 00000100:00100000:3.0:1789265479.363003:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789265479.363010:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+17:17189:x1876180417559552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265479.363018:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265479.363146:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc81490200/0x9272d942b4a97927 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a97920 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265479.363163:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81490200/0x9272d942b4a97927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a97920 expref: 18 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265479.363172:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc81490200/0x9272d942b4a97927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a97920 expref: 18 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265479.363179:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81490200, rc 0) 00000100:00100000:3.0:1789265479.363213:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+18:17189:x1876180417559552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265479.363218:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789265479.363327:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417559552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265479.363339:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a97920 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97927 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265479.363347:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a97920 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97927 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265479.363387:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417559680:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789265479.363414:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265479.363433:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdb6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265479.363485:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417559680 00000100:00100000:1.0:1789265479.363490:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417559680 00000100:00100000:1.0:1789265479.363525:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789265479.363532:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+18:17189:x1876180417559680:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789265479.363543:0:17186:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789265479.363554:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789265479.363557:0:17186:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789265479.363625:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+18:17189:x1876180417559680:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 93us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265479.363647:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789265479.363676:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417559680:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789265479.363712:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789265479.363718:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a97920 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97927 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265479.363725:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a97920 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97927 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265479.681106:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccadb6a240 going to sleep for 0 seconds 00000040:00080000:0.0:1789265479.685780:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789265480.193171:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265480.705434:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccadb6a240 going to sleep for 0 seconds 00010000:00010000:0.0:1789265481.217227:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265481.729325:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccadb6a240 going to sleep for 0 seconds 00000001:02000400:2.0:1789265482.190641:0:18196:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg349-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789265482.242277:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789265482.753484:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789265482.753490:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789265482.753494:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fcb84943800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789265482.753510:0:17249:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fcb84943800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:1.0:1789265482.753530:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83e2c700 x1876180417559936/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265482.753545:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265482.753548:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265482.753551:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265482.753554:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265482.753578:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265482.753581:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265482.753583:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265482.753586:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789265482.753638:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417560064:0@lo:400:kworker.0 00000100:00100000:1.0:1789265482.753696:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265482.753744:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265482.753748:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a57aa04c-0472-45c4-bafc-6983957e249b:3642:1876180417559808:0@lo:400:kworker.0 00000100:00100000:1.0:1789265482.753770:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265482.753795:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417560192:0@lo:400:kworker.0 00000100:00100000:1.0:1789265482.753816:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265482.753829:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265482.753833:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417560320:0@lo:400:kworker.0 00000100:00100000:1.0:1789265482.753857:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265482.753885:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417560064 00000100:00100000:1.0:1789265482.753892:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417560064 00000100:00100000:1.0:1789265482.753928:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417560320 00000100:00100000:1.0:1789265482.753931:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417560320 00000100:00100000:1.0:1789265482.753943:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265482.753950:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417560064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265482.754013:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417560064:12345-0@lo:400:kworker.0 Request processed in 63us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265482.754020:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265482.754071:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265482.754077:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417560320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265482.754280:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417560448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265482.754305:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265482.754329:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417560192 00000100:00100000:0.0:1789265482.754332:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417560192 00000100:00100000:0.0:1789265482.754354:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417560448 00000100:00100000:0.0:1789265482.754356:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417560448 00000100:00100000:0.0:1789265482.754366:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265482.754371:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1876180417560192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265482.754397:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1876180417560192:12345-0@lo:400:kworker.0 Request processed in 27us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265482.754403:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265482.754422:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265482.754427:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417560448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789265482.754446:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789265482.754473:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417560448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 46us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265482.754478:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265482.754520:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417560448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265482.754642:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417560320:12345-0@lo:400:kworker.0 Request processed in 31us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265482.754649:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265482.754667:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417559808 00000100:00100000:1.0:1789265482.754670:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417559808 00000100:00100000:1.0:1789265482.754700:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789265482.754705:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+18:3642:x1876180417559808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265482.754732:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+18:3642:x1876180417559808:12345-0@lo:400:kworker.0 Request processed in 27us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265482.754737:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789265482.754769:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a57aa04c-0472-45c4-bafc-6983957e249b:3642:1876180417559808:0@lo:400:kworker.0 00010000:00080000:1.0:1789265482.754779:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fcb83e2c000 x1876180417560064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265482.754789:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417560064:0@lo:400:kworker.0 00010000:00080000:1.0:1789265482.754822:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fcb83e2f100 x1876180417560320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265482.754831:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417560320:0@lo:400:kworker.0 00000100:00100000:1.0:1789265482.754840:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417560192:0@lo:400:kworker.0 00000100:00100000:3.0:1789265482.755002:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417559936:0@lo:38:kworker.0 00000100:00100000:3.0:1789265482.755059:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265482.756222:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417559936 00000100:00100000:1.0:1789265482.756231:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417559936 00000100:00100000:1.0:1789265482.756359:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265482.756366:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1876180417559936:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789265482.756391:0:17197:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:1.0:1789265482.756426:0:17197:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9272d942b4a9792e 00000004:00100000:1.0:1789265482.756451:0:17197:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789265482.756456:0:17197:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1789265482.757757:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccadb6a240 going to sleep for 0 seconds 00000100:00080000:1.0:1789265482.777798:0:17197:0:(import.c:65:import_set_state_nolock()) ffff9fcc82a8a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265482.777974:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1876180417559936:12345-0@lo:38:kworker.0 Request processed in 21596us (22902us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265482.777986:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1789265482.781331:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789265482.781347:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789265482.781353:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789265482.781357:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb84943800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789265482.781432:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000f88dd4d9): req@ffff9fcb84847800 x1876180417553024/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265482.781487:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417559936:0@lo:38:kworker.0 00000100:00100000:0.0:1789265482.782464:0:17234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265482.782502:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccadb6a240 going to sleep for 11 seconds 00000100:00100000:2.0:1789265482.782596:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417553024 00000100:00100000:2.0:1789265482.782604:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417553024 00000100:00100000:2.0:1789265482.782651:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789265482.782660:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17234:x1876180417553024:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789265482.782732:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17234:x1876180417553024:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 73us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265482.782739:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265482.782835:0:17234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17234:1876180417553024:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1789265482.782877:0:17234:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789265482.782916:0:17234:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e5500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17234:1876180417560576:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789265482.782943:0:17234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265482.782986:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdb6000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265482.783044:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417560576 00000100:00100000:2.0:1789265482.783049:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417560576 00000100:00100000:2.0:1789265482.783073:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789265482.783079:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17234:x1876180417560576:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789265482.783184:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17234:x1876180417560576:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 105us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265482.783206:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789265482.783232:0:17234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e5500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17234:1876180417560576:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789265482.783306:0:17234:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f33800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17234:1876180417560704:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789265482.783330:0:17234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265482.783343:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcca189dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265482.783353:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417560704 00000100:00100000:2.0:1789265482.783356:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417560704 00000100:00100000:2.0:1789265482.783371:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789265482.783376:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17234:x1876180417560704:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789265482.783415:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17234:x1876180417560704:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 39us (84us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265482.783421:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789265482.783455:0:17234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f33800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17234:1876180417560704:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1789265482.783495:0:17234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789265482.785623:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789265482.785716:0:17234:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:2.0:1789265482.785721:0:17234:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:0.0:1789265482.786651:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417560832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265482.786731:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265482.786846:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417560832 00000100:00100000:3.0:1789265482.786862:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417560832 00000100:00100000:3.0:1789265482.786914:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789265482.786923:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180417560832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789265482.786955:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789265482.787402:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180417560832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 478us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265482.787410:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789265482.787590:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417560832:0@lo:41:osp-pre-1-0.0 00000020:00000004:2.0:1789265482.954600:0:18248:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265482.954793:0:18248:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789265483.266535:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789265483.904428:0:18299:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265483.904673:0:18299:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789265484.289298:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789265485.145417:0:18347:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd90a67490 20000000:00000080:2.0:1789265485.145439:0:18347:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fcc842b1c00 uarg=0000000000000000 20000000:01000000:2.0:1789265485.145547:0:18347:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789265485.145554:0:18347:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789265485.145560:0:18347:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789265485.149724:0:18348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1789265485.150887:0:18347:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789265485.162237:0:18347:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789265485.162472:0:18347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fcc882b6400/0x9272d942b4a97935 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.162551:0:18347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcb83f52800/0x9272d942b4a977de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a977d7 expref: 17 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.162560:0:18347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc81490600/0x9272d942b4a978e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a978da expref: 17 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.162568:0:18347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fcc882b6400/0x9272d942b4a97935 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.162611:0:18347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc81490600/0x9272d942b4a978e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a978da expref: 17 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.162627:0:18347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcc81490600/0x9272d942b4a978e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a978da expref: 17 pid: 17184 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265485.162659:0:18347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18347:1876180417560960:0@lo:104: 00000100:00100000:3.0:1789265485.162792:0:18347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265485.162971:0:18347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcb83f52800/0x9272d942b4a977de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a977d7 expref: 17 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265485.162981:0:18347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcb83f52800/0x9272d942b4a977de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a977d7 expref: 17 pid: 17184 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265485.163000:0:18347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18347:1876180417561088:0@lo:104: 00000100:00100000:3.0:1789265485.163055:0:18347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265485.163620:0:18347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb094ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265485.163759:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417560960 00000100:00100000:1.0:1789265485.163769:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417560960 00000100:00100000:1.0:1789265485.163880:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417561088 00000100:00100000:1.0:1789265485.163884:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417561088 00000100:00100000:1.0:1789265485.163901:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265485.163909:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a57aa04c-0472-45c4-bafc-6983957e249b+4:18347:x1876180417560960:12345-0@lo:104: 00010000:00010000:1.0:1789265485.164237:0:17176:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a978da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a978e1 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.164335:0:17176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789265485.164342:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a57aa04c-0472-45c4-bafc-6983957e249b+4:18347:x1876180417560960:12345-0@lo:104: Request processed in 434us (1550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265485.164350:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265485.164368:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265485.164375:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a57aa04c-0472-45c4-bafc-6983957e249b+3:18347:x1876180417561088:12345-0@lo:104: 00010000:00010000:1.0:1789265485.164393:0:17176:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc81490000/0x9272d942b4a977d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a977de expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.164429:0:17176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789265485.164434:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a57aa04c-0472-45c4-bafc-6983957e249b+3:18347:x1876180417561088:12345-0@lo:104: Request processed in 60us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265485.164440:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789265485.164516:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265485.164523:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a978da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a978e1 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.164530:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f53400 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265485.164533:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a978da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a978e1 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.164541:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a978da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a978e1 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265485.164547:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a978da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a978e1 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265485.164553:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789265485.164583:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a978da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a978e1 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.164590:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265485.164609:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a978da lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a978e1 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.164615:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53400/0x9272d942b4a978da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a978e1 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.164628:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265485.164631:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc81490000/0x9272d942b4a977d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a977de expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.164648:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490000 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265485.164651:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81490000/0x9272d942b4a977d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a977de expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.164659:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc81490000/0x9272d942b4a977d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a977de expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265485.164665:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81490000/0x9272d942b4a977d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a977de expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265485.164670:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789265485.164698:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc81490000/0x9272d942b4a977d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a977de expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.164704:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265485.164710:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc81490000/0x9272d942b4a977d7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a977de expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.164717:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc81490000/0x9272d942b4a977d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a977de expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.164730:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265485.164732:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265485.164734:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265485.164752:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a57aa04c-0472-45c4-bafc-6983957e249b:3643:1876180417561216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265485.164786:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265485.164830:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265485.164836:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a57aa04c-0472-45c4-bafc-6983957e249b:3643:1876180417561344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265485.164865:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265485.164894:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417561216 00000100:00100000:2.0:1789265485.164899:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417561216 00010000:00010000:2.0:1789265485.164920:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc81490600/0x9272d942b4a978e1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a978da expref: 18 pid: 17184 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265485.164962:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417561344 00000100:00100000:2.0:1789265485.164965:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417561344 00010000:00010000:2.0:1789265485.164978:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcb83f52800/0x9272d942b4a977de lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a977d7 expref: 19 pid: 17184 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265485.165001:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265485.165007:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a57aa04c-0472-45c4-bafc-6983957e249b+19:3643:x1876180417561216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265485.165017:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265485.165042:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc81490600/0x9272d942b4a978e1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a978da expref: 19 pid: 17184 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.165053:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc81490600/0x9272d942b4a978e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a978da expref: 19 pid: 17184 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.165070:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265485.165099:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a57aa04c-0472-45c4-bafc-6983957e249b+19:3643:x1876180417561216:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265485.165106:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265485.165120:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789265485.165126:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a57aa04c-0472-45c4-bafc-6983957e249b+18:3643:x1876180417561344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265485.165133:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265485.165137:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcb83f52800/0x9272d942b4a977de lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a977d7 expref: 18 pid: 17184 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.165157:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcb83f52800/0x9272d942b4a977de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a977d7 expref: 18 pid: 17184 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.165170:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fcc882b6400/0x9272d942b4a97935 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.165177:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc882b6400/0x9272d942b4a97935 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.165189:0:17179:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fcc882b6400/0x9272d942b4a97935 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.165196:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fcc882b6400/0x9272d942b4a97935 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.165202:0:17179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fcc882b6400/0x9272d942b4a97935 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.165208:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fcc882b6400/0x9272d942b4a97935 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.165213:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6400 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265485.165217:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fcc882b6400/0x9272d942b4a97935 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.165224:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fcc882b6400/0x9272d942b4a97935 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.165232:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fcc882b6400/0x9272d942b4a97935 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265485.165252:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265485.165276:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a57aa04c-0472-45c4-bafc-6983957e249b+18:3643:x1876180417561344:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265485.165282:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789265485.165322:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a57aa04c-0472-45c4-bafc-6983957e249b:3643:1876180417561344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265485.165331:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a57aa04c-0472-45c4-bafc-6983957e249b:3643:1876180417561216:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265485.165603:0:18347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81490600/0x9272d942b4a978e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a978da expref: 17 pid: 17184 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265485.165615:0:18347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18347:1876180417560960:0@lo:104: 00010000:00010000:0.0:1789265485.165624:0:18347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb83f52800/0x9272d942b4a977de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a977d7 expref: 16 pid: 17184 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265485.165631:0:18347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18347:1876180417561088:0@lo:104: 00010000:00010000:0.0:1789265485.165655:0:18347:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fcc882b6400/0x9272d942b4a97935 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.165663:0:18347:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fcc882b6400/0x9272d942b4a97935 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.165669:0:18347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fcc882b6400/0x9272d942b4a97935 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265485.165674:0:18347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b6400/0x9272d942b4a97935 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265485.166212:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265485.315498:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789265485.894450:0:17228:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789265486.342236:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789265487.171790:0:17189:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789265487.171797:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fccaa073800 from 13 10000000:01000000:1.0:1789265487.171803:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789265487.171854:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a9793c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.171866:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a9793c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.171879:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a9793c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265487.171908:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417561472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789265487.172136:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265487.172182:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82da0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265487.172635:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417561472 00000100:00100000:0.0:1789265487.172646:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417561472 00000100:00100000:0.0:1789265487.172710:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789265487.172722:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+16:17189:x1876180417561472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265487.172736:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265487.172766:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83da5c00/0x9272d942b4a97943 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9793c expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.172794:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83da5c00/0x9272d942b4a97943 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9793c expref: 17 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.172805:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83da5c00/0x9272d942b4a97943 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9793c expref: 17 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.172815:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5c00, rc 0) 00000100:00100000:0.0:1789265487.172873:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+17:17189:x1876180417561472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265487.172880:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789265487.173014:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417561472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265487.173051:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a9793c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97943 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265487.173063:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a9793c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97943 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265487.173147:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417561600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265487.173180:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265487.173220:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83e9c480 going to sleep for 11 seconds 00000100:00100000:2.0:1789265487.173235:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417561600 00000100:00100000:2.0:1789265487.173239:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417561600 00000100:00100000:2.0:1789265487.173264:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789265487.173270:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+17:17189:x1876180417561600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265487.173367:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+17:17189:x1876180417561600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265487.173374:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789265487.176048:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417561600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265487.176103:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417561728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265487.176164:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265487.176200:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83e9c480 going to sleep for 11 seconds 00000100:00100000:2.0:1789265487.177267:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417561728 00000100:00100000:2.0:1789265487.177279:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417561728 00000100:00100000:2.0:1789265487.177338:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789265487.177349:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+17:17189:x1876180417561728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265487.177801:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+17:17189:x1876180417561728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 453us (1634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265487.177811:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789265487.177882:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417561728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789265487.180389:0:18421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789265487.182717:0:17189:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789265487.182743:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789265487.182754:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a9793c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97943 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.182765:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a9793c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97943 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265487.182776:0:17189:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789265487.182778:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fcb83933000 from 13 10000000:01000000:1.0:1789265487.182781:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789265487.182821:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a9794a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.182829:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a9794a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.182839:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a9794a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265487.182863:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417561856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789265487.187147:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265487.187197:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83b87840 going to sleep for 11 seconds 00000100:00100000:2.0:1789265487.187220:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417561856 00000100:00100000:2.0:1789265487.187230:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417561856 00000100:00100000:2.0:1789265487.187353:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789265487.187364:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+17:17189:x1876180417561856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265487.187381:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265487.187402:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb84a2fc00/0x9272d942b4a97951 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9794a expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265487.187427:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb84a2fc00/0x9272d942b4a97951 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9794a expref: 18 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265487.187436:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb84a2fc00/0x9272d942b4a97951 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9794a expref: 18 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265487.187458:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2fc00, rc 0) 00000100:00100000:2.0:1789265487.187515:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+18:17189:x1876180417561856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265487.187523:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789265487.187541:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417561856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265487.187558:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a9794a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97951 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.187578:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a9794a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97951 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265487.187657:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417561984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265487.187686:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265487.187822:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83b87840 going to sleep for 11 seconds 00000100:00100000:2.0:1789265487.189533:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417561984 00000100:00100000:2.0:1789265487.189546:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417561984 00000100:00100000:2.0:1789265487.189733:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789265487.189746:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+18:17189:x1876180417561984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265487.190486:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+18:17189:x1876180417561984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 741us (2796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265487.190495:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789265487.190610:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417561984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265487.190658:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417562112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265487.190704:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265487.190812:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83e9cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265487.190850:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417562112 00000100:00100000:1.0:1789265487.190855:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417562112 00000100:00100000:1.0:1789265487.191116:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789265487.191127:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+18:17189:x1876180417562112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265487.191244:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+18:17189:x1876180417562112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265487.191252:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789265487.191488:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417562112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789265487.192469:0:18422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789265487.192535:0:17189:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789265487.192556:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265487.192568:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a9794a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97951 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265487.192578:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a9794a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97951 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.361504:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265487.874208:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265477/real 1789265477] req@ffff9fcb83e2ca80 x1876180417556224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265487 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265487.874239:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb83e2ca80 x1876180417556224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265487 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265487.874246:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417562240:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265487.874253:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265477/real 1789265477] req@ffff9fcb83e2f800 x1876180417555968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265487 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265487.874268:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb83e2f800 x1876180417555968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265487 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789265487.874285:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccad90f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265487.874300:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789265487.874305:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417556224:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789265487.874312:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb83c79800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265487.874319:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789265487.874322:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417555968:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1789265487.874329:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265487.874384:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417562240 00000100:00100000:2.0:1789265487.874392:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417562240 00000100:00100000:2.0:1789265487.874442:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789265487.874453:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1876180417562240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789265487.874503:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789265487.876095:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417562496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265487.876154:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265487.876199:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417562496 00000100:00100000:3.0:1789265487.876205:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417562496 00000100:00100000:3.0:1789265487.876237:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789265487.876246:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417562496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265487.876271:0:17934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789265487.876316:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417562496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265487.876323:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789265487.876366:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417562496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265487.876923:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a57aa04c-0472-45c4-bafc-6983957e249b:3642:1876180417562368:0@lo:400:kworker.0 00000100:00100000:1.0:1789265487.876970:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265487.879000:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1876180417562240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4543us (4667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265487.879014:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789265487.879082:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417562368 00000100:00100000:2.0:1789265487.879090:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417562368 00000100:00100000:2.0:1789265487.879135:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789265487.879144:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+18:3642:x1876180417562368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265487.879210:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+18:3642:x1876180417562368:12345-0@lo:400:kworker.0 Request processed in 67us (2239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265487.879216:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789265487.879268:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a57aa04c-0472-45c4-bafc-6983957e249b:3642:1876180417562368:0@lo:400:kworker.0 00000100:00100000:1.0:1789265487.879485:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417562240:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1789265487.884665:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265487.884675:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789265487.884679:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265487.884683:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265487.884789:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265487.884793:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789265487.884797:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fcb83c79800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789265487.884804:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 528 00000100:00080000:1.0:1789265487.884810:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789265487.884818:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9fcb83c79800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:1.0:1789265487.884842:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83e2f800 x1876180417562752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265487.884873:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265487.884876:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789265487.884877:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fccad90f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789265487.884880:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 528 00000100:00080000:1.0:1789265487.884883:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789265487.884886:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fccad90f000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:1.0:1789265487.884897:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83e2ca80 x1876180417562880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265487.884946:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265487.884963:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417563008:0@lo:400:kworker.0 00000100:00100000:1.0:1789265487.885044:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265487.885085:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417563008 00000100:00100000:1.0:1789265487.885091:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417563008 00000100:00100000:1.0:1789265487.885133:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265487.885142:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417563008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265487.885189:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417563008:12345-0@lo:400:kworker.0 Request processed in 48us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265487.885196:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789265487.885233:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fcb83e2c000 x1876180417563008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265487.885246:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417563008:0@lo:400:kworker.0 00000100:00100000:3.0:1789265487.885314:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417562624:0@lo:400:kworker.0 00000100:00100000:3.0:1789265487.885349:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265487.887798:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417562752:0@lo:8:kworker.0 00000400:00000100:0.0:1789265487.887862:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180417562752 offset 0 length 520: 4 00000100:00100000:0.0:1789265487.887904:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417562880:0@lo:8:kworker.0 00000400:00000100:0.0:1789265487.887924:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180417562880 offset 0 length 520: 4 00000100:00100000:1.0:1789265487.893614:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417562624 00000100:00100000:1.0:1789265487.893629:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417562624 00000100:00100000:1.0:1789265487.893709:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265487.893718:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417562624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265487.893832:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417562624:12345-0@lo:400:kworker.0 Request processed in 115us (8481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265487.893840:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789265487.893940:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fcb83e2ed80 x1876180417562624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265487.893954:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417562624:0@lo:400:kworker.0 00010000:00010000:1.0:1789265488.385499:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265488.900134:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265473/real 1789265473] req@ffff9fcb83f32d80 x1876180417554048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265488 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265488.900164:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb83f32d80 x1876180417554048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265488 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265488.900175:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265473/real 1789265473] req@ffff9fcb83f31c00 x1876180417554176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265488 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265488.900208:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb83f31c00 x1876180417554176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265488 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789265488.900227:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccbf44b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789265488.900248:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789265488.900252:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417554048:0@lo:8:kworker.0 00000100:00080000:2.0:1789265488.900258:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb8391e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789265488.900263:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789265488.900266:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417554176:0@lo:8:kworker.0 00000100:00080000:2.0:1789265488.900359:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265488.900362:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789265488.900365:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fccbf44b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265488.900369:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 524 00000100:00080000:2.0:1789265488.900374:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789265488.900381:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fccbf44b800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:1.0:1789265488.900393:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a57aa04c-0472-45c4-bafc-6983957e249b:3642:1876180417563136:0@lo:400:kworker.0 00000100:00100000:2.0:1789265488.900403:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83f32a00 x1876180417563392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789265488.900417:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265488.900421:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789265488.900422:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fcb8391e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265488.900426:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 524 00000100:00080000:2.0:1789265488.900428:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789265488.900431:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fcb8391e800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265488.900444:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83f32300 x1876180417563520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265488.900466:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789265488.900479:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265488.900483:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265488.900486:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265488.900490:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789265488.900518:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417563264:0@lo:400:kworker.0 00000100:00100000:1.0:1789265488.900521:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417563904:0@lo:400:kworker.0 00000100:00100000:2.0:1789265488.900569:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265488.900573:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265488.900601:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265488.900602:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265488.900611:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417563648:0@lo:400:kworker.0 00000100:00100000:1.0:1789265488.900613:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417563776:0@lo:400:kworker.0 00000100:00100000:2.0:1789265488.900651:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265488.900657:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265488.900686:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417563392:0@lo:8:kworker.0 00000100:00100000:1.0:1789265488.900705:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417563136 00000400:00000100:2.0:1789265488.900707:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180417563392 offset 0 length 520: 4 00000100:00100000:1.0:1789265488.900715:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417563136 00000100:00100000:2.0:1789265488.900722:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417563520:0@lo:8:kworker.0 00000400:00000100:2.0:1789265488.900738:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180417563520 offset 0 length 520: 4 00000100:00100000:1.0:1789265488.900768:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789265488.900778:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+18:3642:x1876180417563136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265488.900779:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417563264 00000100:00100000:2.0:1789265488.900784:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417563264 00000100:00100000:2.0:1789265488.900810:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417563776 00000100:00100000:2.0:1789265488.900813:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417563776 00000100:00100000:2.0:1789265488.900826:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789265488.900833:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1876180417563264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265488.900878:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1876180417563264:12345-0@lo:400:kworker.0 Request processed in 45us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265488.900885:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789265488.900900:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789265488.900906:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417563776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265488.900964:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417563776:12345-0@lo:400:kworker.0 Request processed in 57us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265488.901994:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+18:3642:x1876180417563136:12345-0@lo:400:kworker.0 Request processed in 1214us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265488.902005:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789265488.902054:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417563904 00000100:00100000:1.0:1789265488.902059:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417563904 00000100:00100000:1.0:1789265488.902092:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417563648 00000100:00100000:1.0:1789265488.902095:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417563648 00000100:00100000:1.0:1789265488.902110:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265488.902117:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417563904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265488.902151:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417563904:12345-0@lo:400:kworker.0 Request processed in 35us (1584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265488.902168:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265488.902181:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789265488.902187:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417563648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265488.902220:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417563648:12345-0@lo:400:kworker.0 Request processed in 33us (1569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265488.902227:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789265488.902287:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417563776:0@lo:400:kworker.0 00010000:00080000:1.0:1789265488.902303:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fcb83f30000 x1876180417563904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265488.902313:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417563904:0@lo:400:kworker.0 00000100:00100000:1.0:1789265488.902321:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a57aa04c-0472-45c4-bafc-6983957e249b:3642:1876180417563136:0@lo:400:kworker.0 00000100:00100000:2.0:1789265488.902603:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1789265488.904571:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fcb83f31f80 x1876180417563648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265488.904590:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417563648:0@lo:400:kworker.0 00000100:00100000:2.0:1789265488.904608:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417563264:0@lo:400:kworker.0 00000001:00100000:1.0:1789265488.904766:0:17926:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1789265489.410166:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789265489.921950:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789265490.438580:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265491.457330:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789265492.201251:0:18695:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789265492.201256:0:18695:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789265492.201257:0:18695:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789265492.201360:0:18695:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fcc82d4d000 00000020:01000004:1.0:1789265492.201375:0:18695:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789265492.201388:0:18695:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789265492.201402:0:18695:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9fcb829f8000) 00000020:00000080:1.0:1789265492.201419:0:18695:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789265492.255637:0:18695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789265492.266576:0:18695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789265492.267643:0:18695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789265492.267917:0:18695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789265492.268550:0:18695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789265492.268831:0:18695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789265492.269426:0:18695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1789265492.271726:0:18695:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789265492.272923:0:18695:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789265492.272952:0:18695:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789265492.272969:0:18695:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9272d942b4a9795f 00000020:01000004:3.0:1789265492.272978:0:18695:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789265492.273000:0:18695:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.149@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789265492.273004:0:18695:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.149@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789265492.273010:0:18695:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789265492.273015:0:18695:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789265492.273053:0:18695:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9fccbd378000) 00000020:00000080:3.0:1789265492.273065:0:18695:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1789265492.276338:0:18695:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789265492.278598:0:18695:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789265492.278614:0:18695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789265492.283788:0:18695:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789265492.283801:0:18695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789265492.299912:0:18695:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789265492.299927:0:18695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789265492.304628:0:18695:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265492.304819:0:18695:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789265492.304830:0:18695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789265492.305740:0:18695:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789265492.305749:0:18695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789265492.343681:0:18695:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265492.343939:0:18695:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789265492.343945:0:18695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789265492.346886:0:18695:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789265492.346909:0:18695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789265492.347892:0:18695:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789265492.347910:0:18695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789265492.350884:0:18695:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265492.351115:0:18695:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789265492.351121:0:18695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789265492.352260:0:18695:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789265492.352270:0:18695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789265492.454543:0:18695:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789265492.454781:0:18695:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789265492.454786:0:18695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789265492.456908:0:18695:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789265492.456921:0:18695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789265492.458998:0:18695:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789265492.459069:0:18695:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1789265492.459075:0:18695:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.149@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00010000:00010000:1.0:1789265492.481470:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789265492.482951:0:18695:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.149@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789265492.482991:0:18695:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.149@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789265492.482995:0:18695:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789265492.482997:0:18695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789265492.482998:0:18695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265492.482999:0:18695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265492.483000:0:18695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265492.483002:0:18695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265492.483003:0:18695:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265492.483005:0:18695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265492.483006:0:18695:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789265492.483009:0:18695:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789265492.483011:0:18695:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789265492.483013:0:18695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789265492.483014:0:18695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265492.483015:0:18695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265492.483016:0:18695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265492.483017:0:18695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265492.483017:0:18695:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265492.483019:0:18695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265492.483019:0:18695:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789265492.485016:0:18695:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789265492.485065:0:18695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417564032:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789265492.485181:0:18695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265492.485233:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417564032 00000100:00100000:3.0:1789265492.485234:0:18695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccae7630c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265492.485242:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417564032 00000100:00100000:3.0:1789265492.485756:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789265492.485767:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc9b089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+18:18695:x1876180417564032:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789265492.485816:0:17187:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789265492.485819:0:17187:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789265492.485823:0:17187:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789265492.490830:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc9b089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+18:18695:x1876180417564032:12345-0@lo:253:mount.lustre.0 Request processed in 5055us (5639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265492.490862:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789265492.491845:0:18695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417564032:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789265492.491864:0:18695:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789265492.491867:0:18695:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789265492.491869:0:18695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789265492.491871:0:18695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265492.491884:0:18695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265492.491885:0:18695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265492.491886:0:18695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265492.491888:0:18695:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789265492.491890:0:18695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265492.491891:0:18695:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789265492.491923:0:18695:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fcc82d4d000 from lustre-OST0000 10000000:01000000:2.0:1789265492.491957:0:18695:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789265492.491959:0:18695:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789265492.491968:0:18695:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fcb829f99b8 local copy 00010000:00010000:2.0:1789265492.491981:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53a00/0x9272d942b4a9771a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97721 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265492.492129:0:18695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417564160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265492.492181:0:18695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265492.495425:0:18695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada67000 going to sleep for 11 seconds 00000100:00100000:1.0:1789265492.497312:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417564160 00000100:00100000:1.0:1789265492.497326:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417564160 00000100:00100000:2.0:1789265492.497649:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789265492.497658:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc9b08b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+18:18695:x1876180417564160:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265492.497863:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc9b08b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+18:18695:x1876180417564160:12345-0@lo:501:mount.lustre.0 Request processed in 205us (5682us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789265492.497871:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789265492.497975:0:18695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417564160:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789265492.497996:0:18695:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.149@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789265492.498060:0:18695:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.149@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789265492.498068:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53a00/0x9272d942b4a9771a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97721 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265492.498079:0:18695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53a00/0x9272d942b4a9771a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97721 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265492.498107:0:18695:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fcc82d4d000 10000000:01000000:1.0:1789265492.498111:0:18695:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789265492.498116:0:18695:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789265492.498119:0:18695:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789265492.498123:0:18695:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789265492.498126:0:18695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789265492.498164:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52200/0x9272d942b4a9796d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265492.498172:0:18695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52200/0x9272d942b4a9796d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265492.498181:0:18695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52200/0x9272d942b4a9796d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265492.498213:0:18695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417564288:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265492.498247:0:18695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265492.498273:0:18695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3e2180 going to sleep for 11 seconds 00000100:00100000:2.0:1789265492.498332:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417564288 00000100:00100000:2.0:1789265492.498337:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417564288 00000100:00100000:2.0:1789265492.498357:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789265492.498363:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc9b08b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+18:18695:x1876180417564288:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265492.498371:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265492.498382:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb84a2f000/0x9272d942b4a97974 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9796d expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.498402:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb84a2f000/0x9272d942b4a97974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9796d expref: 19 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.498419:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb84a2f000/0x9272d942b4a97974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9796d expref: 19 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.498427:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2f000, rc 0) 00000100:00100000:2.0:1789265492.498623:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc9b08b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+19:18695:x1876180417564288:12345-0@lo:101:mount.lustre.0 Request processed in 259us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265492.498629:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789265492.498783:0:18695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417564288:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265492.498795:0:18695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52200/0x9272d942b4a9796d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97974 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265492.498805:0:18695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52200/0x9272d942b4a9796d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97974 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265492.500154:0:18695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789265492.500844:0:18695:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265492.503244:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789265492.503293:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789265492.503308:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789265492.503323:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789265492.503337:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789265492.503351:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789265492.503372:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789265492.503376:0:18695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789265492.503558:0:18695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417564416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265492.503620:0:18695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265492.503655:0:18695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccadbf0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265492.503961:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417564416 00000100:00100000:3.0:1789265492.503968:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417564416 00000100:00100000:3.0:1789265492.504016:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789265492.504053:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+19:18695:x1876180417564416:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265492.504205:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+19:18695:x1876180417564416:12345-0@lo:501:mount.lustre.0 Request processed in 181us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265492.504213:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789265492.504505:0:18695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417564416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265492.504537:0:18695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417564544:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265492.504580:0:18695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265492.504602:0:18695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccadbf0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265492.504691:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417564544 00000100:00100000:3.0:1789265492.504695:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417564544 00000100:00100000:3.0:1789265492.504726:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789265492.504732:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+19:18695:x1876180417564544:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265492.505932:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+19:18695:x1876180417564544:12345-0@lo:503:mount.lustre.0 Request processed in 1197us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265492.505942:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789265492.506061:0:18695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417564544:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789265492.506865:0:18695:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789265492.506951:0:18695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417564672:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265492.507006:0:18695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265492.507077:0:18695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada67000 going to sleep for 11 seconds 00000100:00100000:0.0:1789265492.507218:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417564672 00000100:00100000:0.0:1789265492.507225:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417564672 00000100:00100000:0.0:1789265492.507271:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789265492.507287:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+19:18695:x1876180417564672:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265492.507876:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+19:18695:x1876180417564672:12345-0@lo:502:mount.lustre.0 Request processed in 588us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265492.507884:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789265492.507975:0:18695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417564672:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789265492.508205:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789265492.508236:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789265492.508249:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789265492.508261:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789265492.508276:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789265492.508309:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789265492.508324:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789265492.508337:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789265492.508351:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1789265492.508366:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1789265492.508378:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1789265492.508391:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1789265492.508418:0:18695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417564800:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265492.508477:0:18695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265492.508598:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417564800 00000100:00100000:3.0:1789265492.508603:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417564800 00000100:00100000:3.0:1789265492.508640:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789265492.508647:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+19:18695:x1876180417564800:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265492.508744:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+19:18695:x1876180417564800:12345-0@lo:502:mount.lustre.0 Request processed in 97us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265492.508751:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789265492.509019:0:18695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3e2180 going to sleep for 11 seconds 00000100:00100000:3.0:1789265492.509321:0:18695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417564800:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265492.509377:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789265492.509387:0:18695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1789265492.510474:0:18712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789265492.510483:0:18712:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1789265492.510490:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265492.510500:0:18712:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789265492.510506:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789265492.510521:0:18712:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9fcc842899b8) 00000020:00000080:2.0:1789265492.510543:0:18712:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789265492.510548:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789265492.510616:0:18712:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fcc82d4d000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789265492.510624:0:18712:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789265492.510631:0:18712:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9272d942b4a97982 00010000:00010000:2.0:1789265492.513503:0:18712:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1789265492.516838:0:18712:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:3.0:1789265492.521733:0:18712:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1789265492.525931:0:18712:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789265492.525944:0:18712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265492.525952:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265492.525955:0:18712:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789265492.525960:0:18712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789265492.525963:0:18712:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1789265492.525965:0:18712:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789265492.525979:0:18712:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789265492.525981:0:18712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789265492.525984:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265492.525985:0:18712:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789265492.525988:0:18712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265492.525990:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265492.525992:0:18712:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789265492.525995:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789265492.525997:0:18712:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789265492.525999:0:18712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265492.526002:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265492.526003:0:18712:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789265492.526005:0:18712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265492.526008:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265492.526009:0:18712:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789265492.526012:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789265492.526110:0:18712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265492.526114:0:18712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265492.526115:0:18712:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789265492.526119:0:18712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1789265492.528774:0:18695:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789265492.528817:0:18695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789265492.528838:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52200/0x9272d942b4a9796d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97974 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265492.528850:0:18695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52200/0x9272d942b4a9796d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97974 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265492.528859:0:18695:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fcc82d4d000 from 1 10000000:01000000:3.0:1789265492.528861:0:18695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789265492.528915:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7200/0x9272d942b4a97989 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265492.528924:0:18695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7200/0x9272d942b4a97989 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265492.528936:0:18695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7200/0x9272d942b4a97989 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265492.528961:0:18695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417564928:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789265492.529056:0:18695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265492.529095:0:18695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265492.530337:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417564928 00000100:00100000:0.0:1789265492.530351:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417564928 00000100:00100000:0.0:1789265492.530404:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789265492.530414:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+19:18695:x1876180417564928:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789265492.530429:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265492.530443:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83da4000/0x9272d942b4a97990 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a97989 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265492.530602:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83da4000/0x9272d942b4a97990 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a97989 expref: 20 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265492.530615:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83da4000/0x9272d942b4a97990 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a97989 expref: 20 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265492.530625:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da4000, rc 0) 00000100:00100000:0.0:1789265492.530689:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+20:18695:x1876180417564928:12345-0@lo:101:mount.lustre.0 Request processed in 276us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265492.530696:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789265492.530984:0:18695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417564928:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265492.531002:0:18695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7200/0x9272d942b4a97989 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97990 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265492.531012:0:18695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7200/0x9272d942b4a97989 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97990 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265492.533408:0:18695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789265492.534865:0:18695:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265492.535940:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789265492.535977:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789265492.536017:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789265492.536049:0:18695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789265492.536132:0:18695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417565056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265492.536192:0:18695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265492.536241:0:18695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d8540 going to sleep for 11 seconds 00000100:00100000:1.0:1789265492.536428:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417565056 00000100:00100000:1.0:1789265492.536446:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417565056 00000100:00100000:1.0:1789265492.536651:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789265492.536661:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+20:18695:x1876180417565056:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265492.536784:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+20:18695:x1876180417565056:12345-0@lo:501:mount.lustre.0 Request processed in 123us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265492.536792:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789265492.536872:0:18695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417565056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265492.536919:0:18695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417565184:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265492.536960:0:18695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265492.536987:0:18695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacd3c780 going to sleep for 11 seconds 00000100:00100000:3.0:1789265492.537131:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417565184 00000100:00100000:3.0:1789265492.537136:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417565184 00000100:00100000:3.0:1789265492.537170:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789265492.537176:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+20:18695:x1876180417565184:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265492.537352:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+20:18695:x1876180417565184:12345-0@lo:503:mount.lustre.0 Request processed in 174us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265492.537359:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789265492.537426:0:18695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417565184:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789265492.538059:0:18695:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789265492.538136:0:18695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417565312:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265492.538188:0:18695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265492.538222:0:18695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacd3c780 going to sleep for 11 seconds 00000100:00100000:1.0:1789265492.540363:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417565312 00000100:00100000:1.0:1789265492.540375:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417565312 00000100:00100000:1.0:1789265492.540424:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789265492.540432:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+20:18695:x1876180417565312:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265492.540687:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+20:18695:x1876180417565312:12345-0@lo:502:mount.lustre.0 Request processed in 255us (2498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265492.540701:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789265492.540931:0:18695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417565312:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789265492.541184:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789265492.541222:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789265492.541234:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789265492.541245:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789265492.541256:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789265492.541273:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789265492.541285:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789265492.541308:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1789265492.541320:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789265492.541331:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1789265492.541342:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1789265492.541371:0:18695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417565440:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265492.541412:0:18695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265492.541458:0:18695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacd3c780 going to sleep for 11 seconds 00000100:00100000:1.0:1789265492.541998:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417565440 00000100:00100000:1.0:1789265492.542005:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417565440 00000100:00100000:1.0:1789265492.542075:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789265492.542084:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+20:18695:x1876180417565440:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265492.542183:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+20:18695:x1876180417565440:12345-0@lo:502:mount.lustre.0 Request processed in 101us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265492.542191:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789265492.542381:0:18695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417565440:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789265492.542615:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1789265492.542630:0:18695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789265492.548983:0:18716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265492.548997:0:18716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265492.549000:0:18716:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789265492.549006:0:18716:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fcc82d4d000 00000020:00000080:2.0:1789265492.549009:0:18716:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789265492.549017:0:18716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265492.549053:0:18716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265492.549055:0:18716:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789265492.549059:0:18716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265492.549075:0:18716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265492.549076:0:18716:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789265492.549081:0:18716:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fcc82d4d000 00000020:00000080:2.0:1789265492.549083:0:18716:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789265492.549991:0:18716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265492.550165:0:18716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265492.550169:0:18716:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789265492.550174:0:18716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265492.550178:0:18716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265492.550179:0:18716:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789265492.550183:0:18716:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fcc82d4d000 00000020:00000080:3.0:1789265492.550186:0:18716:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789265492.560966:0:18716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265492.561071:0:18716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265492.561074:0:18716:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789265492.561080:0:18716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265492.561084:0:18716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265492.561092:0:18716:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789265492.561098:0:18716:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fcc82d4d000 00000020:00000080:3.0:1789265492.561100:0:18716:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789265492.561166:0:18716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265492.561170:0:18716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265492.561172:0:18716:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789265492.561175:0:18716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1789265492.561322:0:18695:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789265492.561354:0:18695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265492.561367:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7200/0x9272d942b4a97989 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97990 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265492.561379:0:18695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7200/0x9272d942b4a97989 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97990 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265492.561433:0:18695:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789265492.561436:0:18695:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fcc82d4d000 10000000:01000000:3.0:1789265492.564342:0:18695:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fcc82d4d000 10000000:01000000:3.0:1789265492.564353:0:18695:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789265492.564361:0:18695:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fcc82d4d000 from 1 10000000:01000000:3.0:1789265492.564364:0:18695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789265492.564406:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a97997 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265492.564419:0:18695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a97997 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265492.564430:0:18695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a97997 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265492.565319:0:18695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417565568:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789265492.565398:0:18695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265492.566096:0:18695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d8480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265492.567692:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417565568 00000100:00100000:3.0:1789265492.567705:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417565568 00000100:00100000:3.0:1789265492.567761:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789265492.567772:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+20:18695:x1876180417565568:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265492.567789:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265492.567807:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc882b7400/0x9272d942b4a9799e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a97997 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265492.567834:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc882b7400/0x9272d942b4a9799e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a97997 expref: 21 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265492.567846:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc882b7400/0x9272d942b4a9799e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a97997 expref: 21 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265492.567855:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b7400, rc 0) 00000100:00100000:3.0:1789265492.567934:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+21:18695:x1876180417565568:12345-0@lo:101:mount.lustre.0 Request processed in 164us (2535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265492.567940:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789265492.567996:0:18695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417565568:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265492.568012:0:18695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a97997 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9799e expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265492.568036:0:18695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a97997 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9799e expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265492.578010:0:18695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1789265492.578701:0:18695:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265492.578887:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789265492.578927:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789265492.578943:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789265492.578956:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789265492.578970:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789265492.578984:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789265492.579015:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789265492.579066:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789265492.579082:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789265492.579095:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789265492.579110:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789265492.579122:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789265492.579134:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789265492.579147:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789265492.579161:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789265492.579175:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789265492.579190:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789265492.581336:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789265492.581385:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789265492.581403:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789265492.581418:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789265492.581434:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789265492.581486:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789265492.582437:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789265492.582472:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1789265492.582487:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1789265492.582503:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1789265492.582515:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1789265492.582526:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1789265492.582539:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1789265492.582552:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1789265492.582565:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1789265492.582591:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1789265492.582607:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1789265492.582620:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1789265492.582631:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1789265492.582645:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1789265492.582673:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1789265492.582679:0:18695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1789265492.582779:0:18695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417565696:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265492.582844:0:18695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265492.582905:0:18695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d8600 going to sleep for 11 seconds 00000100:00100000:2.0:1789265492.583605:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417565696 00000100:00100000:2.0:1789265492.583614:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417565696 00000100:00100000:2.0:1789265492.583668:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789265492.583677:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+21:18695:x1876180417565696:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265492.583800:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+21:18695:x1876180417565696:12345-0@lo:501:mount.lustre.0 Request processed in 124us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265492.583807:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789265492.589016:0:18695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417565696:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265492.589095:0:18695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417565824:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265492.589169:0:18695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265492.589216:0:18695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d8600 going to sleep for 11 seconds 00000100:00100000:1.0:1789265492.590116:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417565824 00000100:00100000:1.0:1789265492.590125:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417565824 00000100:00100000:1.0:1789265492.590176:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789265492.590184:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+21:18695:x1876180417565824:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265492.590300:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+21:18695:x1876180417565824:12345-0@lo:503:mount.lustre.0 Request processed in 116us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265492.590308:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789265492.592001:0:18695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417565824:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789265492.592400:0:18695:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265492.592507:0:18695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417565952:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265492.592568:0:18695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265492.592603:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417565952 00000100:00100000:3.0:1789265492.592608:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417565952 00000100:00100000:3.0:1789265492.592645:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789265492.592654:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8a56e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+21:18695:x1876180417565952:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265492.592739:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8a56e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+21:18695:x1876180417565952:12345-0@lo:502:mount.lustre.0 Request processed in 85us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265492.592746:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789265492.592787:0:18695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d8480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265492.592804:0:18695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417565952:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265492.592967:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789265492.592992:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789265492.593006:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789265492.593018:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789265492.593053:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789265492.593065:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789265492.593077:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789265492.593088:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789265492.593101:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789265492.593113:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789265492.593125:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789265492.593137:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789265492.593148:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789265492.593161:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789265492.593185:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789265492.593198:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789265492.593210:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789265492.593222:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789265492.593233:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789265492.593245:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789265492.593257:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789265492.593269:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789265492.593281:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789265492.593293:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789265492.593309:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1789265492.593321:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1789265492.593333:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1789265492.593344:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1789265492.593356:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1789265492.593368:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1789265492.593389:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1789265492.593407:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1789265492.593418:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1789265492.593430:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1789265492.593442:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1789265492.593454:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1789265492.593466:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1789265492.593477:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1789265492.593490:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1789265492.593501:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1789265492.593513:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1789265492.593525:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1789265492.593536:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1789265492.593548:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1789265492.593559:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1789265492.593571:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1789265492.593592:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1789265492.593605:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1789265492.593639:0:18695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417566080:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265492.593680:0:18695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265492.593711:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417566080 00000100:00100000:3.0:1789265492.593715:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417566080 00000100:00100000:3.0:1789265492.593742:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789265492.593749:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8a56e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+21:18695:x1876180417566080:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265492.593816:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8a56e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+21:18695:x1876180417566080:12345-0@lo:502:mount.lustre.0 Request processed in 67us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265492.593823:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789265492.593856:0:18695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d8480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265492.593870:0:18695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417566080:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265492.594006:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1789265492.594053:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1789265492.594074:0:18695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417566208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265492.594106:0:18695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265492.594128:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417566208 00000100:00100000:3.0:1789265492.594132:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417566208 00000100:00100000:3.0:1789265492.594152:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789265492.594158:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+21:18695:x1876180417566208:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265492.594213:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+21:18695:x1876180417566208:12345-0@lo:502:mount.lustre.0 Request processed in 54us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265492.594220:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789265492.594249:0:18695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d8480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265492.594262:0:18695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417566208:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265492.594294:0:18695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1789265492.594303:0:18695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789265492.597794:0:18721:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789265492.597811:0:18721:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9fccb09b0000) 00000020:00000080:3.0:1789265492.597835:0:18721:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1789265492.599009:0:18721:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fcc82d4d000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789265492.599017:0:18721:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fcc82d4d000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789265492.599048:0:18721:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fcc82d4d000 3 00010000:00080000:3.0:1789265492.599085:0:18721:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fcc85928800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.149@tcp at head 00010000:00010000:3.0:1789265492.600662:0:18721:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1789265492.600874:0:18721:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789265492.600926:0:18721:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789265492.600937:0:18721:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9272d942b4a979ac 00000100:00080000:3.0:1789265492.600947:0:18721:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789265492.600952:0:18721:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fcc85928800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:3.0:1789265492.600985:0:18721:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb84845180 x1876180417566336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265492.601011:0:18721:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789265492.601293:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265492.601298:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265492.601300:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265492.601303:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265492.601329:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265492.601332:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265492.601334:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265492.601337:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789265492.601578:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417566720:0@lo:400:kworker.0 00000100:00100000:1.0:1789265492.601645:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265492.601678:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265492.601683:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417566848:0@lo:400:kworker.0 00000100:00100000:1.0:1789265492.601705:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265492.601752:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417566720 00000100:00100000:1.0:1789265492.601758:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417566720 00000100:00100000:1.0:1789265492.601794:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789265492.601802:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417566720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265492.601850:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417566720:12345-0@lo:400:kworker.0 Request processed in 49us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265492.601857:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789265492.601878:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417566848 00000100:00100000:1.0:1789265492.601881:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417566848 00000100:00100000:1.0:1789265492.601913:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265492.601919:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417566848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265492.601947:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417566848:12345-0@lo:400:kworker.0 Request processed in 28us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265492.601953:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789265492.601986:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fcb83f32d80 x1876180417566848/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265492.602000:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417566848:0@lo:400:kworker.0 00000100:00100000:1.0:1789265492.602011:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417566720:0@lo:400:kworker.0 00000100:00100000:2.0:1789265492.603569:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1876180417566336:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789265492.603621:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265492.603675:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417566592:0@lo:400:kworker.0 00000100:00100000:2.0:1789265492.603696:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265492.603714:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265492.603721:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417566464:0@lo:400:kworker.0 00000100:00100000:2.0:1789265492.603741:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265492.603767:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417566336 00000100:00100000:2.0:1789265492.603772:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417566336 00000100:00100000:2.0:1789265492.603791:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417566592 00000100:00100000:2.0:1789265492.603794:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417566592 00000100:00100000:2.0:1789265492.603813:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789265492.603819:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417566592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265492.603858:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417566592:12345-0@lo:400:kworker.0 Request processed in 39us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265492.603866:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789265492.603886:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265492.603890:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1876180417566336:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789265492.603925:0:17192:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:2.0:1789265492.603958:0:17192:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9272d942b4a979b3 00000004:00100000:2.0:1789265492.603974:0:17192:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789265492.604002:0:17192:0:(import.c:65:import_set_state_nolock()) ffff9fcca93b1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265492.604052:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876180417566336:12345-0@lo:38:llog_process_th.0 Request processed in 160us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265492.604059:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265492.604080:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417566464 00000100:00100000:2.0:1789265492.604083:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417566464 00000100:00100000:2.0:1789265492.604102:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789265492.604108:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417566464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265492.604136:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417566464:12345-0@lo:400:kworker.0 Request processed in 28us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265492.604141:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789265492.604171:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417566464:0@lo:400:kworker.0 00010000:00080000:2.0:1789265492.604181:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fcb83e2c700 x1876180417566592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265492.604191:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417566592:0@lo:400:kworker.0 00010000:00080000:2.0:1789265492.604213:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fcb84845180 x1876180417566336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265492.604221:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789265492.604227:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1789265492.604234:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789265492.604244:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789265492.604246:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcc85928800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789265492.604252:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1876180417566336:0@lo:38:llog_process_th.0 00000020:01000004:2.0:1789265492.605712:0:18721:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789265492.605727:0:18721:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9fcc8428cd28) 00000020:00000080:2.0:1789265492.605749:0:18721:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1789265492.605841:0:18721:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fcc82d4d000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789265492.605845:0:18721:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fcc82d4d000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789265492.605848:0:18721:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fcc82d4d000 3 00010000:00080000:2.0:1789265492.605873:0:18721:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fcc992fc800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.149@tcp at head 00010000:00010000:2.0:1789265492.610279:0:18721:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1789265492.614099:0:18721:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1789265492.614147:0:18721:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789265492.614161:0:18721:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x9272d942b4a979c1 00000100:00080000:2.0:1789265492.614171:0:18721:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789265492.614177:0:18721:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9fcc992fc800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265492.614212:0:18721:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83da9880 x1876180417566976/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265492.614253:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1876180417566976:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789265492.614320:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789265492.614377:0:18721:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789265492.621149:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417566976 00000100:00100000:3.0:1789265492.621165:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417566976 00000100:00100000:3.0:1789265492.621216:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789265492.621225:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1876180417566976:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789265492.621257:0:17192:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:3.0:1789265492.621293:0:17192:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x9272d942b4a979c8 00000004:00100000:3.0:1789265492.621310:0:17192:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789265492.621342:0:17192:0:(import.c:65:import_set_state_nolock()) ffff9fcc842c4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265492.621427:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876180417566976:12345-0@lo:38:llog_process_th.0 Request processed in 202us (7106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265492.621436:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789265492.621531:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265492.621536:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265492.621551:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265492.621554:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265492.621558:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265492.621560:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265492.621562:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265492.621565:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:2.0:1789265492.623306:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fcb83da9880 x1876180417566976/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265492.623322:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789265492.623331:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1789265492.623339:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789265492.623355:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789265492.623358:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcc992fc800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789265492.623366:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1876180417566976:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789265492.624182:0:18721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1789265492.624754:0:18695:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789265492.624784:0:18695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789265492.624808:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a97997 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9799e expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265492.624821:0:18695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a97997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9799e expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789265492.624878:0:18695:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789265492.624880:0:18695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789265492.624881:0:18695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265492.624883:0:18695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265492.624884:0:18695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265492.624886:0:18695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265492.624887:0:18695:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265492.624889:0:18695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265492.624890:0:18695:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789265492.624894:0:18695:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1789265492.624905:0:18695:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789265492.624907:0:18695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789265492.624908:0:18695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265492.624909:0:18695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265492.624910:0:18695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265492.624911:0:18695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265492.624912:0:18695:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265492.624913:0:18695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265492.624914:0:18695:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789265492.624939:0:18695:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789265492.624959:0:18695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417567104:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789265492.625046:0:18695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265492.625086:0:18695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265492.628659:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417567104 00000100:00100000:3.0:1789265492.628672:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417567104 00000100:00100000:3.0:1789265492.629165:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789265492.629177:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+21:18695:x1876180417567104:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789265492.629211:0:17187:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789265492.629224:0:17187:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789265492.632580:0:17187:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789265492.632629:0:17187:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789265492.633068:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+21:18695:x1876180417567104:12345-0@lo:253:mount.lustre.0 Request processed in 3889us (8017us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265492.633081:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789265492.633253:0:18695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:18695:1876180417567104:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789265492.633267:0:18695:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789265492.633271:0:18695:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789265492.633272:0:18695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789265492.633274:0:18695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265492.633275:0:18695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265492.633276:0:18695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265492.633278:0:18695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265492.633279:0:18695:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265492.633281:0:18695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265492.633282:0:18695:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789265492.633296:0:18695:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1789265492.635515:0:17208:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789265492.635525:0:17208:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789265492.635546:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fcb83da4e00/0x9272d942b4a979cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265492.635565:0:17208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc81490400/0x9272d942b4a97919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a97912 expref: 20 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265492.635574:0:17208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc81490200/0x9272d942b4a97927 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a97920 expref: 20 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265492.635597:0:17208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fcb83da4e00/0x9272d942b4a979cf lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265492.635637:0:17208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc81490200/0x9272d942b4a97927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a97920 expref: 20 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265492.635655:0:17208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcc81490200/0x9272d942b4a97927 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a97920 expref: 20 pid: 17184 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265492.635671:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1876180417567232:0@lo:104: 00000100:00100000:0.0:1789265492.635742:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789265492.635809:0:17208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc81490400/0x9272d942b4a97919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a97912 expref: 20 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265492.635818:0:17208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcc81490400/0x9272d942b4a97919 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a97912 expref: 20 pid: 17184 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265492.635827:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1876180417567360:0@lo:104: 00000100:00100000:0.0:1789265492.635853:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265492.635880:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7d480 going to sleep for 11 seconds 00000100:00100000:2.0:1789265492.635951:0:17175:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789265492.635983:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417567232 00000100:00100000:2.0:1789265492.635991:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417567232 00000100:00100000:2.0:1789265492.636050:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417567360 00000100:00100000:2.0:1789265492.636054:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417567360 00000100:00100000:2.0:1789265492.636071:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265492.636079:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a57aa04c-0472-45c4-bafc-6983957e249b+4:17208:x1876180417567232:12345-0@lo:104: 00010000:00010000:2.0:1789265492.636093:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a97920 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a97927 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.636148:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265492.636155:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a57aa04c-0472-45c4-bafc-6983957e249b+4:17208:x1876180417567232:12345-0@lo:104: Request processed in 77us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265492.636161:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265492.636178:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265492.636184:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e32850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a57aa04c-0472-45c4-bafc-6983957e249b+3:17208:x1876180417567360:12345-0@lo:104: 00010000:00010000:2.0:1789265492.636192:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a97912 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a97919 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.636237:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789265492.636242:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e32850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a57aa04c-0472-45c4-bafc-6983957e249b+3:17208:x1876180417567360:12345-0@lo:104: Request processed in 59us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265492.636248:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789265492.636292:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265492.636307:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a97920 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a97927 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.636314:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5400 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265492.636318:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a97920 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a97927 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.636326:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a97920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a97927 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265492.636334:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a97920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a97927 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265492.636339:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265492.636368:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a97920 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a97927 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.636375:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265492.636396:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a97920 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a97927 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.636403:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a97920 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a97927 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.636416:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265492.636420:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a97912 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a97919 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.636425:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5e00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265492.636428:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a97912 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a97919 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.636445:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a97912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a97919 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265492.636571:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a97912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a97919 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265492.636576:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265492.636593:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a97912 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a97919 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.636600:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265492.636607:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a97912 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a97919 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.636614:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a97912 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a97919 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.636628:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265492.636630:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265492.636631:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265492.636644:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a57aa04c-0472-45c4-bafc-6983957e249b:3643:1876180417567488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265492.636678:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265492.636702:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265492.636708:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a57aa04c-0472-45c4-bafc-6983957e249b:3643:1876180417567616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265492.636731:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265492.636772:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417567488 00000100:00100000:2.0:1789265492.636777:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417567488 00010000:00010000:2.0:1789265492.636793:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc81490200/0x9272d942b4a97927 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a97920 expref: 21 pid: 17184 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265492.636826:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417567616 00000100:00100000:2.0:1789265492.636830:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417567616 00010000:00010000:2.0:1789265492.636849:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc81490400/0x9272d942b4a97919 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a97912 expref: 22 pid: 17184 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265492.636862:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265492.636869:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a57aa04c-0472-45c4-bafc-6983957e249b+22:3643:x1876180417567488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265492.636879:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265492.636883:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc81490200/0x9272d942b4a97927 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a97920 expref: 22 pid: 17184 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.636892:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc81490200/0x9272d942b4a97927 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a97920 expref: 22 pid: 17184 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.636918:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265492.636949:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a57aa04c-0472-45c4-bafc-6983957e249b+22:3643:x1876180417567488:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265492.636956:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265492.636969:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265492.636975:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821ae450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a57aa04c-0472-45c4-bafc-6983957e249b+21:3643:x1876180417567616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265492.636982:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265492.636986:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc81490400/0x9272d942b4a97919 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a97912 expref: 21 pid: 17184 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.636994:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc81490400/0x9272d942b4a97919 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a97912 expref: 21 pid: 17184 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.637006:0:17178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fcb83da4e00/0x9272d942b4a979cf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.637042:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83da4e00/0x9272d942b4a979cf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789265492.637057:0:17178:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006048022s 00010000:00010000:2.0:1789265492.637062:0:17178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fcb83da4e00/0x9272d942b4a979cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.637069:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fcb83da4e00/0x9272d942b4a979cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.637076:0:17178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fcb83da4e00/0x9272d942b4a979cf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.637083:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fcb83da4e00/0x9272d942b4a979cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.637088:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4e00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265492.637092:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fcb83da4e00/0x9272d942b4a979cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.637099:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fcb83da4e00/0x9272d942b4a979cf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.637108:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fcb83da4e00/0x9272d942b4a979cf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265492.637118:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265492.637144:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821ae450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a57aa04c-0472-45c4-bafc-6983957e249b+21:3643:x1876180417567616:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265492.637150:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789265492.638446:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81490200/0x9272d942b4a97927 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a97920 expref: 20 pid: 17184 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265492.638532:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1876180417567232:0@lo:104: 00010000:00010000:0.0:1789265492.638547:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81490400/0x9272d942b4a97919 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a97912 expref: 19 pid: 17184 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265492.638555:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1876180417567360:0@lo:104: 00010000:00010000:0.0:1789265492.638589:0:17208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fcb83da4e00/0x9272d942b4a979cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265492.638598:0:17208:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fcb83da4e00/0x9272d942b4a979cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265492.638603:0:17208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fcb83da4e00/0x9272d942b4a979cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265492.638608:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb83da4e00/0x9272d942b4a979cf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265492.638632:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265492.638926:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a57aa04c-0472-45c4-bafc-6983957e249b:3643:1876180417567616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265492.638943:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a57aa04c-0472-45c4-bafc-6983957e249b:3643:1876180417567488:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1789265492.639102:0:18695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789265492.642303:0:18695:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789265492.642315:0:18695:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789265492.642354:0:18695:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789265492.642393:0:18695:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.149@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789265492.642412:0:18695:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789265492.642428:0:18695:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1789265492.643639:0:18695:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789265492.643861:0:18695:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789265492.993290:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417567744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265492.993361:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265492.993425:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417567744 00000100:00100000:0.0:1789265492.993433:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417567744 00000100:00100000:0.0:1789265492.993490:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789265492.993499:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417567744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789265492.993532:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789265492.993579:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417567744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265492.993587:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789265492.993634:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417567744:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265492.994636:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417567872:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265492.994683:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265492.994762:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417567872 00000100:00100000:3.0:1789265492.994769:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417567872 00000100:00100000:3.0:1789265492.994808:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789265492.994817:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417567872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789265492.994851:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789265492.994908:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417567872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265492.994915:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265492.994986:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417567872:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789265493.505148:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789265493.506934:0:18774:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789265493.507247:0:18774:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1789265493.825576:0:17189:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789265493.825583:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fccaa073800 from 9 10000000:01000000:2.0:1789265493.825588:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789265493.825634:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a979d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265493.825646:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a979d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265493.825657:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a979d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265493.825683:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417568000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265493.825755:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265493.825808:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83e9cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265493.826154:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417568000 00000100:00100000:3.0:1789265493.826261:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417568000 00000100:00100000:3.0:1789265493.826317:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789265493.826327:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+19:17189:x1876180417568000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265493.826340:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265493.826353:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc882b6600/0x9272d942b4a979dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a979d6 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265493.826377:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc882b6600/0x9272d942b4a979dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a979d6 expref: 20 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265493.826387:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc882b6600/0x9272d942b4a979dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a979d6 expref: 20 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265493.826396:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6600, rc 0) 00000100:00100000:3.0:1789265493.826771:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+20:17189:x1876180417568000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 445us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265493.826778:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789265493.827073:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417568000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265493.827092:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a979d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a979dd expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265493.827103:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a979d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a979dd expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265493.827314:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417568128:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789265493.827358:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265493.827392:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83e9cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265493.829065:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417568128 00000100:00100000:3.0:1789265493.829082:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417568128 00000100:00100000:3.0:1789265493.829150:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789265493.829167:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+20:17189:x1876180417568128:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789265493.829192:0:17187:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789265493.829217:0:17187:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789265493.829225:0:17187:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1789265493.829366:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+20:17189:x1876180417568128:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 201us (2007us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265493.829374:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789265493.829517:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417568128:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789265493.829599:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789265493.829613:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a979d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a979dd expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265493.829623:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a979d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a979dd expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265493.829633:0:17189:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789265493.829636:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fcb83933000 from 9 10000000:01000000:0.0:1789265493.829638:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789265493.829667:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a979e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265493.829675:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a979e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265493.829684:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a979e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265493.829702:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417568256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265493.829738:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265493.829771:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7d480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265493.829904:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417568256 00000100:00100000:3.0:1789265493.829910:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417568256 00000100:00100000:3.0:1789265493.829946:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789265493.829953:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+20:17189:x1876180417568256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265493.829962:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265493.829974:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc882b6000/0x9272d942b4a979eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a979e4 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265493.829995:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc882b6000/0x9272d942b4a979eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a979e4 expref: 21 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265493.830005:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc882b6000/0x9272d942b4a979eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a979e4 expref: 21 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265493.830014:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6000, rc 0) 00000100:00100000:3.0:1789265493.830070:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+21:17189:x1876180417568256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265493.830076:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789265493.830286:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417568256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265493.830300:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a979e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a979eb expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265493.830317:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a979e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a979eb expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265493.830363:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417568384:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789265493.830394:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265493.830419:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b756c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265493.830481:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417568384 00000100:00100000:2.0:1789265493.830486:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417568384 00000100:00100000:2.0:1789265493.830509:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789265493.830515:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+21:17189:x1876180417568384:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789265493.830526:0:17186:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789265493.830539:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789265493.830541:0:17186:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1789265493.830618:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+21:17189:x1876180417568384:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 102us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265493.830624:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789265493.830732:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417568384:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789265493.830776:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789265493.830781:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a979e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a979eb expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265493.830789:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a979e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a979eb expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265494.531131:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789265495.108293:0:17228:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789265495.553222:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265496.577233:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265497.601276:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789265498.116971:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265498.116978:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265498.116981:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265498.116984:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265498.117006:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265498.117009:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265498.117012:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265498.117015:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789265498.117103:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a57aa04c-0472-45c4-bafc-6983957e249b:3643:1876180417568512:0@lo:400:kworker.0 00000100:00100000:2.0:1789265498.117180:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265498.117221:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417569024:0@lo:400:kworker.0 00000100:00100000:2.0:1789265498.117252:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265498.117278:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789265498.117285:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83daa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417568640:0@lo:400:kworker.0 00000100:00100000:2.0:1789265498.117313:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265498.117331:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83daad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417569152:0@lo:400:kworker.0 00000100:00100000:2.0:1789265498.117353:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265498.117384:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417568896:0@lo:400:kworker.0 00000100:00100000:2.0:1789265498.117410:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265498.117431:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789265498.117436:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417568768:0@lo:400:kworker.0 00000100:00100000:2.0:1789265498.117459:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265498.117474:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83daaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417569280:0@lo:400:kworker.0 00000100:00100000:2.0:1789265498.117495:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265498.117517:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417568512 00000100:00100000:2.0:1789265498.117524:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417568512 00000100:00100000:0.0:1789265498.118286:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417568640 00000100:00100000:0.0:1789265498.118292:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417568640 00000100:00100000:0.0:1789265498.118331:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417568896 00000100:00100000:0.0:1789265498.118335:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417568896 00000100:00100000:0.0:1789265498.118353:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265498.118363:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417568640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265498.118433:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417568640:12345-0@lo:400:kworker.0 Request processed in 71us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265498.118455:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265498.118475:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789265498.118482:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417568896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265498.118514:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417568896:12345-0@lo:400:kworker.0 Request processed in 33us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265498.118520:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789265498.118538:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417569024 00000100:00100000:0.0:1789265498.118541:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417569024 00000100:00100000:0.0:1789265498.118576:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417569152 00000100:00100000:0.0:1789265498.118579:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417569152 00000100:00100000:1.0:1789265498.118843:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265498.119783:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417569408:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265498.119837:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265498.120167:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265498.120179:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417569536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265498.120208:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265498.120253:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417568896:0@lo:400:kworker.0 00000100:00100000:0.0:1789265498.120663:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417568768 00000100:00100000:0.0:1789265498.120669:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417568768 00000100:00100000:0.0:1789265498.120697:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417569280 00000100:00100000:0.0:1789265498.120700:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417569280 00000100:00100000:0.0:1789265498.120721:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265498.120729:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417569024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265498.120775:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417569024:12345-0@lo:400:kworker.0 Request processed in 47us (3522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265498.120782:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265498.120796:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789265498.120802:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83daa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417569152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265498.120825:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83daa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417569152:12345-0@lo:400:kworker.0 Request processed in 24us (3471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265498.120831:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789265498.120842:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265498.120847:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417568768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265498.120911:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417568768:12345-0@lo:400:kworker.0 Request processed in 63us (3451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265498.120917:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265498.120929:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789265498.120934:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417569280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265498.120958:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417569280:12345-0@lo:400:kworker.0 Request processed in 24us (3463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265498.120963:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789265498.120980:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417569408 00000100:00100000:0.0:1789265498.120983:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417569408 00000100:00100000:0.0:1789265498.120997:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417569536 00000100:00100000:0.0:1789265498.120999:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417569536 00000100:00100000:0.0:1789265498.121008:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789265498.121014:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417569408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789265498.121058:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789265498.121097:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417569408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265498.121104:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789265498.121116:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789265498.121122:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417569536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789265498.121136:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789265498.121164:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417569536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 42us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265498.121170:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789265498.121204:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417569408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265498.121231:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417569536:0@lo:41:osp-pre-0-1.0 00010000:00080000:0.0:1789265498.121265:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb83da8a80 x1876180417568768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265498.121276:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417568768:0@lo:400:kworker.0 00010000:00080000:0.0:1789265498.121290:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb83daaa00 x1876180417569280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265498.121298:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83daaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417569280:0@lo:400:kworker.0 00000100:00100000:0.0:1789265498.121321:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83daa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417568640:0@lo:400:kworker.0 00010000:00080000:0.0:1789265498.121335:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb83daad80 x1876180417569152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265498.121343:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83daad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417569152:0@lo:400:kworker.0 00010000:00080000:0.0:1789265498.121356:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb83da8e00 x1876180417569024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265498.121364:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417569024:0@lo:400:kworker.0 00000100:00100000:2.0:1789265498.124098:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789265498.124119:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+21:3643:x1876180417568512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265498.124202:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+21:3643:x1876180417568512:12345-0@lo:400:kworker.0 Request processed in 93us (7022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265498.124209:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1789265498.124276:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789265498.124281:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265498.129066:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a57aa04c-0472-45c4-bafc-6983957e249b:3643:1876180417568512:0@lo:400:kworker.0 00010000:00010000:1.0:1789265498.628757:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789265498.859891:0:19064:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg349-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:3.0:1789265499.138649:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789265499.651839:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789265499.849985:0:19116:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789265499.850521:0:19116:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789265500.677180:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789265500.824655:0:19166:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789265500.824880:0:19166:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789265501.708519:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265502.722466:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265502.849187:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265487/real 1789265487] req@ffff9fcb83e2f800 x1876180417562752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265502 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265502.849233:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb83e2f800 x1876180417562752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265502 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265502.849245:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265487/real 1789265487] req@ffff9fcb83e2ca80 x1876180417562880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265502 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265502.849257:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb83e2ca80 x1876180417562880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265502 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789265502.849276:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb83c79800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265502.849303:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789265502.849307:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417562752:0@lo:8:kworker.0 00000100:00080000:1.0:1789265502.849312:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccad90f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265502.849317:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789265502.849319:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417562880:0@lo:8:kworker.0 00000100:00080000:2.0:1789265502.850630:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265502.850637:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265502.850641:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265502.850643:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265502.850661:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265502.850665:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789265502.850668:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fcb83c79800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265502.850675:0:17249:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 539 00000100:00080000:2.0:1789265502.850681:0:17249:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789265502.850689:0:17249:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9fcb83c79800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265502.850717:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fccbf609180 x1876180417570176/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789265502.850727:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417570048:0@lo:400:kworker.0 00000100:00080000:2.0:1789265502.850738:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265502.850743:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789265502.850745:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fccad90f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265502.850748:0:17249:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 539 00000100:00080000:2.0:1789265502.850751:0:17249:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789265502.850755:0:17249:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fccad90f000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265502.850769:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fccbf609500 x1876180417570304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265502.850820:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417569792:0@lo:400:kworker.0 00000100:00100000:3.0:1789265502.850853:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265502.850925:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265502.850989:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417570560:0@lo:400:kworker.0 00000100:00100000:3.0:1789265502.850999:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789265502.851012:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a57aa04c-0472-45c4-bafc-6983957e249b:3643:1876180417569664:0@lo:400:kworker.0 00000100:00100000:2.0:1789265502.851066:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265502.851111:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265502.851167:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417570176:0@lo:8:kworker.0 00000100:00100000:2.0:1789265502.851990:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789265502.852001:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417569920:0@lo:400:kworker.0 00000100:00100000:2.0:1789265502.852120:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265502.852153:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417570688:0@lo:400:kworker.0 00000100:00100000:2.0:1789265502.852187:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265502.852244:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417570432:0@lo:400:kworker.0 00000100:00100000:2.0:1789265502.852263:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417570048 00000100:00100000:2.0:1789265502.852271:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417570048 00000100:00100000:3.0:1789265502.852308:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265502.852318:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417569792 00000100:00100000:2.0:1789265502.852322:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417569792 00000100:00100000:2.0:1789265502.852337:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789265502.852345:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417570048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265502.852472:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265502.852481:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789265502.852500:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417569792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265502.852513:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417570304:0@lo:8:kworker.0 00000100:00100000:1.0:1789265502.852793:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265502.852873:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417570176 00000100:00100000:1.0:1789265502.852879:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417570176 00000100:00100000:0.0:1789265502.852895:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417570560 00000100:00100000:3.0:1789265502.852903:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417569792:12345-0@lo:400:kworker.0 Request processed in 405us (1976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265502.852909:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417570304 00000100:00100000:1.0:1789265502.852914:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417570304 00000100:00100000:3.0:1789265502.852918:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789265502.852937:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265502.852966:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417569664 00000100:00100000:3.0:1789265502.852975:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417569664 00000100:00100000:3.0:1789265502.853018:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789265502.853051:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+21:3643:x1876180417569664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265502.853105:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+21:3643:x1876180417569664:12345-0@lo:400:kworker.0 Request processed in 57us (1996us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265502.853113:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789265502.853127:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417570560 00000100:00100000:0.0:1789265502.853182:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417569920 00000100:00100000:0.0:1789265502.853187:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417569920 00000100:00100000:3.0:1789265502.853192:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417569792:0@lo:400:kworker.0 00000100:00100000:0.0:1789265502.853210:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417570688 00000100:00100000:0.0:1789265502.853216:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417570688 00000100:00100000:0.0:1789265502.853244:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417570432 00000100:00100000:0.0:1789265502.853248:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417570432 00000100:00100000:3.0:1789265502.853256:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a57aa04c-0472-45c4-bafc-6983957e249b:3643:1876180417569664:0@lo:400:kworker.0 00000100:00100000:0.0:1789265502.853275:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789265502.853285:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417570560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265502.853334:0:17192:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789265502.853345:0:17192:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789265502.853361:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417570560:12345-0@lo:400:kworker.0 Request processed in 77us (2338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265502.853380:0:17193:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789265502.853393:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789265502.853403:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417569920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265502.853449:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417569920:12345-0@lo:400:kworker.0 Request processed in 48us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265502.853472:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789265502.853489:0:17193:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789265502.853495:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789265502.853501:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417570688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265502.853532:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417570688:12345-0@lo:400:kworker.0 Request processed in 31us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265502.853538:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789265502.853553:0:17193:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789265502.853560:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789265502.853568:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417570432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265502.853616:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417570048:12345-0@lo:400:kworker.0 Request processed in 1267us (2766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265502.853626:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417570432:12345-0@lo:400:kworker.0 Request processed in 55us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265502.853637:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789265502.853649:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789265502.853683:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789265502.853688:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789265502.853724:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccbf60b100 x1876180417570432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265502.853741:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417570432:0@lo:400:kworker.0 00000100:00100000:2.0:1789265502.853755:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417570048:0@lo:400:kworker.0 00000100:00100000:1.0:1789265502.853789:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1876180417570176:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789265502.853824:0:18700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 554 last 0 00010000:00080000:3.0:1789265502.853843:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccbf608380 x1876180417569920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265502.853861:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417569920:0@lo:400:kworker.0 00000020:00000080:1.0:1789265502.853880:0:18700:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9272d942b4a979f2 00010000:00080000:3.0:1789265502.853887:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccbf608700 x1876180417570688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265502.853899:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417570688:0@lo:400:kworker.0 00002000:00100000:1.0:1789265502.853900:0:18700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9fcb82c50800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1789265502.853913:0:18700:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1789265502.853917:0:18700:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:3.0:1789265502.853930:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccbf60ad80 x1876180417570560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265502.853942:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417570560:0@lo:400:kworker.0 00000100:00100000:0.0:1789265502.853977:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00002000:00080000:1.0:1789265502.854825:0:18700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1789265502.854866:0:18700:0:(import.c:65:import_set_state_nolock()) ffff9fcb82c55000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265502.855455:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1876180417570176:12345-0@lo:8:kworker.0 Request processed in 2507us (2981us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265502.855465:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265502.855496:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265502.855502:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1876180417570304:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789265502.855521:0:18700:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1789265502.855840:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccbf609180 x1876180417570176/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265502.855859:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789265502.855867:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789265502.855875:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789265502.855881:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789265502.855884:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb83c79800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789265502.855907:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789265502.855913:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417570176:0@lo:8:kworker.0 00000004:00080000:2.0:1789265502.856210:0:17936:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789265502.856235:0:17936:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17936:1876180417570944:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1789265502.856298:0:17936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265502.856323:0:17936:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0a7e180 going to sleep for 11 seconds 00000100:00100000:2.0:1789265502.856338:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417570816:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265502.856363:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265502.856557:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789265502.856564:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789265502.856586:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417570816 00000100:00100000:2.0:1789265502.856591:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417570816 00000100:00100000:2.0:1789265502.856633:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265502.856640:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1876180417570816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789265502.856664:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789265502.856701:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1876180417570816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265502.856709:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789265502.856800:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789265502.856980:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccbf609f80 x1876180417570816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265502.856999:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417570816:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265502.857136:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417570944 00000100:00100000:2.0:1789265502.857141:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417570944 00000100:00100000:2.0:1789265502.857237:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265502.857244:0:19247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17936:x1876180417570944:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1789265502.857602:0:17935:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789265502.857681:0:17935:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 554087657779ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789265502.857688:0:17935:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1789265502.860301:0:17926:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:2.0:1789265502.862342:0:19247:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1789265502.862354:0:19247:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1789265502.862556:0:19247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17936:x1876180417570944:12345-0@lo:7:osp-pre-0-1.0 Request processed in 5306us (6252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265502.862570:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789265502.862721:0:17936:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccbf60b100 x1876180417570944/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789265518 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265502.862739:0:17936:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17936:1876180417570944:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1789265502.862759:0:17936:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789265502.862895:0:17936:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17936:1876180417571072:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789265502.862944:0:17936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265502.862983:0:17936:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcca9792c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265502.863253:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417571072 00000100:00100000:2.0:1789265502.863262:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417571072 00000100:00100000:2.0:1789265502.863366:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265502.863388:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17936:x1876180417571072:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1789265502.863425:0:18702:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1789265502.863472:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17936:x1876180417571072:12345-0@lo:5:osp-pre-0-1.0 Request processed in 87us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265502.863479:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789265502.863591:0:17936:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccbd3e7480 x1876180417571072/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265518 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265502.863603:0:17936:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17936:1876180417571072:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789265502.863615:0:17936:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789265502.863648:0:17936:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17936:1876180417571200:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789265502.863683:0:17936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265502.863701:0:17936:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcca9792c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265502.863739:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417571200 00000100:00100000:2.0:1789265502.863744:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417571200 00000100:00100000:2.0:1789265502.863890:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789265502.863899:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17936:x1876180417571200:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1789265502.863930:0:18702:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1789265502.893224:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1876180417570304:12345-0@lo:8:kworker.0 Request processed in 37715us (40425us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789265502.893238:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789265502.893288:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccad90f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265502.893293:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789265502.893298:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417570304:0@lo:8:kworker.0 00000001:00080000:0.0:1789265502.894159:0:18696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1789265502.894173:0:18696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789265502.894296:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17936:x1876180417571200:12345-0@lo:5:osp-pre-0-1.0 Request processed in 30397us (30610us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789265502.894309:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789265502.894373:0:17936:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccbd3e7480 x1876180417571200/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265518 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265502.894392:0:17936:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789265502.894399:0:17936:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17936:1876180417571200:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789265502.894416:0:17936:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1789265502.894471:0:17936:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17936:1876180417571328:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789265502.894512:0:17936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265502.894551:0:17936:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcca9792c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265502.894959:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417571328 00000100:00100000:2.0:1789265502.894965:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417571328 00000100:00100000:2.0:1789265502.895002:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265502.895011:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17936:x1876180417571328:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789265502.895090:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17936:x1876180417571328:12345-0@lo:900:osp-pre-0-1.0 Request processed in 80us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265502.895200:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789265502.895305:0:17936:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccbd3e7480 x1876180417571328/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789265518 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265502.895317:0:17936:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17936:1876180417571328:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789265503.233319:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417571456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265503.233399:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265503.233463:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265503.233472:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417571584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265503.233497:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265503.233528:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417571456 00000100:00100000:2.0:1789265503.233535:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417571456 00000100:00100000:2.0:1789265503.233576:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417571584 00000100:00100000:2.0:1789265503.233579:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417571584 00000100:00100000:2.0:1789265503.233596:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789265503.233603:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417571456:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265503.233743:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789265503.233753:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417571584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265503.233788:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789265503.233858:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417571584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265503.233866:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789265503.233945:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417571584:0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789265503.234003:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789265503.234082:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417571456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 478us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265503.234090:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789265503.234272:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417571456:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789265503.746458:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265504.769602:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789265505.347224:0:17228:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789265505.795160:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265506.824206:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789265507.418212:0:19513:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789265507.418283:0:19513:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789265507.418285:0:19513:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789265507.418492:0:19513:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fccbc124800 00000020:01000004:2.0:1789265507.418508:0:19513:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789265507.418523:0:19513:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789265507.418538:0:19513:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9fcc84288000) 00000020:00000080:2.0:1789265507.418557:0:19513:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789265507.474746:0:19513:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789265507.475117:0:19513:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789265507.475376:0:19513:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789265507.475539:0:19513:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789265507.475704:0:19513:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789265507.476216:0:19513:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789265507.476603:0:19513:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:0.0:1789265507.480381:0:19513:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789265507.480586:0:19513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789265507.480600:0:19513:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789265507.480612:0:19513:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9272d942b4a97a00 00000020:01000004:0.0:1789265507.480618:0:19513:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789265507.480639:0:19513:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.149@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789265507.480643:0:19513:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.149@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789265507.480649:0:19513:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789265507.480676:0:19513:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1789265507.480680:0:19513:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.149@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789265507.489128:0:19513:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.149@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789265507.489212:0:19513:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.149@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1789265507.489218:0:19513:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789265507.489220:0:19513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789265507.489221:0:19513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265507.489221:0:19513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265507.489286:0:19513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265507.489287:0:19513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265507.489289:0:19513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265507.489291:0:19513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265507.489292:0:19513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789265507.489296:0:19513:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1789265507.489298:0:19513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789265507.489300:0:19513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789265507.489301:0:19513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265507.489302:0:19513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265507.489303:0:19513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265507.489304:0:19513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265507.489305:0:19513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265507.489306:0:19513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265507.489307:0:19513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789265507.489332:0:19513:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789265507.489415:0:19513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417571712:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789265507.489488:0:19513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265507.489544:0:19513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc83275cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265507.489627:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417571712 00000100:00100000:3.0:1789265507.489634:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417571712 00000100:00100000:3.0:1789265507.489682:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789265507.489690:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+21:19513:x1876180417571712:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789265507.489717:0:17184:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789265507.489720:0:17184:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1789265507.489724:0:17184:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789265507.490088:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+21:19513:x1876180417571712:12345-0@lo:253:mount.lustre.0 Request processed in 397us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265507.490097:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789265507.490097:0:19513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417571712:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789265507.490105:0:19513:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789265507.490107:0:19513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789265507.490108:0:19513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789265507.490109:0:19513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265507.490110:0:19513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265507.490111:0:19513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265507.490112:0:19513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265507.490113:0:19513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265507.490114:0:19513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265507.490115:0:19513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789265507.490198:0:19513:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fccbc124800 from lustre-OST0001 10000000:01000000:0.0:1789265507.490288:0:19513:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789265507.490291:0:19513:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789265507.490300:0:19513:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fcb829f99b8 local copy 00010000:00010000:0.0:1789265507.490418:0:19513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53a00/0x9272d942b4a9771a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97721 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265507.490518:0:19513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417571840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265507.490545:0:19513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265507.490571:0:19513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc832750c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265507.490594:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417571840 00000100:00100000:2.0:1789265507.490599:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417571840 00000100:00100000:2.0:1789265507.490633:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789265507.490641:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+21:19513:x1876180417571840:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265507.490702:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+21:19513:x1876180417571840:12345-0@lo:501:mount.lustre.0 Request processed in 62us (156us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789265507.490709:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789265507.490712:0:19513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417571840:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789265507.490723:0:19513:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.149@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789265507.490739:0:19513:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.149@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789265507.490745:0:19513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53a00/0x9272d942b4a9771a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97721 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265507.490753:0:19513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53a00/0x9272d942b4a9771a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97721 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265507.491052:0:19513:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fccbc124800 10000000:01000000:0.0:1789265507.491058:0:19513:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789265507.491065:0:19513:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789265507.491068:0:19513:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789265507.491072:0:19513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789265507.491075:0:19513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789265507.491099:0:19513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5200/0x9272d942b4a97a07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265507.491107:0:19513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5200/0x9272d942b4a97a07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265507.491116:0:19513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5200/0x9272d942b4a97a07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265507.491210:0:19513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417571968:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789265507.491464:0:19513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265507.491498:0:19513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc832750c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265507.491730:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417571968 00000100:00100000:3.0:1789265507.491734:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417571968 00000100:00100000:3.0:1789265507.491765:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789265507.491773:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+21:19513:x1876180417571968:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265507.491792:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265507.491814:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc882b7800/0x9272d942b4a97a0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a97a07 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265507.491835:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc882b7800/0x9272d942b4a97a0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a97a07 expref: 22 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265507.491845:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc882b7800/0x9272d942b4a97a0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a97a07 expref: 22 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265507.491860:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b7800, rc 0) 00000100:00100000:3.0:1789265507.491905:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+22:19513:x1876180417571968:12345-0@lo:101:mount.lustre.0 Request processed in 133us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265507.491911:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789265507.491989:0:19513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417571968:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789265507.492000:0:19513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5200/0x9272d942b4a97a07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97a0e expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265507.492007:0:19513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5200/0x9272d942b4a97a07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97a0e expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789265507.492945:0:19513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789265507.493530:0:19513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265507.494819:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789265507.494857:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789265507.494873:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789265507.494886:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789265507.494899:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789265507.494913:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789265507.494933:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789265507.494939:0:19513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789265507.495047:0:19513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417572096:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265507.495109:0:19513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265507.495151:0:19513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc83275240 going to sleep for 11 seconds 00000100:00100000:2.0:1789265507.495399:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417572096 00000100:00100000:2.0:1789265507.495406:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417572096 00000100:00100000:2.0:1789265507.495452:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789265507.495462:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+22:19513:x1876180417572096:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265507.495616:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+22:19513:x1876180417572096:12345-0@lo:501:mount.lustre.0 Request processed in 155us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265507.495624:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789265507.495714:0:19513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417572096:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265507.495751:0:19513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417572224:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265507.495813:0:19513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265507.495834:0:19513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3429c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265507.495898:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417572224 00000100:00100000:3.0:1789265507.495902:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417572224 00000100:00100000:3.0:1789265507.495969:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789265507.495977:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+22:19513:x1876180417572224:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265507.496780:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+22:19513:x1876180417572224:12345-0@lo:503:mount.lustre.0 Request processed in 801us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265507.496788:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789265507.496895:0:19513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417572224:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789265507.497338:0:19513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789265507.497423:0:19513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417572352:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265507.497461:0:19513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265507.497664:0:19513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3429c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265507.497756:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417572352 00000100:00100000:2.0:1789265507.497761:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417572352 00000100:00100000:2.0:1789265507.497792:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789265507.497810:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+22:19513:x1876180417572352:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265507.498441:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+22:19513:x1876180417572352:12345-0@lo:502:mount.lustre.0 Request processed in 631us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265507.498450:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789265507.498530:0:19513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417572352:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789265507.498716:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789265507.498742:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789265507.498757:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789265507.498771:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789265507.498783:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789265507.498794:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789265507.498825:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789265507.498838:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789265507.498850:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1789265507.498874:0:19513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417572480:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265507.498912:0:19513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265507.498944:0:19513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3429c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265507.498994:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417572480 00000100:00100000:0.0:1789265507.498999:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417572480 00000100:00100000:0.0:1789265507.499069:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789265507.499078:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8ade3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+22:19513:x1876180417572480:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265507.499165:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8ade3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+22:19513:x1876180417572480:12345-0@lo:502:mount.lustre.0 Request processed in 88us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265507.499172:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789265507.499652:0:19513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417572480:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789265507.499697:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789265507.499712:0:19513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1789265507.500609:0:19517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789265507.500616:0:19517:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1789265507.500622:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265507.500624:0:19517:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789265507.500629:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789265507.500642:0:19517:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9fccbc5819b8) 00000020:00000080:1.0:1789265507.500663:0:19517:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789265507.500668:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789265507.500722:0:19517:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fccbc124800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789265507.500729:0:19517:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789265507.500734:0:19517:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9272d942b4a97a1c 00010000:00010000:1.0:1789265507.504967:0:19517:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1789265507.505965:0:19517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1789265507.509065:0:19517:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1789265507.512678:0:19517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789265507.512692:0:19517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265507.512700:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265507.512702:0:19517:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789265507.512706:0:19517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265507.512710:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265507.512711:0:19517:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789265507.512715:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789265507.512717:0:19517:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789265507.512719:0:19517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265507.512721:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265507.512723:0:19517:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789265507.512725:0:19517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265507.512727:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265507.512728:0:19517:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789265507.512731:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789265507.512768:0:19517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265507.512771:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265507.512772:0:19517:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789265507.512775:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1789265507.513081:0:19513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789265507.513114:0:19513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789265507.513146:0:19513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5200/0x9272d942b4a97a07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97a0e expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265507.513160:0:19513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5200/0x9272d942b4a97a07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97a0e expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265507.513169:0:19513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fccbc124800 from 1 10000000:01000000:0.0:1789265507.513172:0:19513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789265507.513208:0:19513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a97a23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265507.513217:0:19513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a97a23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265507.513235:0:19513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a97a23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265507.513259:0:19513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417572608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789265507.513329:0:19513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265507.513374:0:19513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc83275000 going to sleep for 11 seconds 00000100:00100000:3.0:1789265507.513445:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417572608 00000100:00100000:3.0:1789265507.513465:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417572608 00000100:00100000:3.0:1789265507.513514:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789265507.513524:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+22:19513:x1876180417572608:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265507.513536:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265507.513548:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc882b7a00/0x9272d942b4a97a2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a97a23 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265507.513582:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc882b7a00/0x9272d942b4a97a2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a97a23 expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265507.513592:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc882b7a00/0x9272d942b4a97a2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a97a23 expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265507.513601:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b7a00, rc 0) 00000100:00100000:3.0:1789265507.513640:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+23:19513:x1876180417572608:12345-0@lo:101:mount.lustre.0 Request processed in 118us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265507.513646:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789265507.514157:0:19513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417572608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789265507.514173:0:19513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a97a23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97a2a expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265507.514196:0:19513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a97a23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97a2a expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265507.522345:0:19513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789265507.522785:0:19513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789265507.523549:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789265507.523577:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789265507.523597:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789265507.523602:0:19513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789265507.523686:0:19513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417572736:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265507.523753:0:19513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265507.523804:0:19513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265507.524002:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417572736 00000100:00100000:0.0:1789265507.524010:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417572736 00000100:00100000:0.0:1789265507.524074:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789265507.524083:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+23:19513:x1876180417572736:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265507.524208:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+23:19513:x1876180417572736:12345-0@lo:501:mount.lustre.0 Request processed in 125us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265507.524216:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789265507.524636:0:19513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417572736:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265507.524675:0:19513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417572864:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265507.524723:0:19513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265507.524754:0:19513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265507.524815:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417572864 00000100:00100000:0.0:1789265507.524820:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417572864 00000100:00100000:0.0:1789265507.524885:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789265507.524893:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+23:19513:x1876180417572864:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789265507.524985:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+23:19513:x1876180417572864:12345-0@lo:503:mount.lustre.0 Request processed in 92us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265507.524992:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789265507.525090:0:19513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417572864:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789265507.525480:0:19513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789265507.525543:0:19513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417572992:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265507.525581:0:19513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265507.526361:0:19513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265507.526477:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417572992 00000100:00100000:3.0:1789265507.526484:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417572992 00000100:00100000:3.0:1789265507.526521:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789265507.526529:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+23:19513:x1876180417572992:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265507.526694:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+23:19513:x1876180417572992:12345-0@lo:502:mount.lustre.0 Request processed in 165us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265507.526701:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789265507.528752:0:19513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417572992:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789265507.528990:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789265507.529046:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789265507.529064:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789265507.529076:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789265507.529101:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789265507.529112:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789265507.529125:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789265507.529152:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1789265507.529165:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789265507.529176:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1789265507.529187:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1789265507.529220:0:19513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417573120:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265507.529282:0:19513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265507.529317:0:19513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265507.529476:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417573120 00000100:00100000:0.0:1789265507.529483:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417573120 00000100:00100000:0.0:1789265507.529531:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789265507.529540:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+23:19513:x1876180417573120:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265507.529656:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+23:19513:x1876180417573120:12345-0@lo:502:mount.lustre.0 Request processed in 117us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265507.529664:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789265507.529830:0:19513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417573120:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789265507.529879:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1789265507.529888:0:19513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789265507.531317:0:19521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265507.531330:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265507.531333:0:19521:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789265507.531339:0:19521:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fccbc124800 00000020:00000080:2.0:1789265507.531342:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789265507.531350:0:19521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265507.531353:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265507.531354:0:19521:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789265507.531356:0:19521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265507.531358:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265507.531359:0:19521:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789265507.531363:0:19521:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fccbc124800 00000020:00000080:2.0:1789265507.531365:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789265507.531468:0:19521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265507.531473:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265507.531474:0:19521:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789265507.531476:0:19521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265507.531479:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265507.531480:0:19521:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789265507.531496:0:19521:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fccbc124800 00000020:00000080:2.0:1789265507.531498:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789265507.538661:0:19521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265507.538691:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265507.538694:0:19521:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789265507.538698:0:19521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265507.538702:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265507.538704:0:19521:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789265507.538708:0:19521:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fccbc124800 00000020:00000080:2.0:1789265507.538710:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789265507.538773:0:19521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265507.538776:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265507.538778:0:19521:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789265507.538781:0:19521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1789265507.548431:0:19513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789265507.548479:0:19513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265507.548505:0:19513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a97a23 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97a2a expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265507.548518:0:19513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a97a23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97a2a expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265507.548596:0:19513:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789265507.548600:0:19513:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fccbc124800 10000000:01000000:2.0:1789265507.548603:0:19513:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fccbc124800 10000000:01000000:2.0:1789265507.548614:0:19513:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789265507.548621:0:19513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fccbc124800 from 1 10000000:01000000:2.0:1789265507.548624:0:19513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789265507.548672:0:19513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2fe00/0x9272d942b4a97a31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265507.548681:0:19513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2fe00/0x9272d942b4a97a31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265507.548703:0:19513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2fe00/0x9272d942b4a97a31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265507.548727:0:19513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417573248:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789265507.548813:0:19513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265507.548866:0:19513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d8240 going to sleep for 11 seconds 00000100:00100000:3.0:1789265507.550193:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417573248 00000100:00100000:3.0:1789265507.550205:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417573248 00000100:00100000:3.0:1789265507.550262:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789265507.550271:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+23:19513:x1876180417573248:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265507.550286:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265507.550302:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc882b6200/0x9272d942b4a97a38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a97a31 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265507.550329:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc882b6200/0x9272d942b4a97a38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a97a31 expref: 24 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265507.550356:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc882b6200/0x9272d942b4a97a38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a97a31 expref: 24 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265507.550366:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6200, rc 0) 00000100:00100000:3.0:1789265507.550432:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+24:19513:x1876180417573248:12345-0@lo:101:mount.lustre.0 Request processed in 161us (1618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265507.550439:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789265507.551586:0:19513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417573248:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265507.551621:0:19513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2fe00/0x9272d942b4a97a31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97a38 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265507.551634:0:19513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2fe00/0x9272d942b4a97a31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97a38 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265507.554468:0:19513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1789265507.554745:0:19513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789265507.554922:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789265507.554948:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789265507.554962:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789265507.554976:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789265507.554989:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789265507.555003:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789265507.555015:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789265507.555048:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789265507.555064:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789265507.555077:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789265507.555089:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789265507.555101:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789265507.555114:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789265507.555127:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789265507.555153:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789265507.555165:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789265507.555177:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789265507.555190:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789265507.555203:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789265507.555216:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789265507.555228:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789265507.555240:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789265507.555251:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789265507.555263:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789265507.555276:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1789265507.555854:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1789265507.555880:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1789265507.555894:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1789265507.555908:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1789265507.555923:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1789265507.555937:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1789265507.555950:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1789265507.555964:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1789265507.555976:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1789265507.555988:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1789265507.556000:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1789265507.556013:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1789265507.556148:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1789265507.556166:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1789265507.556178:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1789265507.556191:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1789265507.556223:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1789265507.556238:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1789265507.556252:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1789265507.556266:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1789265507.556279:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1789265507.556299:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1789265507.556438:0:19513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1789265507.556526:0:19513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417573376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265507.556590:0:19513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265507.556665:0:19513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d8180 going to sleep for 11 seconds 00000100:00100000:1.0:1789265507.556721:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417573376 00000100:00100000:1.0:1789265507.556729:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417573376 00000100:00100000:1.0:1789265507.556816:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789265507.556826:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+24:19513:x1876180417573376:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265507.556940:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+24:19513:x1876180417573376:12345-0@lo:501:mount.lustre.0 Request processed in 115us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265507.556948:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789265507.557011:0:19513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417573376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265507.557060:0:19513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417573504:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265507.557101:0:19513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265507.557120:0:19513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d8180 going to sleep for 11 seconds 00000100:00100000:2.0:1789265507.557134:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417573504 00000100:00100000:2.0:1789265507.557138:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417573504 00000100:00100000:2.0:1789265507.557162:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789265507.557168:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+24:19513:x1876180417573504:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265507.557238:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+24:19513:x1876180417573504:12345-0@lo:503:mount.lustre.0 Request processed in 70us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265507.557245:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789265507.557285:0:19513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417573504:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789265507.557772:0:19513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789265507.557844:0:19513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417573632:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265507.557882:0:19513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265507.557901:0:19513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83b876c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265507.557916:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417573632 00000100:00100000:2.0:1789265507.557919:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417573632 00000100:00100000:2.0:1789265507.557944:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789265507.557950:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+24:19513:x1876180417573632:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265507.558088:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+24:19513:x1876180417573632:12345-0@lo:502:mount.lustre.0 Request processed in 138us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265507.558102:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789265507.558147:0:19513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417573632:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789265507.558450:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789265507.558477:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789265507.558492:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789265507.558505:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789265507.558519:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789265507.558532:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789265507.558545:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789265507.558557:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789265507.558582:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789265507.558598:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789265507.558610:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789265507.558621:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789265507.558632:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789265507.558643:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789265507.558653:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789265507.558664:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789265507.558680:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789265507.558690:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789265507.558700:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789265507.558711:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789265507.558721:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789265507.558731:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789265507.558742:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789265507.558755:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789265507.558775:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1789265507.558787:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1789265507.558812:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1789265507.558826:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1789265507.558846:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1789265507.558857:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1789265507.558868:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1789265507.558879:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1789265507.558891:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1789265507.558903:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1789265507.558916:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1789265507.558929:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1789265507.558942:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1789265507.558955:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1789265507.558968:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1789265507.558979:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1789265507.559003:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1789265507.559017:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1789265507.559109:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1789265507.559122:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1789265507.559134:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1789265507.559147:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1789265507.559160:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1789265507.559172:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1789265507.559210:0:19513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417573760:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265507.559260:0:19513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265507.559336:0:19513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d8240 going to sleep for 11 seconds 00000100:00100000:1.0:1789265507.559486:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417573760 00000100:00100000:1.0:1789265507.559493:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417573760 00000100:00100000:1.0:1789265507.559566:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789265507.559575:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+24:19513:x1876180417573760:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265507.559673:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+24:19513:x1876180417573760:12345-0@lo:502:mount.lustre.0 Request processed in 99us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265507.559680:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789265507.559754:0:19513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417573760:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789265507.559906:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1789265507.559928:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1789265507.559952:0:19513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417573888:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265507.559986:0:19513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265507.560010:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417573888 00000100:00100000:2.0:1789265507.560013:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417573888 00000100:00100000:2.0:1789265507.560070:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789265507.560075:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+24:19513:x1876180417573888:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265507.560139:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+24:19513:x1876180417573888:12345-0@lo:502:mount.lustre.0 Request processed in 63us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265507.560146:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789265507.560196:0:19513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83b876c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265507.560210:0:19513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417573888:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789265507.560259:0:19513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1789265507.560266:0:19513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789265507.561670:0:19526:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789265507.561686:0:19526:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9fccbc584d28) 00000020:00000080:1.0:1789265507.561709:0:19526:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1789265507.561811:0:19526:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fccbc124800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789265507.561816:0:19526:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fccbc124800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789265507.561818:0:19526:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fccbc124800 3 00010000:00080000:1.0:1789265507.561847:0:19526:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fcb82af0800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.149@tcp at head 00010000:00010000:1.0:1789265507.570008:0:19526:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1789265507.572627:0:19526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789265507.572673:0:19526:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789265507.572687:0:19526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9272d942b4a97a46 00000100:00080000:1.0:1789265507.572697:0:19526:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789265507.572703:0:19526:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fcb82af0800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:1.0:1789265507.572734:0:19526:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83f30380 x1876180417574016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265507.572765:0:19526:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789265507.572814:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265507.572817:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265507.572820:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265507.572823:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265507.572851:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265507.572854:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789265507.572856:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fccad90f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789265507.572860:0:17249:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 554 00000100:00080000:1.0:1789265507.572864:0:17249:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789265507.572867:0:17249:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fccad90f000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:1.0:1789265507.572886:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83da8e00 x1876180417574656/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265507.572926:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417574400:0@lo:400:kworker.0 00000100:00100000:1.0:1789265507.573002:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265507.573565:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1876180417574016:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789265507.575657:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83daaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417575040:0@lo:400:kworker.0 00000100:00100000:2.0:1789265507.576060:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417574272:0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.576158:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265507.576197:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417574656:0@lo:8:kworker.0 00000100:00100000:0.0:1789265507.576224:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265507.576307:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417574144:0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.576334:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265507.576355:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83daad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417574784:0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.576376:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265507.576399:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265507.576406:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417574528:0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.576427:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265507.576620:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417574016 00000100:00100000:3.0:1789265507.576627:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417574016 00000100:00100000:3.0:1789265507.576658:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417574784 00000100:00100000:3.0:1789265507.576661:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417574784 00000100:00100000:3.0:1789265507.576690:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789265507.576699:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417574784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265507.576759:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417574784:12345-0@lo:400:kworker.0 Request processed in 60us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265507.576766:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789265507.576784:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789265507.576789:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1876180417574016:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789265507.576825:0:17192:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 558 last 0 00000020:00000080:3.0:1789265507.576863:0:17192:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9272d942b4a97a4d 00000004:00100000:3.0:1789265507.576878:0:17192:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789265507.576921:0:17192:0:(import.c:65:import_set_state_nolock()) ffff9fccb6ecb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265507.576964:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876180417574016:12345-0@lo:38:llog_process_th.0 Request processed in 172us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265507.576971:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789265507.577017:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb83daad80 x1876180417574784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265507.577337:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83daad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417574784:0@lo:400:kworker.0 00010000:00080000:3.0:1789265507.577383:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb83f30380 x1876180417574016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265507.577392:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789265507.577399:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789265507.577405:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789265507.577410:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789265507.577412:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb82af0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789265507.577418:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1876180417574016:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789265507.577721:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417574656 00000100:00100000:0.0:1789265507.577726:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417574656 00000100:00100000:0.0:1789265507.577749:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417574528 00000100:00100000:0.0:1789265507.577752:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417574528 00000100:00100000:0.0:1789265507.577813:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265507.577823:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417574528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.577870:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417574528:12345-0@lo:400:kworker.0 Request processed in 49us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265507.577876:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265507.577890:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265507.577894:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1876180417574656:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789265507.578013:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1876180417574656:12345-0@lo:8:kworker.0 Request processed in 116us (1787us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789265507.578042:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789265507.579486:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789265507.579535:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb83da8000 x1876180417574528/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265507.579551:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417574528:0@lo:400:kworker.0 00000100:00100000:3.0:1789265507.579586:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789265507.579592:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccad90f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789265507.579596:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789265507.579599:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417574656:0@lo:8:kworker.0 00000100:00100000:3.0:1789265507.580326:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417574400 00000100:00100000:3.0:1789265507.580334:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417574400 00000100:00100000:3.0:1789265507.580378:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417574144 00000100:00100000:3.0:1789265507.580382:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417574144 00000100:00100000:3.0:1789265507.580397:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789265507.580406:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417574400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265507.582001:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265507.582114:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789265507.582130:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417574144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265507.582187:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417574144:12345-0@lo:400:kworker.0 Request processed in 62us (5851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265507.582195:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789265507.584114:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417575040 00000100:00100000:0.0:1789265507.584125:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417575040 00000100:00100000:0.0:1789265507.584264:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789265507.584273:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417575040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.584355:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417575040:12345-0@lo:400:kworker.0 Request processed in 83us (2359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265507.584363:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789265507.585046:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417574144:0@lo:400:kworker.0 00010000:00080000:0.0:1789265507.585088:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb83daaa00 x1876180417575040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265507.585099:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83daaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417575040:0@lo:400:kworker.0 00000100:00100000:2.0:1789265507.585262:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265507.585339:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83daa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417574912:0@lo:400:kworker.0 00000100:00100000:2.0:1789265507.585372:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265507.587581:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417574400:12345-0@lo:400:kworker.0 Request processed in 7167us (14570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265507.587602:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789265507.587641:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265507.595571:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417574272 00000100:00100000:0.0:1789265507.595585:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417574272 00000100:00100000:0.0:1789265507.595649:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417574912 00000100:00100000:0.0:1789265507.595652:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417574912 00000100:00100000:0.0:1789265507.595689:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789265507.595699:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417574272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.595791:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417574272:12345-0@lo:400:kworker.0 Request processed in 94us (10528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265507.596105:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789265507.596117:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417574912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265507.596292:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417574400:0@lo:400:kworker.0 00000100:00100000:2.0:1789265507.596714:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417574912:12345-0@lo:400:kworker.0 Request processed in 600us (11340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265507.596724:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789265507.596788:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1789265507.596829:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789265507.596855:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb83f30700 x1876180417574272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265507.596867:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417574272:0@lo:400:kworker.0 00010000:00080000:0.0:1789265507.596879:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb83daa300 x1876180417574912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265507.596888:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83daa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417574912:0@lo:400:kworker.0 00000020:01000004:3.0:1789265507.597404:0:19526:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789265507.597421:0:19526:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9fccb09b4d28) 00000020:00000080:3.0:1789265507.597445:0:19526:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1789265507.597780:0:19526:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fccbc124800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789265507.597786:0:19526:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fccbc124800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789265507.597788:0:19526:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fccbc124800 3 00010000:00080000:3.0:1789265507.597829:0:19526:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fccb6ecd000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.149@tcp at head 00010000:00010000:3.0:1789265507.601897:0:19526:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1789265507.604862:0:19526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1789265507.604926:0:19526:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789265507.604942:0:19526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x9272d942b4a97a5b 00000100:00080000:3.0:1789265507.604955:0:19526:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789265507.604961:0:19526:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9fccb6ecd000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:3.0:1789265507.604997:0:19526:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb84847800 x1876180417575168/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265507.605055:0:19526:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789265507.605294:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265507.605299:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265507.605302:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265507.605305:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789265507.605385:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1876180417575168:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789265507.605468:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265507.605613:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417575168 00000100:00100000:1.0:1789265507.605621:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417575168 00000100:00100000:1.0:1789265507.605663:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265507.605671:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1876180417575168:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789265507.605696:0:17193:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 558 last 0 00000020:00000080:1.0:1789265507.605727:0:17193:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x9272d942b4a97a62 00000004:00100000:1.0:1789265507.605743:0:17193:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789265507.605773:0:17193:0:(import.c:65:import_set_state_nolock()) ffff9fcb82af4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265507.605836:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876180417575168:12345-0@lo:38:llog_process_th.0 Request processed in 164us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265507.605857:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789265507.606078:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb84847800 x1876180417575168/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265507.606089:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789265507.606097:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1789265507.606103:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789265507.606108:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789265507.606110:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccb6ecd000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789265507.606115:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1876180417575168:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789265507.606722:0:19526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1789265507.607310:0:19513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789265507.607405:0:19513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789265507.607427:0:19513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2fe00/0x9272d942b4a97a31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97a38 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265507.607436:0:19513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2fe00/0x9272d942b4a97a31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97a38 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789265507.607751:0:19513:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789265507.607754:0:19513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789265507.607755:0:19513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265507.607756:0:19513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265507.607757:0:19513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265507.607759:0:19513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265507.607761:0:19513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265507.607763:0:19513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265507.607764:0:19513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789265507.607768:0:19513:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789265507.607770:0:19513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789265507.607772:0:19513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789265507.607773:0:19513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265507.607774:0:19513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265507.607774:0:19513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265507.607775:0:19513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265507.607777:0:19513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265507.607778:0:19513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265507.607779:0:19513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789265507.607809:0:19513:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789265507.607829:0:19513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417575296:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789265507.607893:0:19513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265507.608327:0:19513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd377840 going to sleep for 11 seconds 00000100:00100000:0.0:1789265507.608468:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417575296 00000100:00100000:0.0:1789265507.608476:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417575296 00000100:00100000:0.0:1789265507.608527:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789265507.608536:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+24:19513:x1876180417575296:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789265507.608560:0:17187:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789265507.608584:0:17187:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789265507.621877:0:17187:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789265507.621931:0:17187:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789265507.624331:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+24:19513:x1876180417575296:12345-0@lo:253:mount.lustre.0 Request processed in 15787us (16428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265507.624354:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 20000000:01000000:2.0:1789265507.624515:0:17208:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789265507.624521:0:17208:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789265507.624542:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a97a69 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265507.624559:0:17208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc882b6600/0x9272d942b4a979dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a979d6 expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265507.624567:0:17208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc882b6000/0x9272d942b4a979eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a979e4 expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265507.624587:0:17208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a97a69 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265507.624626:0:17208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc882b6000/0x9272d942b4a979eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a979e4 expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265507.624641:0:17208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcc882b6000/0x9272d942b4a979eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a979e4 expref: 23 pid: 17184 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265507.624654:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1876180417575424:0@lo:104: 00000100:00100000:2.0:1789265507.624691:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265507.624743:0:17208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc882b6600/0x9272d942b4a979dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a979d6 expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265507.624751:0:17208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcc882b6600/0x9272d942b4a979dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a979d6 expref: 23 pid: 17184 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265507.624759:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1876180417575552:0@lo:104: 00000100:00100000:2.0:1789265507.624782:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265507.624812:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83b876c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265507.624831:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417575424 00000100:00100000:2.0:1789265507.624839:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417575424 00000100:00100000:2.0:1789265507.624871:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417575552 00000100:00100000:2.0:1789265507.624874:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417575552 00000100:00100000:2.0:1789265507.624888:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265507.624895:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf609180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a57aa04c-0472-45c4-bafc-6983957e249b+4:17208:x1876180417575424:12345-0@lo:104: 00010000:00010000:2.0:1789265507.624988:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a979e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a979eb expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265507.625071:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265507.625077:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf609180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a57aa04c-0472-45c4-bafc-6983957e249b+4:17208:x1876180417575424:12345-0@lo:104: Request processed in 182us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265507.625084:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265507.625099:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789265507.625106:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf608700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a57aa04c-0472-45c4-bafc-6983957e249b+3:17208:x1876180417575552:12345-0@lo:104: 00010000:00010000:2.0:1789265507.625113:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a979d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a979dd expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265507.625215:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789265507.625221:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf608700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a57aa04c-0472-45c4-bafc-6983957e249b+3:17208:x1876180417575552:12345-0@lo:104: Request processed in 116us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265507.625226:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1789265507.625241:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265507.625247:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a979e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a979eb expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265507.625254:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5400 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265507.625257:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a979e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a979eb expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265507.625266:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a979e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a979eb expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265507.625605:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a979e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a979eb expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265507.625613:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265507.625652:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a979e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a979eb expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265507.625659:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265507.625679:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a979e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a979eb expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265507.625686:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5400/0x9272d942b4a979e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a979eb expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265507.625699:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265507.625703:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a979d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a979dd expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265507.625709:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e800 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265507.625713:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a979d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a979dd expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265507.625720:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a979d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a979dd expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265507.625726:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a979d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a979dd expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265507.625731:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265507.625743:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a979d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a979dd expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265507.625749:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265507.625755:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a979d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a979dd expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265507.625772:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a979d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a979dd expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265507.625787:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265507.625789:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265507.625791:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265507.625810:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265507.625829:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a57aa04c-0472-45c4-bafc-6983957e249b:3641:1876180417575680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265507.625864:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265507.625887:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265507.625893:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a57aa04c-0472-45c4-bafc-6983957e249b:3641:1876180417575808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265507.625987:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265507.626057:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417575680 00000100:00100000:2.0:1789265507.626062:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417575680 00000100:00100000:3.0:1789265507.626069:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417575808 00000100:00100000:3.0:1789265507.626076:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417575808 00010000:00010000:2.0:1789265507.626234:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc882b6000/0x9272d942b4a979eb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a979e4 expref: 25 pid: 17184 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265507.626267:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265507.626275:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf608e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a57aa04c-0472-45c4-bafc-6983957e249b+25:3641:x1876180417575680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265507.626286:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265507.626291:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc882b6000/0x9272d942b4a979eb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a979e4 expref: 25 pid: 17184 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265507.626301:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc882b6000/0x9272d942b4a979eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a979e4 expref: 25 pid: 17184 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265507.626316:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265507.626419:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf608e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a57aa04c-0472-45c4-bafc-6983957e249b+25:3641:x1876180417575680:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265507.626426:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789265507.626494:0:19513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a57aa04c-0472-45c4-bafc-6983957e249b:19513:1876180417575296:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789265507.626507:0:19513:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789265507.626510:0:19513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789265507.626512:0:19513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789265507.626513:0:19513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265507.626514:0:19513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265507.626516:0:19513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265507.626517:0:19513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265507.626519:0:19513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265507.626520:0:19513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265507.626521:0:19513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789265507.626537:0:19513:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1789265507.629192:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc882b6600/0x9272d942b4a979dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a979d6 expref: 25 pid: 17184 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265507.629243:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265507.629262:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a57aa04c-0472-45c4-bafc-6983957e249b+25:3641:x1876180417575808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265507.629275:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265507.629281:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc882b6600/0x9272d942b4a979dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a979d6 expref: 25 pid: 17184 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265507.629306:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc882b6600/0x9272d942b4a979dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a979d6 expref: 25 pid: 17184 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265507.629347:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a97a69 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265507.629356:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a97a69 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789265507.629373:0:17179:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006048022s 00010000:00010000:3.0:1789265507.629378:0:17179:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a97a69 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265507.629384:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a97a69 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265507.629390:0:17179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a97a69 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265507.629397:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a97a69 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265507.629403:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f800 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265507.629407:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a97a69 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265507.629414:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a97a69 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265507.629423:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a97a69 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265507.629441:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265507.629508:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a57aa04c-0472-45c4-bafc-6983957e249b+25:3641:x1876180417575808:12345-0@lo:103:ldlm_bl.0 Request processed in 257us (3520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265507.629516:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789265507.630069:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a57aa04c-0472-45c4-bafc-6983957e249b:3641:1876180417575808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265507.630085:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a57aa04c-0472-45c4-bafc-6983957e249b:3641:1876180417575680:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265507.630102:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b6000/0x9272d942b4a979eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a979e4 expref: 23 pid: 17184 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265507.630116:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1876180417575424:0@lo:104: 00010000:00010000:3.0:1789265507.630129:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b6600/0x9272d942b4a979dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a979d6 expref: 22 pid: 17184 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265507.630137:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17208:1876180417575552:0@lo:104: 00010000:00010000:3.0:1789265507.630157:0:17208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a97a69 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265507.630166:0:17208:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a97a69 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265507.630172:0:17208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a97a69 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265507.630179:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a97a69 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1789265507.647628:0:19513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789265507.650662:0:19513:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789265507.650672:0:19513:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789265507.650709:0:19513:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789265507.650763:0:19513:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.149@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789265507.650780:0:19513:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1789265507.650807:0:19513:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1789265507.651667:0:19513:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789265507.651932:0:19513:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789265507.841137:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265508.354344:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417575936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265508.354428:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265508.354487:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417575936 00000100:00100000:0.0:1789265508.354494:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417575936 00000100:00100000:0.0:1789265508.354549:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789265508.354565:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417575936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789265508.354598:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789265508.354601:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83daa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417576064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265508.354638:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417575936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265508.354644:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265508.354645:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789265508.354660:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417576064 00000100:00100000:0.0:1789265508.354663:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417576064 00000100:00100000:0.0:1789265508.354682:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789265508.354687:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83daaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417576064:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265508.354701:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417575936:0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789265508.354702:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789265508.354733:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83daaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417576064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 45us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265508.354739:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789265508.354740:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83daa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417576064:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265508.367070:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265508.367376:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417576192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265508.367496:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265508.367725:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417576192 00000100:00100000:0.0:1789265508.367734:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417576192 00000100:00100000:0.0:1789265508.367781:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265508.367800:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417576192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789265508.367833:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789265508.367885:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417576192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265508.367893:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789265508.367934:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83efc380 x1876180417576192/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265508.367953:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417576192:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265508.611144:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265488/real 1789265488] req@ffff9fcb83f32a00 x1876180417563392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265508 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265508.611176:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb83f32a00 x1876180417563392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265508 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265508.611185:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265488/real 1789265488] req@ffff9fcb83f32300 x1876180417563520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265508 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265508.611195:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb83f32300 x1876180417563520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265508 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789265508.611213:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccbf44b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789265508.611233:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789265508.611237:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417563392:0@lo:8:kworker.0 00000100:00080000:2.0:1789265508.611243:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb8391e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789265508.611248:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789265508.611250:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417563520:0@lo:8:kworker.0 00000100:00080000:1.0:1789265508.611398:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265508.611403:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789265508.611405:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fccbf44b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789265508.611410:0:17249:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 540 00000100:00080000:1.0:1789265508.611416:0:17249:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789265508.611422:0:17249:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fccbf44b800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:1.0:1789265508.611444:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83da8e00 x1876180417576448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265508.611456:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265508.611468:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789265508.611471:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fcb8391e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789265508.611474:0:17249:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 540 00000100:00080000:1.0:1789265508.611476:0:17249:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789265508.611480:0:17249:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fcb8391e800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:1.0:1789265508.611493:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83da8000 x1876180417576576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265508.611519:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265508.611522:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789265508.611523:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fccad90f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789265508.611528:0:17249:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fccad90f000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:1.0:1789265508.611540:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fccbd3e7480 x1876180417576832/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265508.611594:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83daad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417576704:0@lo:400:kworker.0 00000100:00100000:1.0:1789265508.611669:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265508.611698:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417577344:0@lo:400:kworker.0 00000100:00100000:1.0:1789265508.611726:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265508.611749:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789265508.611755:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417576960:0@lo:400:kworker.0 00000100:00100000:1.0:1789265508.611776:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265508.611804:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417577472:0@lo:400:kworker.0 00000100:00100000:1.0:1789265508.611830:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265508.611863:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417576704 00000100:00100000:1.0:1789265508.611872:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417576704 00000100:00100000:1.0:1789265508.611912:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417577344 00000100:00100000:1.0:1789265508.611923:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417577344 00000100:00100000:1.0:1789265508.611950:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417576960 00000100:00100000:1.0:1789265508.611952:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417576960 00000100:00100000:1.0:1789265508.611961:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417577472 00000100:00100000:1.0:1789265508.611963:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417577472 00000100:00100000:1.0:1789265508.611979:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789265508.611987:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417576704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265508.612063:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417576704:12345-0@lo:400:kworker.0 Request processed in 75us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265508.612070:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789265508.612085:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789265508.612092:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417577344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265508.612119:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417577344:12345-0@lo:400:kworker.0 Request processed in 28us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265508.612125:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789265508.612136:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789265508.612142:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417576960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265508.612171:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417576960:12345-0@lo:400:kworker.0 Request processed in 28us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265508.612177:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789265508.612188:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789265508.612193:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417577472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265508.612216:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417577472:12345-0@lo:400:kworker.0 Request processed in 24us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265508.612222:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789265508.612244:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265508.612248:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789265508.612279:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83e2ca80 x1876180417576960/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265508.612291:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417576960:0@lo:400:kworker.0 00010000:00080000:1.0:1789265508.612301:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83e2ed80 x1876180417577472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265508.612309:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417577472:0@lo:400:kworker.0 00010000:00080000:1.0:1789265508.612319:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83daad80 x1876180417576704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265508.612326:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83daad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417576704:0@lo:400:kworker.0 00010000:00080000:1.0:1789265508.612334:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83e2d500 x1876180417577344/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265508.612341:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417577344:0@lo:400:kworker.0 00000100:00100000:2.0:1789265508.613386:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83daa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a57aa04c-0472-45c4-bafc-6983957e249b:3642:1876180417576320:0@lo:400:kworker.0 00000100:00100000:2.0:1789265508.613446:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265508.613490:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417577216:0@lo:400:kworker.0 00000100:00100000:2.0:1789265508.613527:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265508.613554:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265508.613560:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417577088:0@lo:400:kworker.0 00000100:00100000:2.0:1789265508.613582:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265508.613625:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417577216 00000100:00100000:2.0:1789265508.613632:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417577216 00000100:00100000:2.0:1789265508.613669:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417577088 00000100:00100000:2.0:1789265508.613673:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417577088 00000100:00100000:2.0:1789265508.613688:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265508.613694:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417577216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265508.613737:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417577216:12345-0@lo:400:kworker.0 Request processed in 42us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265508.613744:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265508.613760:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789265508.613766:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417577088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265508.613804:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417577088:12345-0@lo:400:kworker.0 Request processed in 38us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265508.613809:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1789265508.613894:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83e2f800 x1876180417577088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265508.613906:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417577088:0@lo:400:kworker.0 00010000:00080000:2.0:1789265508.613916:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83e2c700 x1876180417577216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265508.613923:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417577216:0@lo:400:kworker.0 00000100:00100000:2.0:1789265508.613949:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417576448:0@lo:8:kworker.0 00000100:00100000:2.0:1789265508.613984:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265508.614003:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417576576:0@lo:8:kworker.0 00000100:00100000:2.0:1789265508.614063:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265508.614086:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd3e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417576832:0@lo:8:kworker.0 00000100:00100000:2.0:1789265508.614111:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265508.614137:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417576448 00000100:00100000:2.0:1789265508.614141:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417576448 00000100:00100000:2.0:1789265508.614161:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417576576 00000100:00100000:2.0:1789265508.614164:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417576576 00000100:00100000:2.0:1789265508.614170:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417576832 00000100:00100000:2.0:1789265508.614173:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417576832 00000100:00100000:2.0:1789265508.614181:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265508.614186:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1876180417576448:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789265508.614211:0:18701:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:2.0:1789265508.614240:0:18701:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9272d942b4a97a70 00002000:00100000:2.0:1789265508.614253:0:18701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9fcb821ea800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789265508.614257:0:18701:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789265508.614259:0:18701:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789265508.614336:0:18701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789265508.614360:0:18701:0:(import.c:65:import_set_state_nolock()) ffff9fcb821ed800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265508.614412:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1876180417576448:12345-0@lo:8:kworker.0 Request processed in 225us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265508.614419:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265508.614431:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265508.614435:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1876180417576576:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789265508.614451:0:18701:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:2.0:1789265508.614468:0:18701:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9272d942b4a97a77 00002000:00100000:2.0:1789265508.614481:0:18701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9fcb821ed000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789265508.614484:0:18701:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789265508.614486:0:18701:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789265508.614628:0:18701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789265508.614642:0:18701:0:(import.c:65:import_set_state_nolock()) ffff9fcb821ef800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265508.614674:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1876180417576576:12345-0@lo:8:kworker.0 Request processed in 236us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265508.614680:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265508.614692:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789265508.614696:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1876180417576832:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789265508.614711:0:18701:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:2.0:1789265508.614727:0:18701:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9272d942b4a97a7e 00002000:00100000:2.0:1789265508.614732:0:18701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9fcb821ec800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1789265508.614736:0:18701:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1789265508.614738:0:18701:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789265508.614758:0:18701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1789265508.614769:0:18701:0:(import.c:65:import_set_state_nolock()) ffff9fcb821ee800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265508.614810:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1876180417576832:12345-0@lo:8:kworker.0 Request processed in 112us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265508.614816:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789265508.614858:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83da8e00 x1876180417576448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265508.614867:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789265508.614873:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789265508.614881:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789265508.614886:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789265508.614895:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccbf44b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789265508.614939:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789265508.614945:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417576448:0@lo:8:kworker.0 00010000:00080000:2.0:1789265508.614959:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83da8000 x1876180417576576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265508.614965:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789265508.614969:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789265508.614974:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789265508.614976:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789265508.614978:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb8391e800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789265508.614988:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789265508.614991:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417576576:0@lo:8:kworker.0 00010000:00080000:2.0:1789265508.614999:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd3e7480 x1876180417576832/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789265508.615006:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789265508.615010:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789265508.615012:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789265508.615014:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccad90f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789265508.615047:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789265508.615051:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd3e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417576832:0@lo:8:kworker.0 00000004:00080000:2.0:1789265508.615100:0:17217:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1789265508.615116:0:17217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84a3d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17217:1876180417577728:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789265508.615141:0:17217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265508.615155:0:17217:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacd3c900 going to sleep for 11 seconds 00000004:00080000:2.0:1789265508.615177:0:17938:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789265508.615190:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84a3ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17938:1876180417577984:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1789265508.615219:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265508.615233:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacd3c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265508.615246:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417577728 00000100:00100000:2.0:1789265508.615251:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417577728 00000100:00100000:2.0:1789265508.615282:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417577984 00000100:00100000:2.0:1789265508.615286:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417577984 00000100:00100000:2.0:1789265508.615301:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789265508.615308:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17217:x1876180417577728:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789265508.615554:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789265508.615562:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17938:x1876180417577984:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:2.0:1789265508.615692:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265508.615696:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265508.615709:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417577856:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265508.615737:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265508.615761:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265508.615766:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417577600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265508.615797:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265508.615822:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417577856 00000100:00100000:2.0:1789265508.615826:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417577856 00000100:00100000:2.0:1789265508.615900:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417577600 00000100:00100000:2.0:1789265508.615903:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417577600 00000100:00100000:2.0:1789265508.615918:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265508.615923:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3642:x1876180417577856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789265508.615935:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923533824 avail 3692011520 00000100:00100000:2.0:1789265508.615981:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3642:x1876180417577856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265508.615987:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265508.616005:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265508.616010:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1876180417577600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265508.616019:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789265508.616063:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1876180417577600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265508.616068:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789265508.616718:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb84a3d880 x1876180417577600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265508.616737:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417577600:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1789265508.616749:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb84a3f100 x1876180417577856/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265508.616760:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417577856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265508.616937:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417576320 00000100:00100000:1.0:1789265508.616942:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417576320 00000100:00100000:1.0:1789265508.616978:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789265508.616986:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+22:3642:x1876180417576320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265508.617048:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+22:3642:x1876180417576320:12345-0@lo:400:kworker.0 Request processed in 63us (3602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265508.617054:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000004:00080000:1.0:1789265508.617109:0:17219:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1789265508.617123:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17219:1876180417578240:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789265508.617145:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265508.617158:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc88495000 going to sleep for 11 seconds 00000100:00100000:1.0:1789265508.617176:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265508.617184:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417578112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265508.617205:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789265508.621215:0:17216:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789265508.621325:0:17216:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 559851301627ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789265508.621360:0:17216:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:00000004:1.0:1789265508.623462:0:19581:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789265508.623708:0:19581:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000004:00080000:3.0:1789265508.624730:0:17218:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789265508.624830:0:17218:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 559854807073ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789265508.624839:0:17218:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1789265508.624855:0:17937:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789265508.624890:0:17937:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 559854867246ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789265508.624894:0:17937:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789265508.625857:0:19247:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1789265508.625871:0:19247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1789265508.625895:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417578112 00000100:00100000:2.0:1789265508.625905:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417578112 00000004:00080000:0.0:1789265508.625914:0:17172:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1789265508.625963:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789265508.625972:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876180417578112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265508.625998:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923533824 avail 3692011520 00000100:00100000:2.0:1789265508.626100:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876180417578112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (8892us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265508.626107:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789265508.626152:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83bb8700 x1876180417578112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265508.626175:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417578112:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789265508.626217:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265508.626242:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83daa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a57aa04c-0472-45c4-bafc-6983957e249b:3642:1876180417576320:0@lo:400:kworker.0 00002000:00080000:2.0:1789265508.626264:0:18700:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789265508.626273:0:18700:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789265508.626279:0:18700:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000004:00080000:0.0:1789265508.628222:0:17926:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1789265508.629120:0:19247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417578240 00000100:00100000:0.0:1789265508.629131:0:19247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417578240 00000004:00080000:0.0:1789265508.629904:0:17172:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1789265508.634628:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265508.634646:0:19582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17219:x1876180417578240:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1789265508.635600:0:18702:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1789265508.635608:0:18702:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789265508.635760:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17938:x1876180417577984:12345-0@lo:7:osp-pre-1-1.0 Request processed in 20197us (20537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265508.635770:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1789265508.635809:0:17938:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb84a3ed80 x1876180417577984/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789265524 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265508.635827:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84a3ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17938:1876180417577984:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1789265508.635842:0:17938:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789265508.635884:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bbb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17938:1876180417578368:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789265508.635923:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265508.635953:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc88495300 going to sleep for 11 seconds 00000100:00100000:0.0:1789265508.636100:0:19247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417578368 00000100:00100000:0.0:1789265508.636106:0:19247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417578368 00000100:00100000:0.0:1789265508.636141:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265508.636149:0:19247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17938:x1876180417578368:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1789265508.636168:0:19247:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1789265508.636202:0:19247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17938:x1876180417578368:12345-0@lo:5:osp-pre-1-1.0 Request processed in 54us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265508.636209:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1789265508.636235:0:17938:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83bbb100 x1876180417578368/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265524 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265508.636245:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bbb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17938:1876180417578368:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1789265508.636252:0:17938:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789265508.636288:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17938:1876180417578496:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789265508.636435:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265508.636459:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3b3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265508.636474:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417578496 00000100:00100000:0.0:1789265508.636483:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417578496 00000100:00100000:0.0:1789265508.636507:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789265508.636513:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17938:x1876180417578496:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1789265508.636535:0:18701:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:0.0:1789265508.638192:0:19582:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1789265508.638204:0:19582:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1789265508.638209:0:19582:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00010000:2.0:1789265508.643280:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265508.643295:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030c8943b/0x9272d942b4a97a85 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.643314:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789265508.643319:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265508.643326:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030c8943b/0x9272d942b4a97a85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.643747:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030c8943b/0x9272d942b4a97a85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.643758:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030c8943b/0x9272d942b4a97a85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.643765:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030c8943b/0x9272d942b4a97a85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.643798:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265508.644102:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265508.644110:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030c8943b/0x9272d942b4a97a85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.644119:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f400 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265508.644123:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030c8943b/0x9272d942b4a97a85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.644132:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030c8943b/0x9272d942b4a97a85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.644153:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030c8943b/0x9272d942b4a97a85 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.644160:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030c8943b/0x9272d942b4a97a85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.644189:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.644190:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.644192:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265508.644495:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265508.644502:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a97a8c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.644519:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789265508.644523:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265508.644529:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a97a8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.644541:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a97a8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.644549:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a97a8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.644557:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a97a8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.646993:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789265508.651844:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265508.651857:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e57277bc/0x9272d942b4a97a93 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.651874:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789265508.651879:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265508.651886:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e57277bc/0x9272d942b4a97a93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.651900:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e57277bc/0x9272d942b4a97a93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.651923:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e57277bc/0x9272d942b4a97a93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.651931:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e57277bc/0x9272d942b4a97a93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.652363:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265508.652372:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a97a8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.652382:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e600 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265508.652387:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a97a8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.652396:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a97a8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.652415:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a97a8c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.652423:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a97a8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.652442:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265508.652445:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e57277bc/0x9272d942b4a97a93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.652451:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2fa00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265508.652460:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e57277bc/0x9272d942b4a97a93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.652467:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e57277bc/0x9272d942b4a97a93 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.652477:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e57277bc/0x9272d942b4a97a93 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.652484:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.652486:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.652488:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265508.657770:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789265508.657782:0:18700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e57277bc/0x9272d942b4a97a93 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265508.659076:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265508.659088:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008987ee09/0x9272d942b4a97a9a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.659105:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789265508.659110:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265508.659117:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008987ee09/0x9272d942b4a97a9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.659131:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008987ee09/0x9272d942b4a97a9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.659142:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008987ee09/0x9272d942b4a97a9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.659164:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008987ee09/0x9272d942b4a97a9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789265508.663344:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265508.663359:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcdedf3b/0x9272d942b4a97aa1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.663378:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1789265508.663382:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265508.663389:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcdedf3b/0x9272d942b4a97aa1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.663408:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcdedf3b/0x9272d942b4a97aa1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.663419:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcdedf3b/0x9272d942b4a97aa1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.663427:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcdedf3b/0x9272d942b4a97aa1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.663770:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265508.663780:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008987ee09/0x9272d942b4a97a9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.663801:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f200 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265508.663806:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008987ee09/0x9272d942b4a97a9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.663815:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008987ee09/0x9272d942b4a97a9a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.663834:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008987ee09/0x9272d942b4a97a9a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.663845:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265508.663857:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcdedf3b/0x9272d942b4a97aa1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.663864:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5800 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265508.663868:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcdedf3b/0x9272d942b4a97aa1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.663875:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcdedf3b/0x9272d942b4a97aa1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.663888:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcdedf3b/0x9272d942b4a97aa1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.663896:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.663898:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.663900:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265508.664004:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789265508.664011:0:18700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008987ee09/0x9272d942b4a97a9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.664616:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265508.664731:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265508.664737:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011eb152d/0x9272d942b4a97aa8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.664750:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789265508.664754:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265508.664759:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011eb152d/0x9272d942b4a97aa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.664770:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011eb152d/0x9272d942b4a97aa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.664779:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011eb152d/0x9272d942b4a97aa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.664797:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011eb152d/0x9272d942b4a97aa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.664852:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265508.665139:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265508.665145:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcdedf3b/0x9272d942b4a97aa1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.665611:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265508.665617:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011eb152d/0x9272d942b4a97aa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.665627:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2ee00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265508.665631:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011eb152d/0x9272d942b4a97aa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.665640:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011eb152d/0x9272d942b4a97aa8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.665657:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011eb152d/0x9272d942b4a97aa8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.665665:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011eb152d/0x9272d942b4a97aa8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.665681:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265508.665683:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265508.665685:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265508.665860:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265508.665867:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4f5d45e/0x9272d942b4a97aaf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.665878:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1789265508.665882:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265508.665887:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4f5d45e/0x9272d942b4a97aaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.665899:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4f5d45e/0x9272d942b4a97aaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.665908:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4f5d45e/0x9272d942b4a97aaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.665916:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4f5d45e/0x9272d942b4a97aaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.665928:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265508.667172:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265508.667181:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4f5d45e/0x9272d942b4a97aaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.667192:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4600 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265508.667202:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4f5d45e/0x9272d942b4a97aaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.667211:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4f5d45e/0x9272d942b4a97aaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.667228:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4f5d45e/0x9272d942b4a97aaf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.667236:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4f5d45e/0x9272d942b4a97aaf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.667252:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265508.667254:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265508.667255:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265508.667441:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265508.667448:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97ab6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.667458:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789265508.667462:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265508.667466:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97ab6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.667477:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97ab6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.667485:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97ab6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.667510:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97ab6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.667529:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265508.667538:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265508.667542:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97ab6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.667549:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e000 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265508.667552:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97ab6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.667560:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97ab6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.667571:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97ab6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.667578:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97ab6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.667593:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265508.667594:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265508.667596:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265508.670446:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265508.670468:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccb0e6c9/0x9272d942b4a97abd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.670486:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789265508.670491:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265508.670499:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccb0e6c9/0x9272d942b4a97abd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.670515:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccb0e6c9/0x9272d942b4a97abd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.670526:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccb0e6c9/0x9272d942b4a97abd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.670533:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ccb0e6c9/0x9272d942b4a97abd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.670557:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265508.670576:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265508.670582:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ccb0e6c9/0x9272d942b4a97abd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.670590:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e800 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265508.670594:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccb0e6c9/0x9272d942b4a97abd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.670603:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccb0e6c9/0x9272d942b4a97abd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.670628:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ccb0e6c9/0x9272d942b4a97abd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.670635:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccb0e6c9/0x9272d942b4a97abd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.670657:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265508.670659:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265508.670661:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265508.673644:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265508.673658:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a97ac4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.673675:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1789265508.673680:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265508.673694:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a97ac4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.673709:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a97ac4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.673719:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a97ac4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.673727:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a97ac4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.673750:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789265508.674080:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265508.674087:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a200a1fb/0x9272d942b4a97acb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.674096:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1789265508.674100:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265508.674104:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a200a1fb/0x9272d942b4a97acb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.674114:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a200a1fb/0x9272d942b4a97acb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.674132:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a200a1fb/0x9272d942b4a97acb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.674138:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a200a1fb/0x9272d942b4a97acb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.674146:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789265508.674578:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265508.674585:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baf16215/0x9272d942b4a97ad2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.674594:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1789265508.674597:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265508.674601:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baf16215/0x9272d942b4a97ad2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.674610:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baf16215/0x9272d942b4a97ad2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.674617:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baf16215/0x9272d942b4a97ad2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.674623:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000baf16215/0x9272d942b4a97ad2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.674643:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1789265508.675222:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265508.675229:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037762089/0x9272d942b4a97ad9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.675239:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1789265508.675242:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265508.675246:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037762089/0x9272d942b4a97ad9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.675257:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037762089/0x9272d942b4a97ad9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.675265:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037762089/0x9272d942b4a97ad9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.675283:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037762089/0x9272d942b4a97ad9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.675292:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1789265508.675551:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265508.675558:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000172d0669/0x9272d942b4a97ae0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.675566:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1789265508.675569:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265508.675573:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000172d0669/0x9272d942b4a97ae0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.675581:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000172d0669/0x9272d942b4a97ae0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.675589:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000172d0669/0x9272d942b4a97ae0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.675595:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000172d0669/0x9272d942b4a97ae0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.675605:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1789265508.676988:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789265508.677002:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a97ac4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.677014:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4e00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265508.677019:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a97ac4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.677043:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a97ac4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.677080:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a97ac4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.677089:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a97ac4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.677452:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789265508.677459:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a200a1fb/0x9272d942b4a97acb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.677466:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f53e00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265508.677469:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a200a1fb/0x9272d942b4a97acb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.677477:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a200a1fb/0x9272d942b4a97acb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.677489:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a200a1fb/0x9272d942b4a97acb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.677496:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a200a1fb/0x9272d942b4a97acb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.677514:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789265508.677518:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000baf16215/0x9272d942b4a97ad2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.677530:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f52400 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265508.677533:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000baf16215/0x9272d942b4a97ad2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.677541:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000baf16215/0x9272d942b4a97ad2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.677552:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000baf16215/0x9272d942b4a97ad2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.677559:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baf16215/0x9272d942b4a97ad2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.677571:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265508.677575:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037762089/0x9272d942b4a97ad9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.677582:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5e00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265508.677585:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037762089/0x9272d942b4a97ad9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.677591:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037762089/0x9272d942b4a97ad9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.677600:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037762089/0x9272d942b4a97ad9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.677612:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037762089/0x9272d942b4a97ad9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.677625:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265508.677628:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000172d0669/0x9272d942b4a97ae0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.677634:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f53400 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265508.677637:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000172d0669/0x9272d942b4a97ae0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.677644:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000172d0669/0x9272d942b4a97ae0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.677654:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000172d0669/0x9272d942b4a97ae0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.677660:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000172d0669/0x9272d942b4a97ae0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.677672:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.677673:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.677675:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265508.677973:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265508.677981:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005860456a/0x9272d942b4a97ae7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.677992:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1789265508.678006:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265508.678012:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005860456a/0x9272d942b4a97ae7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.678054:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005860456a/0x9272d942b4a97ae7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.678064:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005860456a/0x9272d942b4a97ae7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.678071:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005860456a/0x9272d942b4a97ae7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.678092:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789265508.678487:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265508.678494:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f2d02d9/0x9272d942b4a97aee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.678502:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1789265508.678505:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265508.678509:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f2d02d9/0x9272d942b4a97aee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.678519:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f2d02d9/0x9272d942b4a97aee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.678527:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f2d02d9/0x9272d942b4a97aee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.678540:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f2d02d9/0x9272d942b4a97aee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.678548:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789265508.678970:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265508.678977:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a97af5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.678986:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1789265508.678989:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265508.678993:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a97af5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.679002:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a97af5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.679010:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a97af5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.679018:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a97af5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.679043:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1789265508.680056:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265508.680065:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc304ce6/0x9272d942b4a97afc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.680079:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1789265508.680083:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265508.680088:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc304ce6/0x9272d942b4a97afc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.680099:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc304ce6/0x9272d942b4a97afc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.680107:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc304ce6/0x9272d942b4a97afc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.680114:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc304ce6/0x9272d942b4a97afc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.680125:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1789265508.680753:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265508.680760:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089896d30/0x9272d942b4a97b03 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.680777:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1789265508.680780:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265508.680784:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089896d30/0x9272d942b4a97b03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.680806:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089896d30/0x9272d942b4a97b03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.680813:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089896d30/0x9272d942b4a97b03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.680821:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089896d30/0x9272d942b4a97b03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.680830:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1789265508.681660:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789265508.681671:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005860456a/0x9272d942b4a97ae7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.681689:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f53800 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265508.681694:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005860456a/0x9272d942b4a97ae7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.681704:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005860456a/0x9272d942b4a97ae7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.681724:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005860456a/0x9272d942b4a97ae7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.681732:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005860456a/0x9272d942b4a97ae7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.681754:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789265508.681758:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f2d02d9/0x9272d942b4a97aee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.681764:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f52800 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265508.681766:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f2d02d9/0x9272d942b4a97aee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.681773:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f2d02d9/0x9272d942b4a97aee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.681782:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f2d02d9/0x9272d942b4a97aee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.681807:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f2d02d9/0x9272d942b4a97aee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.681821:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789265508.681825:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a97af5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.681832:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4800 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265508.681835:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a97af5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.681843:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a97af5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.681854:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a97af5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.681860:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a97af5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.681873:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265508.681877:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc304ce6/0x9272d942b4a97afc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.681883:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff000 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265508.681892:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc304ce6/0x9272d942b4a97afc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.681900:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc304ce6/0x9272d942b4a97afc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.681911:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc304ce6/0x9272d942b4a97afc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.681917:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc304ce6/0x9272d942b4a97afc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.681930:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265508.681934:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089896d30/0x9272d942b4a97b03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.681940:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4c00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265508.681943:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089896d30/0x9272d942b4a97b03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.681951:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089896d30/0x9272d942b4a97b03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.681961:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089896d30/0x9272d942b4a97b03 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.681968:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089896d30/0x9272d942b4a97b03 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.681987:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.681989:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.681991:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265508.682188:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265508.682196:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb31d0cf/0x9272d942b4a97b0a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.682212:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1789265508.682215:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265508.682220:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb31d0cf/0x9272d942b4a97b0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.682232:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb31d0cf/0x9272d942b4a97b0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.682240:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb31d0cf/0x9272d942b4a97b0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.682248:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb31d0cf/0x9272d942b4a97b0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.682265:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789265508.682545:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265508.682551:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97b11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.682559:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1789265508.682562:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265508.682566:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97b11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.682574:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97b11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.682592:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97b11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.682598:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97b11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.682606:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789265508.683107:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265508.683116:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb31d0cf/0x9272d942b4a97b0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.683125:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff600 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265508.683129:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb31d0cf/0x9272d942b4a97b0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.683137:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb31d0cf/0x9272d942b4a97b0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.683152:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb31d0cf/0x9272d942b4a97b0a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.683159:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb31d0cf/0x9272d942b4a97b0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.683187:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265508.683191:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97b11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.683197:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5400 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265508.683200:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97b11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.683207:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97b11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.683218:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97b11 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.683225:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97b11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.683240:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265508.683241:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265508.683243:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.683723:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265508.684156:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265508.684164:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f60886c/0x9272d942b4a97b18 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.684177:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789265508.684188:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265508.684195:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f60886c/0x9272d942b4a97b18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.684208:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f60886c/0x9272d942b4a97b18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.684217:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f60886c/0x9272d942b4a97b18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.684224:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f60886c/0x9272d942b4a97b18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.684241:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265508.684251:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265508.684256:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f60886c/0x9272d942b4a97b18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.684263:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f800 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265508.684267:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f60886c/0x9272d942b4a97b18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.684275:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f60886c/0x9272d942b4a97b18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.684289:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f60886c/0x9272d942b4a97b18 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.684308:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f60886c/0x9272d942b4a97b18 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.684328:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265508.684334:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265508.684337:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265508.687950:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265508.687968:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008987ee09/0x9272d942b4a97b1f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.687986:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789265508.687992:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265508.687999:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008987ee09/0x9272d942b4a97b1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.688016:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008987ee09/0x9272d942b4a97b1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.688054:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008987ee09/0x9272d942b4a97b1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.688063:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008987ee09/0x9272d942b4a97b1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.688090:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265508.688949:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265508.688959:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008987ee09/0x9272d942b4a97b1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.688970:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f200 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265508.688975:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008987ee09/0x9272d942b4a97b1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.688984:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008987ee09/0x9272d942b4a97b1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.689018:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008987ee09/0x9272d942b4a97b1f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.689051:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008987ee09/0x9272d942b4a97b1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.689070:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265508.689072:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265508.689074:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265508.689213:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265508.689225:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e57277bc/0x9272d942b4a97b26 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.689235:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789265508.689239:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265508.689245:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e57277bc/0x9272d942b4a97b26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.689257:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e57277bc/0x9272d942b4a97b26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.689265:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e57277bc/0x9272d942b4a97b26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.689273:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e57277bc/0x9272d942b4a97b26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.689300:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265508.689679:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265508.689686:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e57277bc/0x9272d942b4a97b26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.689695:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2fa00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265508.689699:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e57277bc/0x9272d942b4a97b26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.689708:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e57277bc/0x9272d942b4a97b26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.689722:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e57277bc/0x9272d942b4a97b26 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.689729:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e57277bc/0x9272d942b4a97b26 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.689755:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265508.689757:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265508.689759:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265508.689864:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265508.689871:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081f97a95/0x9272d942b4a97b2d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.689881:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789265508.689884:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265508.689889:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081f97a95/0x9272d942b4a97b2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.689899:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081f97a95/0x9272d942b4a97b2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.689916:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081f97a95/0x9272d942b4a97b2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.689923:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081f97a95/0x9272d942b4a97b2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.689945:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265508.690227:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265508.690233:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081f97a95/0x9272d942b4a97b2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.690241:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e200 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265508.690244:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081f97a95/0x9272d942b4a97b2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.690252:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081f97a95/0x9272d942b4a97b2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.690264:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081f97a95/0x9272d942b4a97b2d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.690271:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081f97a95/0x9272d942b4a97b2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.690286:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265508.690288:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265508.690289:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265508.690368:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265508.690374:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a97b34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.690383:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789265508.690386:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265508.690390:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a97b34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.690399:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a97b34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.690405:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a97b34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.690413:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a97b34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.690443:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265508.690942:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265508.690952:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a97b34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.690971:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e600 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265508.690974:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a97b34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.690982:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a97b34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.690997:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a97b34 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.691005:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008efefd8/0x9272d942b4a97b34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.691068:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265508.691071:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265508.691072:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265508.696604:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265508.696617:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013f94fd2/0x9272d942b4a97b3b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.696635:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1789265508.696640:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265508.696648:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013f94fd2/0x9272d942b4a97b3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.696663:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013f94fd2/0x9272d942b4a97b3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.696683:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013f94fd2/0x9272d942b4a97b3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.696691:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013f94fd2/0x9272d942b4a97b3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.696710:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789265508.698118:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265508.698128:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de66319c/0x9272d942b4a97b42 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.698142:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=559s v=(0 0) 00010000:00010000:3.0:1789265508.698146:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265508.698151:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de66319c/0x9272d942b4a97b42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.698163:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de66319c/0x9272d942b4a97b42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.698171:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de66319c/0x9272d942b4a97b42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.698178:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de66319c/0x9272d942b4a97b42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.698201:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789265508.698730:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265508.698738:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013f94fd2/0x9272d942b4a97b3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.698748:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fe600 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265508.698752:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013f94fd2/0x9272d942b4a97b3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.698762:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013f94fd2/0x9272d942b4a97b3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.698779:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013f94fd2/0x9272d942b4a97b3b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.698797:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013f94fd2/0x9272d942b4a97b3b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.698816:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265508.698827:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de66319c/0x9272d942b4a97b42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.698835:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6600 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265508.698838:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de66319c/0x9272d942b4a97b42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.698846:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de66319c/0x9272d942b4a97b42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.698858:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de66319c/0x9272d942b4a97b42 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.698865:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de66319c/0x9272d942b4a97b42 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.698880:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265508.698881:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265508.698882:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265508.698889:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265508.698938:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265508.698944:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079664685/0x9272d942b4a97b49 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.698953:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1789265508.698956:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265508.698961:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079664685/0x9272d942b4a97b49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.698982:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079664685/0x9272d942b4a97b49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.698990:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079664685/0x9272d942b4a97b49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.698997:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079664685/0x9272d942b4a97b49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.699484:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789265508.700316:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265508.700324:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055fb4c0e/0x9272d942b4a97b50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.700347:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1789265508.700351:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265508.700357:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055fb4c0e/0x9272d942b4a97b50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.700369:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055fb4c0e/0x9272d942b4a97b50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.700377:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055fb4c0e/0x9272d942b4a97b50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.700395:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055fb4c0e/0x9272d942b4a97b50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.700495:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265508.700503:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079664685/0x9272d942b4a97b49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.700511:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fee00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265508.700514:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079664685/0x9272d942b4a97b49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.700522:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079664685/0x9272d942b4a97b49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.700537:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079664685/0x9272d942b4a97b49 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.700544:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079664685/0x9272d942b4a97b49 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.700558:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265508.700567:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055fb4c0e/0x9272d942b4a97b50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.700572:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fe200 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265508.700575:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055fb4c0e/0x9272d942b4a97b50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.700582:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055fb4c0e/0x9272d942b4a97b50 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.700591:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055fb4c0e/0x9272d942b4a97b50 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.700598:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265508.700599:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265508.700601:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265508.704510:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789265508.704526:0:18700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055fb4c0e/0x9272d942b4a97b50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.706694:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265508.710851:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265508.710865:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016fb9522/0x9272d942b4a97b57 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.710898:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=559s v=(0 0) 00010000:00010000:3.0:1789265508.710902:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265508.710910:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016fb9522/0x9272d942b4a97b57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.710924:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016fb9522/0x9272d942b4a97b57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.710934:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016fb9522/0x9272d942b4a97b57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.710942:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016fb9522/0x9272d942b4a97b57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.710968:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265508.711054:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265508.711062:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016fb9522/0x9272d942b4a97b57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.711070:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6000 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265508.711075:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016fb9522/0x9272d942b4a97b57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.711084:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016fb9522/0x9272d942b4a97b57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.711113:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016fb9522/0x9272d942b4a97b57 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.711122:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016fb9522/0x9272d942b4a97b57 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.711140:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265508.711142:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265508.711144:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265508.711195:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265508.711200:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcdedf3b/0x9272d942b4a97b5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.711208:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1789265508.711211:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265508.711215:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcdedf3b/0x9272d942b4a97b5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.711224:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcdedf3b/0x9272d942b4a97b5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.711231:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcdedf3b/0x9272d942b4a97b5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.711237:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dcdedf3b/0x9272d942b4a97b5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.711268:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265508.711449:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265508.711454:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dcdedf3b/0x9272d942b4a97b5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.711462:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5800 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265508.711466:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcdedf3b/0x9272d942b4a97b5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.711474:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcdedf3b/0x9272d942b4a97b5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.711500:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dcdedf3b/0x9272d942b4a97b5e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.711508:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcdedf3b/0x9272d942b4a97b5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.711524:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.711526:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.711528:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265508.711612:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265508.711618:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022ad6cb1/0x9272d942b4a97b65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.711626:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=559s v=(0 0) 00010000:00010000:3.0:1789265508.711629:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265508.711633:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022ad6cb1/0x9272d942b4a97b65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.711717:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022ad6cb1/0x9272d942b4a97b65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.711726:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022ad6cb1/0x9272d942b4a97b65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.711733:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022ad6cb1/0x9272d942b4a97b65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789265508.711757:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265508.711763:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265508.711764:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97b6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.711772:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1789265508.711775:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265508.711779:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97b6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.711798:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97b6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.711807:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97b6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.711814:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97b6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.711825:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265508.711829:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022ad6cb1/0x9272d942b4a97b65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.711836:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7000 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265508.711839:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022ad6cb1/0x9272d942b4a97b65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.711854:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022ad6cb1/0x9272d942b4a97b65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.711866:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022ad6cb1/0x9272d942b4a97b65 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.711873:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022ad6cb1/0x9272d942b4a97b65 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.711889:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265508.711890:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265508.711892:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.712785:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265508.712804:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97b6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.712814:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5400 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265508.712818:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97b6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.712826:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97b6c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.712842:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97b6c lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.712850:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.712852:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.712854:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265508.713194:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265508.713202:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f60886c/0x9272d942b4a97b73 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.713213:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789265508.713217:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265508.713222:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f60886c/0x9272d942b4a97b73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.713233:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f60886c/0x9272d942b4a97b73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.713242:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f60886c/0x9272d942b4a97b73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.713250:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f60886c/0x9272d942b4a97b73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.713862:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789265508.713870:0:18700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c768965/0x9272d942b4a97b6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.714105:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265508.714538:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265508.714547:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f60886c/0x9272d942b4a97b73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.714558:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f800 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265508.714562:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f60886c/0x9272d942b4a97b73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.714571:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f60886c/0x9272d942b4a97b73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.714596:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f60886c/0x9272d942b4a97b73 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.714602:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f60886c/0x9272d942b4a97b73 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.714618:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265508.714619:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265508.714621:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265508.717090:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265508.717105:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccb0e6c9/0x9272d942b4a97b7a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.717121:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789265508.717132:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265508.717138:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccb0e6c9/0x9272d942b4a97b7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.717153:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccb0e6c9/0x9272d942b4a97b7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789265508.717153:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265508.717159:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a97b81 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.717164:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccb0e6c9/0x9272d942b4a97b7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.717167:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1789265508.717170:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265508.717172:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ccb0e6c9/0x9272d942b4a97b7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.717175:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a97b81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.717184:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a97b81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.717188:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265508.717191:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a97b81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.717197:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a97b81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.717219:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789265508.717229:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265508.717234:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccb0e6c9/0x9272d942b4a97b7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.717242:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e800 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265508.717246:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccb0e6c9/0x9272d942b4a97b7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.717255:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccb0e6c9/0x9272d942b4a97b7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.717272:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccb0e6c9/0x9272d942b4a97b7a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.717280:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccb0e6c9/0x9272d942b4a97b7a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.717298:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265508.717301:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a97b81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.717307:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4600 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265508.717310:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a97b81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.717343:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a97b81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.717355:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a97b81 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.717361:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a97b81 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.717376:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265508.717378:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265508.717380:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789265508.717548:0:19514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1789265508.717570:0:19514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1789265508.717575:0:19514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1789265508.717600:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265508.717845:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265508.717851:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a97b88 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.717859:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1789265508.717862:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265508.717866:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a97b88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.717874:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a97b88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.717881:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a97b88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.717895:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a97b88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.717916:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265508.718059:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265508.718066:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a97b88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.718085:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5e00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265508.718089:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a97b88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.718098:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a97b88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.718111:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a97b88 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.718118:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a97b88 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.718133:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.718135:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.718137:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265508.718357:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17938:x1876180417578496:12345-0@lo:5:osp-pre-1-1.0 Request processed in 81840us (81918us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789265508.718367:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265508.718503:0:17938:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789265508.718513:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17938:1876180417578496:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789265508.718530:0:17938:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1789265508.718581:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84846680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17938:1876180417578624:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1789265508.718621:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265508.718661:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc83275840 going to sleep for 11 seconds 00000100:00100000:2.0:1789265508.718914:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417578624 00000100:00100000:2.0:1789265508.718921:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417578624 00000100:00100000:2.0:1789265508.718972:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265508.718981:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17938:x1876180417578624:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789265508.719049:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17938:x1876180417578624:12345-0@lo:900:osp-pre-1-1.0 Request processed in 69us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265508.719056:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789265508.719085:0:17938:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb84846680 x1876180417578624/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789265524 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265508.719096:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84846680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17938:1876180417578624:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1789265508.719546:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265508.719553:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a97b8f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.719566:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1789265508.719570:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265508.719576:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a97b8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.719586:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a97b8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.719594:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a97b8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.719601:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a97b8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.719614:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789265508.719760:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265508.719766:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97b96 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.719774:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789265508.719777:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265508.719781:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97b96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.719800:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97b96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.719808:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97b96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.719815:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97b96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.719833:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789265508.719976:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265508.719983:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a97b8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.719997:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4e00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265508.720002:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a97b8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.720011:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a97b8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.720049:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a97b8f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.720057:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a97b8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.720069:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265508.720074:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265508.720076:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265508.720077:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265508.720684:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265508.720692:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011eb152d/0x9272d942b4a97b9d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.720702:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789265508.720705:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265508.720709:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011eb152d/0x9272d942b4a97b9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.720730:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011eb152d/0x9272d942b4a97b9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.720739:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011eb152d/0x9272d942b4a97b9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.720746:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011eb152d/0x9272d942b4a97b9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.720756:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265508.722575:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265508.722590:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011eb152d/0x9272d942b4a97b9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.722604:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2ee00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265508.722608:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011eb152d/0x9272d942b4a97b9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.722618:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011eb152d/0x9272d942b4a97b9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265508.724214:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265508.724226:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030c8943b/0x9272d942b4a97ba4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.724243:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789265508.724248:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265508.724255:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030c8943b/0x9272d942b4a97ba4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.724269:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030c8943b/0x9272d942b4a97ba4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.724277:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030c8943b/0x9272d942b4a97ba4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.724300:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030c8943b/0x9272d942b4a97ba4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.724328:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265508.726168:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011eb152d/0x9272d942b4a97b9d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.726180:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011eb152d/0x9272d942b4a97b9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.726201:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265508.726207:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030c8943b/0x9272d942b4a97ba4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.726215:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f400 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265508.726219:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030c8943b/0x9272d942b4a97ba4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.726229:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030c8943b/0x9272d942b4a97ba4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.726240:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030c8943b/0x9272d942b4a97ba4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.726248:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030c8943b/0x9272d942b4a97ba4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.726261:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265508.726263:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265508.726273:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265508.728247:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265508.728253:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265508.728255:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265508.728449:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97b96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.728463:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e000 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265508.728467:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97b96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.728478:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97b96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.728497:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97b96 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.728504:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97b96 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.728527:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265508.728529:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265508.728530:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265508.729148:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265508.729155:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089896d30/0x9272d942b4a97bab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.729168:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1789265508.729173:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265508.729179:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089896d30/0x9272d942b4a97bab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.729205:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089896d30/0x9272d942b4a97bab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.729215:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089896d30/0x9272d942b4a97bab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.729222:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089896d30/0x9272d942b4a97bab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.729237:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265508.729248:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265508.729253:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089896d30/0x9272d942b4a97bab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.729717:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4c00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265508.729722:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089896d30/0x9272d942b4a97bab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.729731:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089896d30/0x9272d942b4a97bab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.729747:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089896d30/0x9272d942b4a97bab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.729755:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089896d30/0x9272d942b4a97bab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.729780:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265508.729782:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265508.729784:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265508.731781:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265508.731807:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a97bb2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.731823:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1789265508.731828:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265508.731834:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a97bb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.731848:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a97bb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.731857:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a97bb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.731865:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a97bb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.731884:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1789265508.731952:0:18700:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:0.0:1789265508.732064:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17217:x1876180417577728:12345-0@lo:5:osp-pre-0-0.0 Request processed in 116753us (116918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265508.732075:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265508.732451:0:17217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84a3d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17217:1876180417577728:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789265508.732474:0:17217:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:3.0:1789265508.732521:0:17217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17217:1876180417578752:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789265508.732559:0:17217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265508.732583:0:17217:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc83275a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265508.732605:0:19247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417578752 00000100:00100000:3.0:1789265508.732611:0:19247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417578752 00000100:00100000:3.0:1789265508.732651:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789265508.732659:0:19247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17217:x1876180417578752:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789265508.732693:0:19247:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00002000:00010000:2.0:1789265508.732931:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265508.732938:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008efefd8/0x9272d942b4a97bb9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.732952:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789265508.732956:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265508.732961:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008efefd8/0x9272d942b4a97bb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.732973:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008efefd8/0x9272d942b4a97bb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.732981:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008efefd8/0x9272d942b4a97bb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.732988:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008efefd8/0x9272d942b4a97bb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.733007:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789265508.733802:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265508.733811:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a97bb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.733820:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4800 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265508.733825:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a97bb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.733834:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a97bb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.733852:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a97bb2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.733859:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a97bb2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.733893:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265508.733897:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008efefd8/0x9272d942b4a97bb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.733904:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e600 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265508.733907:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008efefd8/0x9272d942b4a97bb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.733915:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008efefd8/0x9272d942b4a97bb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.733925:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008efefd8/0x9272d942b4a97bb9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.733933:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008efefd8/0x9272d942b4a97bb9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.733949:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.733951:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.733953:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265508.737378:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265508.737391:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098a9c607/0x9272d942b4a97bc0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.737408:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=559s v=(0 0) 00010000:00010000:3.0:1789265508.737419:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265508.737426:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098a9c607/0x9272d942b4a97bc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.737439:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098a9c607/0x9272d942b4a97bc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.737449:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098a9c607/0x9272d942b4a97bc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.737456:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098a9c607/0x9272d942b4a97bc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.737479:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265508.737558:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265508.737565:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098a9c607/0x9272d942b4a97bc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.737574:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7e00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265508.737578:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098a9c607/0x9272d942b4a97bc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.737587:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098a9c607/0x9272d942b4a97bc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.737604:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098a9c607/0x9272d942b4a97bc0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.737612:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098a9c607/0x9272d942b4a97bc0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.737630:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265508.737632:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265508.737633:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265508.739509:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265508.739519:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081f97a95/0x9272d942b4a97bc7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.739540:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789265508.739544:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265508.739550:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081f97a95/0x9272d942b4a97bc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.739563:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081f97a95/0x9272d942b4a97bc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.739572:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081f97a95/0x9272d942b4a97bc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.739580:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081f97a95/0x9272d942b4a97bc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.739608:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265508.739969:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265508.739977:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081f97a95/0x9272d942b4a97bc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.739987:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e200 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265508.739991:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081f97a95/0x9272d942b4a97bc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.740012:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081f97a95/0x9272d942b4a97bc7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.740052:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081f97a95/0x9272d942b4a97bc7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.740061:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081f97a95/0x9272d942b4a97bc7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.740081:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265508.740084:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265508.740087:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265508.740510:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265508.740517:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97bce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.740527:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1789265508.740531:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265508.740537:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97bce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.740549:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97bce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.740557:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97bce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.740575:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97bce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.740595:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265508.743656:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265508.743670:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97bce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.743684:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4c00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265508.743688:0:19586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97bce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.743698:0:19586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97bce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.743720:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97bce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.743729:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97bce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265508.743769:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265508.743771:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265508.743773:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265508.744692:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265508.747253:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265508.747267:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e57277bc/0x9272d942b4a97bd5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.747286:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789265508.747291:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265508.747297:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e57277bc/0x9272d942b4a97bd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.747325:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e57277bc/0x9272d942b4a97bd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.747352:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e57277bc/0x9272d942b4a97bd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.747360:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e57277bc/0x9272d942b4a97bd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.747380:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:1.0:1789265508.749137:0:18696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1789265508.749178:0:18696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789265508.749494:0:19247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17217:x1876180417578752:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16831us (16929us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789265508.749505:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789265508.749799:0:17217:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1789265508.749808:0:17217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17217:1876180417578752:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789265508.749823:0:17217:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:0.0:1789265508.749841:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265508.749850:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e57277bc/0x9272d942b4a97bd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.749862:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2fa00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265508.749866:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e57277bc/0x9272d942b4a97bd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.749877:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e57277bc/0x9272d942b4a97bd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.749897:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e57277bc/0x9272d942b4a97bd5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.749905:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e57277bc/0x9272d942b4a97bd5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.749926:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265508.749928:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265508.749929:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265508.761059:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265508.761093:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fb0b17f/0x9272d942b4a97bdc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.761109:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1789265508.761113:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265508.761119:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fb0b17f/0x9272d942b4a97bdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.761134:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fb0b17f/0x9272d942b4a97bdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.761144:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fb0b17f/0x9272d942b4a97bdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.761153:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fb0b17f/0x9272d942b4a97bdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.761177:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265508.761227:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265508.761235:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fb0b17f/0x9272d942b4a97bdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.761242:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4e00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265508.761246:0:19586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fb0b17f/0x9272d942b4a97bdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.761265:0:19586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fb0b17f/0x9272d942b4a97bdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.761294:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fb0b17f/0x9272d942b4a97bdc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.761301:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fb0b17f/0x9272d942b4a97bdc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.761330:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.761332:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.761334:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265508.761987:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265508.761997:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a97be3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.762008:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1789265508.762012:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265508.762016:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a97be3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.762060:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a97be3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.762077:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a97be3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.762085:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a97be3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.762104:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789265508.762882:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265508.762891:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a97bea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.762903:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1789265508.762906:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265508.762910:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a97bea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.762921:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a97bea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.762928:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a97bea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.762935:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a97bea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.762974:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789265508.763164:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265508.763172:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a97be3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.763180:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4600 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265508.763184:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a97be3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.763192:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a97be3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.763208:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a97be3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.763215:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a97be3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.763234:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265508.763244:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a97bea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.763249:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5400 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265508.763252:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a97bea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.763259:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a97bea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.763270:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a97bea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.763276:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c768965/0x9272d942b4a97bea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265508.763289:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265508.763291:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265508.763292:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.765394:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265508.765677:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265508.765688:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97bf1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.765707:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1789265508.765712:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265508.765718:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97bf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.765733:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97bf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.765744:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97bf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.765752:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97bf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.765776:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265508.766876:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265508.766886:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97bf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.766896:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4c00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265508.766901:0:19586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97bf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.766910:0:19586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97bf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.766929:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97bf1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.766937:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089896d30/0x9272d942b4a97bf1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.766970:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.766972:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.766974:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265508.767235:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265508.767242:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d871ee3c/0x9272d942b4a97bf8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.767253:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1789265508.767263:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265508.767268:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d871ee3c/0x9272d942b4a97bf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.767279:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d871ee3c/0x9272d942b4a97bf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.767287:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d871ee3c/0x9272d942b4a97bf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.767294:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d871ee3c/0x9272d942b4a97bf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.767320:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789265508.767715:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265508.767723:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a97bff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.767728:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265508.767731:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=559s v=(0 0) 00010000:00010000:3.0:1789265508.767733:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d871ee3c/0x9272d942b4a97bf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.767734:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265508.767739:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a97bff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.767741:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4800 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265508.767746:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d871ee3c/0x9272d942b4a97bf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.767748:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a97bff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.767754:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d871ee3c/0x9272d942b4a97bf8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.767756:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a97bff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.767769:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d871ee3c/0x9272d942b4a97bf8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.767769:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a97bff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.767776:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d871ee3c/0x9272d942b4a97bf8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265508.767797:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265508.767800:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265508.767804:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a97bff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.767810:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5e00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265508.767819:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a97bff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.767826:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a97bff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1789265508.767828:0:19582:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00010000:00010000:3.0:1789265508.767837:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a97bff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.767843:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037762089/0x9272d942b4a97bff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265508.767856:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.767858:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265508.767859:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265508.767932:0:19582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17219:x1876180417578240:12345-0@lo:5:osp-pre-1-0.0 Request processed in 133288us (150781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265508.767943:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1789265508.767999:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265508.768010:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17219:1876180417578240:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789265508.768054:0:17219:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1789265508.768098:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17219:1876180417578880:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789265508.768135:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265508.768165:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc83275a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265508.768342:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417578880 00000100:00100000:2.0:1789265508.768349:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417578880 00000100:00100000:2.0:1789265508.768390:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789265508.768399:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17219:x1876180417578880:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789265508.768434:0:18701:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:2.0:1789265508.776532:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17219:x1876180417578880:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8126us (8388us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789265508.776546:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789265508.776742:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17219:1876180417578880:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789265508.776759:0:17219:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:2.0:1789265508.868111:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789265509.378743:0:17189:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789265509.378751:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fccaa073800 from 10 10000000:01000000:0.0:1789265509.378756:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789265509.378807:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5800/0x9272d942b4a97c06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265509.378819:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5800/0x9272d942b4a97c06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265509.378831:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5800/0x9272d942b4a97c06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265509.378855:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417579008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265509.378918:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265509.378957:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc98f17900 going to sleep for 11 seconds 00000100:00100000:1.0:1789265509.379065:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417579008 00000100:00100000:1.0:1789265509.379072:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417579008 00000100:00100000:1.0:1789265509.379116:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789265509.379125:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+22:17189:x1876180417579008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265509.379138:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265509.379150:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccbd2fe600/0x9272d942b4a97c0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a97c06 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265509.379171:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2fe600/0x9272d942b4a97c0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a97c06 expref: 23 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265509.379181:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccbd2fe600/0x9272d942b4a97c0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a97c06 expref: 23 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265509.379189:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fe600, rc 0) 00000100:00100000:1.0:1789265509.379228:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+23:17189:x1876180417579008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265509.379234:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789265509.379287:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83eff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417579008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265509.379302:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5800/0x9272d942b4a97c06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97c0d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265509.379310:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5800/0x9272d942b4a97c06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97c0d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265509.379496:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417579136:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789265509.379531:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265509.379546:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838fab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265509.379559:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417579136 00000100:00100000:1.0:1789265509.379562:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417579136 00000100:00100000:1.0:1789265509.379585:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789265509.379594:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+23:17189:x1876180417579136:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789265509.379608:0:17184:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789265509.379623:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789265509.379626:0:17184:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1789265509.379703:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+23:17189:x1876180417579136:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265509.379710:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789265509.379742:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417579136:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789265509.379805:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789265509.379812:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5800/0x9272d942b4a97c06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97c0d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265509.379819:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5800/0x9272d942b4a97c06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97c0d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265509.379838:0:17189:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789265509.379840:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fcb83933000 from 10 10000000:01000000:1.0:1789265509.379842:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789265509.379857:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe400/0x9272d942b4a97c14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265509.379866:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe400/0x9272d942b4a97c14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265509.379874:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe400/0x9272d942b4a97c14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265509.379885:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417579264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789265509.379907:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265509.379919:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838fab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265509.379930:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417579264 00000100:00100000:1.0:1789265509.379933:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417579264 00000100:00100000:1.0:1789265509.379951:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000040:00080000:2.0:1789265509.379953:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789265509.379956:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+23:17189:x1876180417579264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265509.379963:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265509.379972:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccbd2fec00/0x9272d942b4a97c1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a97c14 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265509.379985:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2fec00/0x9272d942b4a97c1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a97c14 expref: 24 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265509.379992:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccbd2fec00/0x9272d942b4a97c1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a97c14 expref: 24 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265509.380007:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fec00, rc 0) 00000100:00100000:1.0:1789265509.381176:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+24:17189:x1876180417579264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1212us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265509.381188:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789265509.381609:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417579264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265509.381641:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe400/0x9272d942b4a97c14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97c1b expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265509.381652:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe400/0x9272d942b4a97c14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97c1b expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265509.381713:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417579392:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789265509.381758:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265509.381795:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc98f17d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265509.382471:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417579392 00000100:00100000:1.0:1789265509.382479:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417579392 00000100:00100000:1.0:1789265509.382525:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789265509.382534:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+24:17189:x1876180417579392:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789265509.382553:0:17187:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789265509.382570:0:17187:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789265509.382573:0:17187:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1789265509.382681:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+24:17189:x1876180417579392:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 148us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265509.382689:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789265509.382745:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417579392:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789265509.382819:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789265509.382828:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe400/0x9272d942b4a97c14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97c1b expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265509.382837:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe400/0x9272d942b4a97c14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97c1b expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265509.894315:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265510.913474:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265511.938012:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265512.961271:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265513.473560:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265513.473583:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417579520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265513.473684:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265513.473766:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417579520 00000100:00100000:2.0:1789265513.473773:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417579520 00000100:00100000:2.0:1789265513.473827:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265513.473836:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417579520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789265513.473863:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789265513.473922:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417579520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265513.473930:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789265513.473951:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265513.474002:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417579520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265513.481555:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417579648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265513.481634:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265513.481850:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417579648 00000100:00100000:3.0:1789265513.481858:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417579648 00000100:00100000:3.0:1789265513.481924:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789265513.481934:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417579648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265513.481972:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789265513.482046:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417579648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265513.482054:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789265513.482104:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417579648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265513.482490:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417579776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265513.482528:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265513.484957:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417579776 00000100:00100000:1.0:1789265513.484972:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417579776 00000100:00100000:1.0:1789265513.485049:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789265513.485060:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417579776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789265513.485097:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789265513.485200:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417579776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (2671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265513.485207:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789265513.485920:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417579776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265513.985628:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417579904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265513.985709:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265513.985788:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265513.985800:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417579904 00000100:00100000:2.0:1789265513.985807:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417579904 00000100:00100000:2.0:1789265513.985857:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265513.985868:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417579904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789265513.985895:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789265513.985940:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417579904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265513.985948:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1789265513.985967:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265513.986247:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417580032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265513.986278:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265513.986429:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417580160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265513.986456:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265513.986493:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417580032 00000100:00100000:1.0:1789265513.986504:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417580032 00000100:00100000:2.0:1789265513.986559:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417579904:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265513.990813:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417580160 00000100:00100000:0.0:1789265513.990828:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417580160 00000100:00100000:1.0:1789265513.992065:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789265513.992084:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876180417580032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265513.992111:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789265513.992207:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876180417580032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (5927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265513.992215:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265513.999846:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789265513.999867:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417580160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265513.999894:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789265513.999972:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417580160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (13514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265513.999980:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789265514.000048:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417580544:0@lo:400:kworker.0 00000100:00100000:0.0:1789265514.000087:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265514.000120:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180417581056:0@lo:400:kworker.0 00000100:00100000:0.0:1789265514.000142:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265514.000186:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417580032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265514.000209:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789265514.000224:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417580416:0@lo:400:kworker.0 00000100:00100000:0.0:1789265514.000251:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265514.000280:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417580928:0@lo:400:kworker.0 00000100:00100000:0.0:1789265514.000301:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265514.000319:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180417581440:0@lo:400:kworker.0 00000100:00100000:0.0:1789265514.000339:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265514.000367:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417580544 00000100:00100000:0.0:1789265514.000372:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417580544 00000100:00100000:0.0:1789265514.000400:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417581056 00000100:00100000:0.0:1789265514.000402:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417581056 00000100:00100000:0.0:1789265514.000416:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417580928 00000100:00100000:0.0:1789265514.000419:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417580928 00000100:00100000:0.0:1789265514.000429:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417581440 00000100:00100000:0.0:1789265514.000431:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417581440 00000100:00100000:0.0:1789265514.000448:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789265514.000455:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417580544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265514.000493:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417580544:12345-0@lo:400:kworker.0 Request processed in 38us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265514.000499:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789265514.000513:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265514.000519:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180417581056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265514.000544:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180417581056:12345-0@lo:400:kworker.0 Request processed in 27us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265514.000550:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265514.000560:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789265514.000566:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417580928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265514.000590:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417580928:12345-0@lo:400:kworker.0 Request processed in 24us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265514.000603:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789265514.000617:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789265514.000623:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180417581440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265514.000650:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180417581440:12345-0@lo:400:kworker.0 Request processed in 28us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265514.000655:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789265514.000892:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417580416 00000100:00100000:0.0:1789265514.000897:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417580416 00000100:00100000:0.0:1789265514.000925:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789265514.000932:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417580416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265514.000964:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417580416:12345-0@lo:400:kworker.0 Request processed in 33us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265514.000971:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789265514.001013:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417580416:0@lo:400:kworker.0 00010000:00080000:0.0:1789265514.001045:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83f32a00 x1876180417580928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265514.001056:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417580928:0@lo:400:kworker.0 00010000:00080000:0.0:1789265514.001070:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83f30380 x1876180417581440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265514.001077:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180417581440:0@lo:400:kworker.0 00010000:00080000:0.0:1789265514.001086:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb84845f80 x1876180417580544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265514.001093:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417580544:0@lo:400:kworker.0 00010000:00080000:0.0:1789265514.001112:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83f30700 x1876180417581056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265514.001121:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180417581056:0@lo:400:kworker.0 00000100:00080000:2.0:1789265514.002908:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789265514.002917:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265514.002921:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789265514.002924:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265514.002951:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a57aa04c-0472-45c4-bafc-6983957e249b:3642:1876180417580288:0@lo:400:kworker.0 00000100:00100000:2.0:1789265514.003050:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265514.003092:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417580800:0@lo:400:kworker.0 00000100:00100000:2.0:1789265514.003121:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265514.003142:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180417581312:0@lo:400:kworker.0 00000100:00100000:2.0:1789265514.003168:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265514.003191:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789265514.003197:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417580672:0@lo:400:kworker.0 00000100:00100000:2.0:1789265514.003224:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265514.003241:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417581184:0@lo:400:kworker.0 00000100:00100000:2.0:1789265514.003260:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265514.003299:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417580800 00000100:00100000:2.0:1789265514.003307:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417580800 00000100:00100000:2.0:1789265514.003354:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265514.003364:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417580800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265514.003416:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417580800:12345-0@lo:400:kworker.0 Request processed in 54us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265514.003423:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265514.003446:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417580672 00000100:00100000:2.0:1789265514.003450:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417580672 00000100:00100000:2.0:1789265514.003473:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789265514.003480:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417580672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265514.003510:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417580672:12345-0@lo:400:kworker.0 Request processed in 31us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265514.003516:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789265514.003552:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417580672:0@lo:400:kworker.0 00000100:00100000:2.0:1789265514.003561:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417580800:0@lo:400:kworker.0 00000100:00100000:1.0:1789265514.003686:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417580160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265514.003787:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417580288 00000100:00100000:0.0:1789265514.003792:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417580288 00000100:00100000:0.0:1789265514.003833:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789265514.003841:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+24:3642:x1876180417580288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265514.003887:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+24:3642:x1876180417580288:12345-0@lo:400:kworker.0 Request processed in 48us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265514.003894:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789265514.003922:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417581312 00000100:00100000:0.0:1789265514.003926:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417581312 00000100:00100000:0.0:1789265514.003956:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417581184 00000100:00100000:0.0:1789265514.003959:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417581184 00000100:00100000:0.0:1789265514.003980:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789265514.003987:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876180417581312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265514.004016:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876180417581312:12345-0@lo:400:kworker.0 Request processed in 30us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265514.004044:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789265514.004057:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789265514.004063:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417581184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265514.004091:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417581184:12345-0@lo:400:kworker.0 Request processed in 29us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265514.004097:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1789265514.004123:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789265514.004127:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789265514.008740:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83f33b80 x1876180417581184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265514.008768:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417581184:0@lo:400:kworker.0 00000100:00100000:2.0:1789265514.008781:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a57aa04c-0472-45c4-bafc-6983957e249b:3642:1876180417580288:0@lo:400:kworker.0 00010000:00080000:2.0:1789265514.008795:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83f33100 x1876180417581312/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265514.008803:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180417581312:0@lo:400:kworker.0 00000001:00080000:2.0:1789265514.502810:0:19514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:02000400:3.0:1789265514.618104:0:19872:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg349-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789265515.009212:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789265515.581196:0:19925:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789265515.581457:0:19925:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1789265515.585733:0:17228:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789265516.034347:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789265516.470004:0:19975:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789265516.470475:0:19975:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789265516.941820:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265516.942209:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399673088 00000100:00100000:1.0:1789265516.942219:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399673088 00000100:00100000:1.0:1789265516.942317:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 114 00000100:00100000:1.0:1789265516.942326:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2392:x1876180399673088:12345-192.168.203.49@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789265516.942353:0:17187:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 0529895c-e416-4b40-9cbc-d7eabe178719@192.168.203.49@tcp t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:1.0:1789265516.942384:0:17187:0:(genops.c:1385:class_connect()) connect: client 0529895c-e416-4b40-9cbc-d7eabe178719, cookie 0x9272d942b4a97c22 00000100:00080000:1.0:1789265516.942548:0:17187:0:(import.c:65:import_set_state_nolock()) ffff9fcb82af6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265516.943777:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+5:2392:x1876180399673088:12345-192.168.203.49@tcp:250:mount.lustre.0 Request processed in 1444us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265516.943789:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 114 00000100:00100000:0.0:1789265516.950637:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265516.950695:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399673216 00000100:00100000:1.0:1789265516.950705:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399673216 00000100:00100000:1.0:1789265516.950944:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 115 00000100:00100000:1.0:1789265516.950956:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+5:14903:x1876180399673216:12345-192.168.203.49@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789265516.950974:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265516.950991:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccbd2fe000/0x9272d942b4a97c29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc163 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265516.951073:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2fe000/0x9272d942b4a97c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc163 expref: 6 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265516.951085:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccbd2fe000/0x9272d942b4a97c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc163 expref: 6 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265516.951094:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fe000, rc 0) 00000100:00100000:1.0:1789265516.951160:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+6:14903:x1876180399673216:12345-192.168.203.49@tcp:101:mount.lustre.0 Request processed in 207us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265516.951415:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 115 00000100:00100000:3.0:1789265516.964449:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265516.964769:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399673344 00000100:00100000:1.0:1789265516.964780:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399673344 00000100:00100000:1.0:1789265516.964833:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 116 00000100:00100000:1.0:1789265516.964843:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+6:14903:x1876180399673344:12345-192.168.203.49@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789265516.964964:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+6:14903:x1876180399673344:12345-192.168.203.49@tcp:501:mount.lustre.0 Request processed in 122us (526us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789265516.964972:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 116 00000100:00100000:3.0:1789265516.971006:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265516.971077:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399673472 00000100:00100000:1.0:1789265516.971088:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399673472 00000100:00100000:1.0:1789265516.971147:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 117 00000100:00100000:1.0:1789265516.971156:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+6:14903:x1876180399673472:12345-192.168.203.49@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789265516.971182:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265516.971200:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccbd2ff400/0x9272d942b4a97c30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc16a expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265516.971230:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2ff400/0x9272d942b4a97c30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc16a expref: 7 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265516.971255:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccbd2ff400/0x9272d942b4a97c30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc16a expref: 7 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265516.971267:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2ff400, rc 0) 00000100:00100000:1.0:1789265516.971325:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+7:14903:x1876180399673472:12345-192.168.203.49@tcp:101:mount.lustre.0 Request processed in 171us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265516.971332:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 117 00000100:00100000:2.0:1789265516.995907:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265516.996003:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399673600 00000100:00100000:0.0:1789265516.996013:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399673600 00000100:00100000:0.0:1789265516.996103:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 118 00000100:00100000:0.0:1789265516.996113:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0529895c-e416-4b40-9cbc-d7eabe178719+7:14903:x1876180399673600:12345-192.168.203.49@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789265516.996269:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0529895c-e416-4b40-9cbc-d7eabe178719+8:14903:x1876180399673600:12345-192.168.203.49@tcp:501:mount.lustre.0 Request processed in 157us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265516.996277:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 118 00000100:00100000:3.0:1789265517.012192:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265517.012301:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399673728 00000100:00100000:2.0:1789265517.012311:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399673728 00000100:00100000:2.0:1789265517.012364:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 119 00000100:00100000:2.0:1789265517.012373:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+8:14903:x1876180399673728:12345-192.168.203.49@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789265517.012528:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+8:14903:x1876180399673728:12345-192.168.203.49@tcp:503:mount.lustre.0 Request processed in 155us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265517.012536:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 119 00000100:00100000:3.0:1789265517.034374:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265517.034572:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399673856 00000100:00100000:1.0:1789265517.034583:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399673856 00000100:00100000:1.0:1789265517.034641:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 120 00000100:00100000:1.0:1789265517.034651:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+8:14921:x1876180399673856:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789265517.035421:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+8:14921:x1876180399673856:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 768us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265517.035432:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 120 00010000:00010000:2.0:1789265517.057220:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265517.089871:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265517.096952:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399673984 00000100:00100000:0.0:1789265517.096969:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399673984 00000100:00100000:0.0:1789265517.098246:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 121 00000100:00100000:0.0:1789265517.098260:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0529895c-e416-4b40-9cbc-d7eabe178719+8:14921:x1876180399673984:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789265517.098430:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0529895c-e416-4b40-9cbc-d7eabe178719+8:14921:x1876180399673984:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 173us (8576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265517.098438:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 121 00000100:00100000:3.0:1789265517.112979:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265517.113093:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399674112 00000100:00100000:1.0:1789265517.113102:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399674112 00000100:00100000:1.0:1789265517.113158:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 122 00000100:00100000:1.0:1789265517.113168:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+8:14921:x1876180399674112:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789265517.113322:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+8:14921:x1876180399674112:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 156us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265517.113331:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 122 00000100:00100000:1.0:1789265517.122009:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265517.122194:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399674240 00000100:00100000:3.0:1789265517.122205:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399674240 00000100:00100000:3.0:1789265517.122264:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 123 00000100:00100000:3.0:1789265517.122274:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+8:14903:x1876180399674240:12345-192.168.203.49@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789265517.122293:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265517.122314:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc882b7c00/0x9272d942b4a97c37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc19b expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265517.122365:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc882b7c00/0x9272d942b4a97c37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc19b expref: 9 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265517.122377:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc882b7c00/0x9272d942b4a97c37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc19b expref: 9 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265517.122386:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b7c00, rc 0) 00000100:00100000:3.0:1789265517.122461:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+9:14903:x1876180399674240:12345-192.168.203.49@tcp:101:mount.lustre.0 Request processed in 189us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265517.122469:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 123 00000100:00100000:3.0:1789265517.128006:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265517.128214:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399674368 00000100:00100000:0.0:1789265517.128224:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399674368 00000100:00100000:0.0:1789265517.128288:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 124 00000100:00100000:0.0:1789265517.128298:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0529895c-e416-4b40-9cbc-d7eabe178719+9:14903:x1876180399674368:12345-192.168.203.49@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789265517.128321:0:17184:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789265517.128345:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789265517.128349:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789265517.128358:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789265517.128362:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789265517.128364:0:17184:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1789265517.131125:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0529895c-e416-4b40-9cbc-d7eabe178719+9:14903:x1876180399674368:12345-192.168.203.49@tcp:256:mount.lustre.0 Request processed in 2817us (3118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265517.131155:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 124 00000100:00100000:1.0:1789265517.136798:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265517.137119:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399674496 00000100:00100000:3.0:1789265517.137129:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399674496 00000100:00100000:3.0:1789265517.137233:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 125 00000100:00100000:3.0:1789265517.137244:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+9:14903:x1876180399674496:12345-192.168.203.49@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789265517.137261:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265517.137289:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc882b6800/0x9272d942b4a97c3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc1a2 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265517.137318:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc882b6800/0x9272d942b4a97c3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc1a2 expref: 10 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265517.137331:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc882b6800/0x9272d942b4a97c3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc1a2 expref: 10 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265517.137340:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6800, rc 0) 00000100:00100000:3.0:1789265517.137405:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+10:14903:x1876180399674496:12345-192.168.203.49@tcp:101:mount.lustre.0 Request processed in 163us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265517.137435:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 125 00000100:00100000:3.0:1789265517.152383:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265517.152899:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399674624 00000100:00100000:1.0:1789265517.152910:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399674624 00000100:00100000:1.0:1789265517.152976:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 126 00000100:00100000:1.0:1789265517.152986:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0529895c-e416-4b40-9cbc-d7eabe178719+10:14903:x1876180399674624:12345-192.168.203.49@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789265517.153183:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0529895c-e416-4b40-9cbc-d7eabe178719+10:14903:x1876180399674624:12345-192.168.203.49@tcp:501:mount.lustre.0 Request processed in 197us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265517.153191:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 126 00000100:00100000:0.0:1789265517.159887:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265517.159973:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399674752 00000100:00100000:3.0:1789265517.159982:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399674752 00000100:00100000:3.0:1789265517.160073:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 127 00000100:00100000:3.0:1789265517.160084:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+10:14903:x1876180399674752:12345-192.168.203.49@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789265517.160225:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+10:14903:x1876180399674752:12345-192.168.203.49@tcp:503:mount.lustre.0 Request processed in 142us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265517.160232:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 127 00000100:00100000:3.0:1789265517.165184:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265517.165330:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399674880 00000100:00100000:2.0:1789265517.165340:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399674880 00000100:00100000:2.0:1789265517.165398:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 128 00000100:00100000:2.0:1789265517.165408:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc9b089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+10:14926:x1876180399674880:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265517.165560:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc9b089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+10:14926:x1876180399674880:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 153us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265517.165583:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 128 00000100:00100000:2.0:1789265517.177950:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265517.178210:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399675008 00000100:00100000:1.0:1789265517.178220:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399675008 00000100:00100000:1.0:1789265517.178277:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 129 00000100:00100000:1.0:1789265517.178288:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc9b08b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0529895c-e416-4b40-9cbc-d7eabe178719+10:14926:x1876180399675008:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789265517.178489:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc9b08b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0529895c-e416-4b40-9cbc-d7eabe178719+10:14926:x1876180399675008:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 202us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265517.178498:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 129 00000100:00100000:0.0:1789265517.203843:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265517.203947:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265517.204265:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399675136 00000100:00100000:2.0:1789265517.204287:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399675136 00000100:00100000:2.0:1789265517.204334:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399675392 00000100:00100000:2.0:1789265517.204337:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399675392 00000100:00100000:2.0:1789265517.204363:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:2.0:1789265517.204371:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1876180399675136:12345-192.168.203.49@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789265517.204400:0:17192:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from befb0935-501c-4d01-87d3-564eb87bef45@192.168.203.49@tcp t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:2.0:1789265517.204448:0:17192:0:(genops.c:1385:class_connect()) connect: client befb0935-501c-4d01-87d3-564eb87bef45, cookie 0x9272d942b4a97c45 00000004:00100000:2.0:1789265517.204486:0:17192:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789265517.204684:0:17192:0:(import.c:65:import_set_state_nolock()) ffff9fcb821eb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265517.204767:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+6:2392:x1876180399675136:12345-192.168.203.49@tcp:38:mount.lustre.0 Request processed in 395us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265517.204776:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:2.0:1789265517.204795:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 8 00000100:00100000:2.0:1789265517.204799:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1876180399675392:12345-192.168.203.49@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789265517.204851:0:17192:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from befb0935-501c-4d01-87d3-564eb87bef45@192.168.203.49@tcp t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:2.0:1789265517.204885:0:17192:0:(genops.c:1385:class_connect()) connect: client befb0935-501c-4d01-87d3-564eb87bef45, cookie 0x9272d942b4a97c4c 00000004:00100000:2.0:1789265517.204899:0:17192:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789265517.205614:0:17192:0:(import.c:65:import_set_state_nolock()) ffff9fcb82c56800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265517.205838:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+6:2392:x1876180399675392:12345-192.168.203.49@tcp:38:mount.lustre.0 Request processed in 1036us (1889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265517.205846:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 8 00000100:00100000:0.0:1789265517.229538:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265517.229583:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265517.229629:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265517.229740:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399675264 00000100:00100000:1.0:1789265517.229750:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399675264 00000100:00100000:1.0:1789265517.229814:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399675520 00000100:00100000:1.0:1789265517.229818:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399675520 00000100:00100000:1.0:1789265517.229832:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399675648 00000100:00100000:1.0:1789265517.229834:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399675648 00000100:00100000:1.0:1789265517.229848:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 9 00000100:00100000:1.0:1789265517.229868:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:befb0935-501c-4d01-87d3-564eb87bef45+7:0:x1876180399675264:12345-192.168.203.49@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789265517.229904:0:19245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789265517.230013:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:befb0935-501c-4d01-87d3-564eb87bef45+7:0:x1876180399675264:12345-192.168.203.49@tcp:41:mount.lustre.0 Request processed in 156us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265517.230049:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 9 00000100:00100000:1.0:1789265517.230071:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 10 00000100:00100000:1.0:1789265517.230078:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:befb0935-501c-4d01-87d3-564eb87bef45+6:0:x1876180399675520:12345-192.168.203.49@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789265517.230095:0:19245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789265517.230137:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:befb0935-501c-4d01-87d3-564eb87bef45+6:0:x1876180399675520:12345-192.168.203.49@tcp:41:mount.lustre.0 Request processed in 59us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265517.230143:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 10 00000100:00100000:1.0:1789265517.230157:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 11 00000100:00100000:1.0:1789265517.230163:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:befb0935-501c-4d01-87d3-564eb87bef45+6:14903:x1876180399675648:12345-192.168.203.49@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789265517.230173:0:19245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789265517.230193:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:befb0935-501c-4d01-87d3-564eb87bef45+6:14903:x1876180399675648:12345-192.168.203.49@tcp:41:mount.lustre.0 Request processed in 30us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265517.230199:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 11 00000100:00080000:0.0:1789265517.230940:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789265517.230945:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265517.231888:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265517.231961:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399675776 00000100:00100000:1.0:1789265517.231970:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399675776 00000100:00100000:1.0:1789265517.232020:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 12 00000100:00100000:1.0:1789265517.232055:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:befb0935-501c-4d01-87d3-564eb87bef45+6:14903:x1876180399675776:12345-192.168.203.49@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789265517.232128:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:befb0935-501c-4d01-87d3-564eb87bef45+6:14903:x1876180399675776:12345-192.168.203.49@tcp:40:mount.lustre.0 Request processed in 75us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265517.232135:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 12 00000100:00100000:1.0:1789265517.244639:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265517.244683:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265517.244717:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265517.244833:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399675904 00000100:00100000:2.0:1789265517.244844:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399675904 00000100:00100000:2.0:1789265517.244898:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399676032 00000100:00100000:2.0:1789265517.244902:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399676032 00000100:00100000:2.0:1789265517.244928:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 16 00000100:00100000:2.0:1789265517.244936:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1876180399675904:12345-192.168.203.49@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789265517.244973:0:18700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from befb0935-501c-4d01-87d3-564eb87bef45@192.168.203.49@tcp t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:2.0:1789265517.245005:0:18700:0:(genops.c:1385:class_connect()) connect: client befb0935-501c-4d01-87d3-564eb87bef45, cookie 0x9272d942b4a97c53 00002000:00100000:2.0:1789265517.245017:0:18700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli befb0935-501c-4d01-87d3-564eb87bef45/ffff9fcb82c54800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789265517.245064:0:18700:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789265517.245410:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 17 00000100:00100000:1.0:1789265517.245417:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2392:x1876180399676032:12345-192.168.203.49@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789265517.245437:0:18701:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from befb0935-501c-4d01-87d3-564eb87bef45@192.168.203.49@tcp t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:1.0:1789265517.245472:0:18701:0:(genops.c:1385:class_connect()) connect: client befb0935-501c-4d01-87d3-564eb87bef45, cookie 0x9272d942b4a97c5a 00002000:00100000:1.0:1789265517.245479:0:18701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli befb0935-501c-4d01-87d3-564eb87bef45/ffff9fccafac0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789265517.245491:0:18701:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789265517.245620:0:18701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789265517.245649:0:18701:0:(import.c:65:import_set_state_nolock()) ffff9fccafac1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265517.245717:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:befb0935-501c-4d01-87d3-564eb87bef45+6:2392:x1876180399676032:12345-192.168.203.49@tcp:8:mount.lustre.0 Request processed in 297us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265517.245725:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 17 00002000:00080000:2.0:1789265517.246081:0:18700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789265517.246100:0:18700:0:(import.c:65:import_set_state_nolock()) ffff9fcb82c57800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265517.246131:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:befb0935-501c-4d01-87d3-564eb87bef45+6:2392:x1876180399675904:12345-192.168.203.49@tcp:8:mount.lustre.0 Request processed in 1195us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265517.246140:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 16 00000100:00100000:3.0:1789265517.246604:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399676160 00000100:00100000:3.0:1789265517.246612:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399676160 00000100:00100000:3.0:1789265517.246658:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 3 00000100:00100000:3.0:1789265517.246667:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:befb0935-501c-4d01-87d3-564eb87bef45+6:14903:x1876180399676160:12345-192.168.203.49@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789265517.246712:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:befb0935-501c-4d01-87d3-564eb87bef45+6:14903:x1876180399676160:12345-192.168.203.49@tcp:900:mount.lustre.0 Request processed in 46us (2028us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265517.246719:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 3 00000100:00100000:1.0:1789265517.260122:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265517.260247:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399676288 00000100:00100000:0.0:1789265517.260257:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399676288 00000100:00100000:0.0:1789265517.260315:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 0 00000100:00100000:0.0:1789265517.260325:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:befb0935-501c-4d01-87d3-564eb87bef45+6:14903:x1876180399676288:12345-192.168.203.49@tcp:33:mount.lustre.0 00000004:00080000:0.0:1789265517.274145:0:17195:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 13738us 00000004:00200000:0.0:1789265517.295403:0:17195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789265517.295529:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:befb0935-501c-4d01-87d3-564eb87bef45+6:14903:x1876180399676288:12345-192.168.203.49@tcp:33:mount.lustre.0 Request processed in 35200us (35412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265517.295541:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 0 00000100:00100000:0.0:1789265517.535508:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265517.535594:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399676416 00000100:00100000:3.0:1789265517.535604:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399676416 00000100:00100000:3.0:1789265517.535666:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 13 00000100:00100000:3.0:1789265517.535676:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+6:14949:x1876180399676416:12345-192.168.203.49@tcp:101:mkdir.0 00010000:00010000:3.0:1789265517.535696:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265517.535720:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a97c61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc1d3 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265517.535813:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a97c68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265517.535827:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a97c68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265517.535841:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a97c68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265517.535894:0:17194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789265517.535898:0:17194:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265517.535934:0:17194:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a97c68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265517.535960:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a97c61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc1d3 expref: 8 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265517.535979:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a97c68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc1d3 expref: 7 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265517.535988:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcc8b0c6400) 00010000:00010000:3.0:1789265517.535991:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265517.535994:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6e00, rc 0) 00000100:00100000:3.0:1789265517.536437:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+7:14949:x1876180399676416:12345-192.168.203.49@tcp:101:mkdir.0 Request processed in 760us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265517.536445:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 13 00010000:00010000:2.0:1789265518.081530:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265518.593507:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265518.593530:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417581568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265518.593661:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265518.593710:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265518.593734:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417581696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265518.593760:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265518.593788:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417581568 00000100:00100000:2.0:1789265518.593796:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417581568 00000100:00100000:2.0:1789265518.593838:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417581696 00000100:00100000:2.0:1789265518.593841:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417581696 00000100:00100000:2.0:1789265518.593855:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789265518.593863:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417581568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789265518.593895:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789265518.593935:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417581568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265518.593942:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789265518.593958:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789265518.593963:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417581696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789265518.593978:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789265518.594009:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417581696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 45us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265518.594052:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789265518.594102:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417581696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265518.594129:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417581568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265518.594686:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265518.594697:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417581824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265518.594749:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265518.594869:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417581824 00000100:00100000:0.0:1789265518.594875:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417581824 00000100:00100000:0.0:1789265518.594930:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265518.594938:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417581824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789265518.594954:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789265518.594996:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417581824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265518.595011:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265518.595076:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417581824:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789265518.595264:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789265519.114196:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265519.114236:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a57aa04c-0472-45c4-bafc-6983957e249b:3641:1876180417582208:0@lo:400:kworker.0 00000100:00100000:1.0:1789265519.115576:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417581952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265519.115745:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265519.115812:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265519.115867:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265519.115883:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417582080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265519.115908:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265519.115944:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417581952 00000100:00100000:1.0:1789265519.115952:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417581952 00000100:00100000:1.0:1789265519.115999:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417582080 00000100:00100000:1.0:1789265519.116002:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417582080 00000100:00100000:1.0:1789265519.116018:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265519.116059:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417581952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265519.116090:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789265519.116138:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417581952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265519.116145:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265519.116164:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265519.116171:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417582080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789265519.116200:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789265519.116229:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417582080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265519.116235:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1789265519.116252:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265519.116256:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265519.116330:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417582080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265519.116344:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417581952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265519.117734:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417582208 00000100:00100000:1.0:1789265519.117747:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417582208 00000100:00100000:1.0:1789265519.117801:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789265519.117809:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc9b08b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+24:3641:x1876180417582208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265519.118466:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265519.118478:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417582336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265519.118532:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265519.118565:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc9b08b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+24:3641:x1876180417582208:12345-0@lo:400:kworker.0 Request processed in 754us (2818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265519.118575:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a57aa04c-0472-45c4-bafc-6983957e249b:3641:1876180417582208:0@lo:400:kworker.0 00000100:00100000:1.0:1789265519.118576:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789265519.118626:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417582336 00000100:00100000:2.0:1789265519.118630:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417582336 00000100:00100000:2.0:1789265519.118666:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789265519.118673:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417582336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265519.118688:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789265519.118744:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417582336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265519.118751:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1789265519.118768:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265519.118786:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1789265519.118802:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417582336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265519.119596:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417582592:0@lo:400:kworker.0 00000100:00100000:1.0:1789265519.119639:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265519.119667:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265519.119689:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417582464:0@lo:400:kworker.0 00000100:00100000:2.0:1789265519.119694:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265519.119728:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265519.119761:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417582592 00000100:00100000:1.0:1789265519.119766:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417582592 00000100:00100000:1.0:1789265519.119798:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789265519.119806:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417582592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265519.119842:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417582592:12345-0@lo:400:kworker.0 Request processed in 37us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265519.119849:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789265519.119880:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417582592:0@lo:400:kworker.0 00000100:00100000:1.0:1789265519.119920:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417582464 00000100:00100000:1.0:1789265519.119924:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417582464 00000100:00100000:1.0:1789265519.121255:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789265519.121266:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417582464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265519.121335:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417582464:12345-0@lo:400:kworker.0 Request processed in 72us (1616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265519.121342:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789265519.121384:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417582464:0@lo:400:kworker.0 00000100:00100000:0.0:1789265519.125765:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180417583104:0@lo:400:kworker.0 00000100:00100000:3.0:1789265519.125801:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417583232:0@lo:400:kworker.0 00000100:00100000:3.0:1789265519.125844:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265519.125891:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265519.125898:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789265519.125907:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417582848:0@lo:400:kworker.0 00000100:00100000:0.0:1789265519.125921:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789265519.125929:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417582976:0@lo:400:kworker.0 00000100:00100000:0.0:1789265519.125954:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265519.125973:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180417583488:0@lo:400:kworker.0 00000100:00100000:0.0:1789265519.125993:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265519.126036:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417583232 00000100:00100000:0.0:1789265519.126044:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417583232 00000100:00100000:0.0:1789265519.126094:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417583104 00000100:00100000:0.0:1789265519.126097:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417583104 00000100:00100000:0.0:1789265519.126109:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417582976 00000100:00100000:0.0:1789265519.126112:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417582976 00000100:00100000:0.0:1789265519.126122:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417583488 00000100:00100000:0.0:1789265519.126125:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417583488 00000100:00100000:0.0:1789265519.126140:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789265519.126148:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417583232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265519.126194:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417583232:12345-0@lo:400:kworker.0 Request processed in 46us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265519.126201:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789265519.126218:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789265519.126226:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180417583104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265519.126258:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180417583104:12345-0@lo:400:kworker.0 Request processed in 34us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265519.126274:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789265519.126288:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789265519.126293:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417582976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265519.126321:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417582976:12345-0@lo:400:kworker.0 Request processed in 28us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265519.126326:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789265519.126340:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789265519.126346:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180417583488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265519.126379:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265519.126409:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876180417583360:0@lo:400:kworker.0 00000100:00100000:3.0:1789265519.126434:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789265519.126460:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83f32300 x1876180417583232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265519.126473:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417583232:0@lo:400:kworker.0 00000100:00080000:3.0:1789265519.126519:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265519.126523:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265519.126536:0:19247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417582848 00000100:00100000:3.0:1789265519.126540:0:19247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417582848 00000100:00100000:3.0:1789265519.126568:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265519.126574:0:19247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417582848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265519.126609:0:19247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417582848:12345-0@lo:400:kworker.0 Request processed in 35us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265519.126615:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265519.126640:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417582848:0@lo:400:kworker.0 00000100:00100000:3.0:1789265519.126666:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417583360 00000100:00100000:3.0:1789265519.126669:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417583360 00000100:00100000:3.0:1789265519.126690:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789265519.126699:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876180417583360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265519.126700:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180417583488:12345-0@lo:400:kworker.0 Request processed in 62us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265519.126710:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789265519.126750:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876180417583360:12345-0@lo:400:kworker.0 Request processed in 52us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265519.126757:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789265519.126765:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417582976:0@lo:400:kworker.0 00000100:00080000:3.0:1789265519.126777:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789265519.126780:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd23d880 x1876180417583488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265519.126793:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180417583488:0@lo:400:kworker.0 00000100:00100000:0.0:1789265519.126809:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180417583104:0@lo:400:kworker.0 00000100:00100000:3.0:1789265519.126818:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876180417583360:0@lo:400:kworker.0 00000100:00100000:2.0:1789265519.127781:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417582720:0@lo:400:kworker.0 00000100:00100000:2.0:1789265519.127829:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265519.128632:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417582720 00000100:00100000:0.0:1789265519.128642:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417582720 00000100:00100000:0.0:1789265519.128701:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789265519.128712:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417582720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265519.128790:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417582720:12345-0@lo:400:kworker.0 Request processed in 80us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265519.128798:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789265519.129267:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417582720:0@lo:400:kworker.0 00000040:00080000:3.0:1789265519.617777:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789265519.851204:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265519.851320:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399676544 00000100:00100000:1.0:1789265519.851330:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399676544 00000100:00100000:1.0:1789265519.851413:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 14 00000100:00100000:1.0:1789265519.851423:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:befb0935-501c-4d01-87d3-564eb87bef45+7:15001:x1876180399676544:12345-192.168.203.49@tcp:41:lfs.0 00000004:00000024:1.0:1789265519.851463:0:17193:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789265519.851549:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:befb0935-501c-4d01-87d3-564eb87bef45+7:15001:x1876180399676544:12345-192.168.203.49@tcp:41:lfs.0 Request processed in 127us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265519.851557:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 14 00000100:00080000:3.0:1789265519.851871:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265519.859160:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265519.862172:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399676672 00000100:00100000:3.0:1789265519.862188:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399676672 00000100:00100000:3.0:1789265519.862294:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 15 00000100:00100000:3.0:1789265519.862315:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+6:15001:x1876180399676672:12345-192.168.203.49@tcp:41:lfs.0 00000004:00000024:3.0:1789265519.862354:0:17194:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789265519.862455:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+6:15001:x1876180399676672:12345-192.168.203.49@tcp:41:lfs.0 Request processed in 150us (3315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265519.862462:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 15 00000100:00080000:0.0:1789265519.862541:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265519.875208:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265519.875519:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399676800 00000100:00100000:2.0:1789265519.875530:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399676800 00000100:00100000:2.0:1789265519.875614:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 13 00000100:00100000:2.0:1789265519.875624:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83daa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:befb0935-501c-4d01-87d3-564eb87bef45+6:15001:x1876180399676800:12345-192.168.203.49@tcp:13:lfs.0 00002000:00000024:2.0:1789265519.875650:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:0.0:1789265519.875794:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265519.876199:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83daa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:befb0935-501c-4d01-87d3-564eb87bef45+6:15001:x1876180399676800:12345-192.168.203.49@tcp:13:lfs.0 Request processed in 574us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265519.876208:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 13 00000100:00100000:1.0:1789265519.883151:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265519.883793:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399676928 00000100:00100000:2.0:1789265519.883808:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399676928 00000100:00100000:2.0:1789265519.883884:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 14 00000100:00100000:2.0:1789265519.883894:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:befb0935-501c-4d01-87d3-564eb87bef45+6:15001:x1876180399676928:12345-192.168.203.49@tcp:13:lfs.0 00002000:00000024:2.0:1789265519.883927:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789265519.884057:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:befb0935-501c-4d01-87d3-564eb87bef45+6:15001:x1876180399676928:12345-192.168.203.49@tcp:13:lfs.0 Request processed in 164us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265519.884066:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 14 00000100:00080000:0.0:1789265519.884684:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789265520.129663:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265520.172416:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265520.172875:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399677056 00000100:00100000:2.0:1789265520.172885:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399677056 00000100:00100000:2.0:1789265520.172944:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 131 00000100:00100000:2.0:1789265520.172954:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+10:15035:x1876180399677056:12345-192.168.203.49@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789265520.172971:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265520.172990:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb84a2f400/0x9272d942b4a97c6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc1da expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265520.173074:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb84a2f400/0x9272d942b4a97c6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc1da expref: 11 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265520.173087:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb84a2f400/0x9272d942b4a97c6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc1da expref: 11 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265520.173097:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2f400, rc 0) 00000100:00100000:2.0:1789265520.173151:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+11:15035:x1876180399677056:12345-192.168.203.49@tcp:101:mount.lustre.0 Request processed in 198us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265520.173158:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 131 00000100:00100000:3.0:1789265520.178987:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265520.179545:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399677184 00000100:00100000:1.0:1789265520.179556:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399677184 00000100:00100000:1.0:1789265520.179628:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 132 00000100:00100000:1.0:1789265520.179639:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0529895c-e416-4b40-9cbc-d7eabe178719+11:15035:x1876180399677184:12345-192.168.203.49@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789265520.179814:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0529895c-e416-4b40-9cbc-d7eabe178719+11:15035:x1876180399677184:12345-192.168.203.49@tcp:501:mount.lustre.0 Request processed in 176us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265520.179822:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 132 00000100:00100000:3.0:1789265520.187482:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265520.187597:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399677312 00000100:00100000:2.0:1789265520.187606:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399677312 00000100:00100000:2.0:1789265520.187663:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 133 00000100:00100000:2.0:1789265520.187672:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+11:15035:x1876180399677312:12345-192.168.203.49@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789265520.187899:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+11:15035:x1876180399677312:12345-192.168.203.49@tcp:503:mount.lustre.0 Request processed in 227us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265520.187908:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 133 00000100:00100000:2.0:1789265520.197944:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265520.200386:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399677440 00000100:00100000:3.0:1789265520.200403:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399677440 00000100:00100000:3.0:1789265520.200481:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 134 00000100:00100000:3.0:1789265520.200493:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+11:15040:x1876180399677440:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789265520.200670:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+11:15040:x1876180399677440:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 177us (2734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265520.200678:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 134 00000100:00100000:3.0:1789265520.232956:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265520.233072:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399677568 00000100:00100000:2.0:1789265520.233081:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399677568 00000100:00100000:2.0:1789265520.233255:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 135 00000100:00100000:2.0:1789265520.233267:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+11:15040:x1876180399677568:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265520.233426:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+11:15040:x1876180399677568:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 161us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265520.233433:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 135 00000100:00100000:0.0:1789265520.240592:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265520.241405:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399677696 00000100:00100000:2.0:1789265520.241418:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399677696 00000100:00100000:2.0:1789265520.241480:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 136 00000100:00100000:2.0:1789265520.241490:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+11:15040:x1876180399677696:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265520.241646:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+11:15040:x1876180399677696:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 157us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265520.241655:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 136 00000100:00100000:0.0:1789265520.249132:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265520.249427:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399677824 00000100:00100000:2.0:1789265520.249437:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399677824 00000100:00100000:2.0:1789265520.249499:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 137 00000100:00100000:2.0:1789265520.249509:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+11:15035:x1876180399677824:12345-192.168.203.49@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789265520.249526:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265520.249544:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb84a2e800/0x9272d942b4a97c76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc20b expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265520.249573:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb84a2e800/0x9272d942b4a97c76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc20b expref: 12 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265520.249597:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb84a2e800/0x9272d942b4a97c76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc20b expref: 12 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265520.249607:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2e800, rc 0) 00000100:00100000:2.0:1789265520.249667:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+12:15035:x1876180399677824:12345-192.168.203.49@tcp:101:mount.lustre.0 Request processed in 160us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265520.249674:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 137 00000100:00100000:0.0:1789265520.256583:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265520.256679:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399677952 00000100:00100000:1.0:1789265520.256688:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399677952 00000100:00100000:1.0:1789265520.256752:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 138 00000100:00100000:1.0:1789265520.256762:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0529895c-e416-4b40-9cbc-d7eabe178719+12:15035:x1876180399677952:12345-192.168.203.49@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789265520.256785:0:17184:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789265520.256808:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789265520.256812:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789265520.256815:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789265520.256818:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789265520.256820:0:17184:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1789265520.258774:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0529895c-e416-4b40-9cbc-d7eabe178719+12:15035:x1876180399677952:12345-192.168.203.49@tcp:256:mount.lustre.0 Request processed in 2004us (2190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265520.258787:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 138 00000100:00100000:0.0:1789265520.267063:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265520.267171:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399678080 00000100:00100000:3.0:1789265520.267181:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399678080 00000100:00100000:3.0:1789265520.267345:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 139 00000100:00100000:3.0:1789265520.267355:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+12:15035:x1876180399678080:12345-192.168.203.49@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789265520.267387:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265520.267406:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc882b6c00/0x9272d942b4a97c7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc212 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265520.267434:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc882b6c00/0x9272d942b4a97c7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc212 expref: 13 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265520.267446:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc882b6c00/0x9272d942b4a97c7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc212 expref: 13 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265520.267455:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6c00, rc 0) 00000100:00100000:3.0:1789265520.267514:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+13:15035:x1876180399678080:12345-192.168.203.49@tcp:101:mount.lustre.0 Request processed in 161us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265520.267521:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 139 00000100:00100000:0.0:1789265520.270050:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265520.271398:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399678208 00000100:00100000:1.0:1789265520.271412:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399678208 00000100:00100000:1.0:1789265520.271483:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 140 00000100:00100000:1.0:1789265520.271493:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0529895c-e416-4b40-9cbc-d7eabe178719+13:15035:x1876180399678208:12345-192.168.203.49@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789265520.272151:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0529895c-e416-4b40-9cbc-d7eabe178719+13:15035:x1876180399678208:12345-192.168.203.49@tcp:501:mount.lustre.0 Request processed in 657us (2106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265520.272161:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 140 00000100:00100000:0.0:1789265520.275081:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265520.275177:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399678336 00000100:00100000:3.0:1789265520.275186:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399678336 00000100:00100000:3.0:1789265520.275323:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 141 00000100:00100000:3.0:1789265520.275334:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+13:15035:x1876180399678336:12345-192.168.203.49@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789265520.275548:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+13:15035:x1876180399678336:12345-192.168.203.49@tcp:503:mount.lustre.0 Request processed in 215us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265520.275557:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 141 00000100:00100000:0.0:1789265520.279177:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265520.279372:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399678464 00000100:00100000:2.0:1789265520.279382:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399678464 00000100:00100000:2.0:1789265520.279444:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 142 00000100:00100000:2.0:1789265520.279453:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0529895c-e416-4b40-9cbc-d7eabe178719+13:15044:x1876180399678464:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265520.279587:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0529895c-e416-4b40-9cbc-d7eabe178719+13:15044:x1876180399678464:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 134us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265520.279595:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 142 00000100:00100000:0.0:1789265520.284100:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265520.284168:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399678592 00000100:00100000:3.0:1789265520.284180:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399678592 00000100:00100000:3.0:1789265520.284235:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 143 00000100:00100000:3.0:1789265520.284245:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8a56e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+13:15044:x1876180399678592:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789265520.284401:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8a56e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+13:15044:x1876180399678592:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 157us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265520.284415:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 143 00000100:00100000:0.0:1789265520.302347:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265520.302387:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265520.302423:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265520.302451:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265520.302465:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265520.302483:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265520.302734:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399678720 00000100:00100000:1.0:1789265520.302744:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399678720 00000100:00100000:1.0:1789265520.302773:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399679488 00000100:00100000:1.0:1789265520.302776:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399679488 00000100:00100000:1.0:1789265520.302798:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399679360 00000100:00100000:1.0:1789265520.302800:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399679360 00000100:00100000:1.0:1789265520.302809:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399678976 00000100:00100000:1.0:1789265520.302812:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399678976 00000100:00100000:1.0:1789265520.302824:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 40 00000100:00100000:1.0:1789265520.302834:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:befb0935-501c-4d01-87d3-564eb87bef45+6:2396:x1876180399679488:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265520.302917:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:befb0935-501c-4d01-87d3-564eb87bef45+6:2396:x1876180399679488:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 85us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265520.302925:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 40 00000100:00100000:1.0:1789265520.302941:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 41 00000100:00100000:1.0:1789265520.302948:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:befb0935-501c-4d01-87d3-564eb87bef45+7:2396:x1876180399679360:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265520.302980:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:befb0935-501c-4d01-87d3-564eb87bef45+7:2396:x1876180399679360:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 23us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265520.302986:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 41 00000100:00100000:1.0:1789265520.303002:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 16 00000100:00100000:1.0:1789265520.303007:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2392:x1876180399678720:12345-192.168.203.49@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789265520.303066:0:17193:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 32f639db-fb18-46c7-87cd-9f5b45c18fc6@192.168.203.49@tcp t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:1.0:1789265520.303098:0:17193:0:(genops.c:1385:class_connect()) connect: client 32f639db-fb18-46c7-87cd-9f5b45c18fc6, cookie 0x9272d942b4a97c84 00000004:00100000:1.0:1789265520.303134:0:17193:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789265520.303233:0:17193:0:(import.c:65:import_set_state_nolock()) ffff9fccafac2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265520.303276:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:2392:x1876180399678720:12345-192.168.203.49@tcp:38:mount.lustre.0 Request processed in 266us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265520.303283:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 16 00000100:00100000:1.0:1789265520.303298:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 17 00000100:00100000:1.0:1789265520.303302:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2392:x1876180399678976:12345-192.168.203.49@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789265520.303317:0:17193:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 32f639db-fb18-46c7-87cd-9f5b45c18fc6@192.168.203.49@tcp t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:1.0:1789265520.303339:0:17193:0:(genops.c:1385:class_connect()) connect: client 32f639db-fb18-46c7-87cd-9f5b45c18fc6, cookie 0x9272d942b4a97c8b 00000004:00100000:1.0:1789265520.303351:0:17193:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789265520.303394:0:17193:0:(import.c:65:import_set_state_nolock()) ffff9fccafac7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265520.303420:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:2392:x1876180399678976:12345-192.168.203.49@tcp:38:mount.lustre.0 Request processed in 116us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265520.303427:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 17 00000100:00100000:3.0:1789265520.303905:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399679744 00000100:00100000:3.0:1789265520.303912:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399679744 00000100:00100000:3.0:1789265520.303956:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399679616 00000100:00100000:3.0:1789265520.303960:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399679616 00000100:00100000:3.0:1789265520.303996:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 3 00000100:00100000:3.0:1789265520.304003:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:befb0935-501c-4d01-87d3-564eb87bef45+6:2396:x1876180399679744:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265520.304069:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:befb0935-501c-4d01-87d3-564eb87bef45+6:2396:x1876180399679744:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 65us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265520.304076:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 3 00000100:00100000:3.0:1789265520.304090:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 4 00000100:00100000:3.0:1789265520.304098:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:befb0935-501c-4d01-87d3-564eb87bef45+6:2396:x1876180399679616:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265520.304122:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:befb0935-501c-4d01-87d3-564eb87bef45+6:2396:x1876180399679616:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 26us (1656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265520.304127:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 4 00000100:00100000:1.0:1789265520.309279:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265520.309319:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265520.309438:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399679104 00000100:00100000:0.0:1789265520.309447:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399679104 00000100:00100000:0.0:1789265520.309508:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399678848 00000100:00100000:0.0:1789265520.309511:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399678848 00000100:00100000:0.0:1789265520.309531:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 18 00000100:00100000:0.0:1789265520.309539:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:0:x1876180399679104:12345-192.168.203.49@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789265520.309566:0:17193:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789265520.309623:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:0:x1876180399679104:12345-192.168.203.49@tcp:41:mount.lustre.0 Request processed in 85us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265520.309631:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 18 00000100:00100000:0.0:1789265520.309666:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 19 00000100:00100000:0.0:1789265520.309672:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83daad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:0:x1876180399678848:12345-192.168.203.49@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789265520.309682:0:17193:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00080000:1.0:1789265520.310198:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265520.310203:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265520.310462:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83daad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:0:x1876180399678848:12345-192.168.203.49@tcp:41:mount.lustre.0 Request processed in 787us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265520.310471:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 19 00000100:00100000:1.0:1789265520.316526:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265520.318190:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399679232 00000100:00100000:2.0:1789265520.318202:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399679232 00000100:00100000:2.0:1789265520.318310:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 20 00000100:00100000:2.0:1789265520.318321:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:15035:x1876180399679232:12345-192.168.203.49@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789265520.318353:0:19245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789265520.318443:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:15035:x1876180399679232:12345-192.168.203.49@tcp:41:mount.lustre.0 Request processed in 123us (1925us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265520.318450:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 20 00000100:00100000:3.0:1789265520.322219:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265520.325265:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399679872 00000100:00100000:0.0:1789265520.325278:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399679872 00000100:00100000:0.0:1789265520.325362:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 21 00000100:00100000:0.0:1789265520.325373:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:15035:x1876180399679872:12345-192.168.203.49@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789265520.325467:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:15035:x1876180399679872:12345-192.168.203.49@tcp:40:mount.lustre.0 Request processed in 95us (3258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265520.325474:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 21 00000100:00100000:3.0:1789265520.331948:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265520.332091:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265520.332926:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399680000 00000100:00100000:1.0:1789265520.332936:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399680000 00000100:00100000:1.0:1789265520.332986:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 18 00000100:00100000:1.0:1789265520.332994:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2392:x1876180399680000:12345-192.168.203.49@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789265520.333042:0:18701:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 32f639db-fb18-46c7-87cd-9f5b45c18fc6@192.168.203.49@tcp t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:1.0:1789265520.333074:0:18701:0:(genops.c:1385:class_connect()) connect: client 32f639db-fb18-46c7-87cd-9f5b45c18fc6, cookie 0x9272d942b4a97c92 00002000:00100000:1.0:1789265520.333087:0:18701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 32f639db-fb18-46c7-87cd-9f5b45c18fc6/ffff9fccafac3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789265520.333110:0:18701:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789265520.333188:0:18701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789265520.333219:0:18701:0:(import.c:65:import_set_state_nolock()) ffff9fccafac0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265520.333221:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399680256 00000100:00100000:2.0:1789265520.333225:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399680256 00000100:00100000:2.0:1789265520.333310:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 4 00000100:00100000:2.0:1789265520.333318:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:15035:x1876180399680256:12345-192.168.203.49@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789265520.333389:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:15035:x1876180399680256:12345-192.168.203.49@tcp:900:mount.lustre.0 Request processed in 71us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265520.333396:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 4 00000100:00100000:1.0:1789265520.333474:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:2392:x1876180399680000:12345-192.168.203.49@tcp:8:mount.lustre.0 Request processed in 479us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265520.333482:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 18 00000100:00100000:1.0:1789265520.334592:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265520.334666:0:19247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399680128 00000100:00100000:3.0:1789265520.334673:0:19247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399680128 00000100:00100000:3.0:1789265520.334728:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 19 00000100:00100000:3.0:1789265520.334734:0:19247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1876180399680128:12345-192.168.203.49@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789265520.334763:0:19247:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 32f639db-fb18-46c7-87cd-9f5b45c18fc6@192.168.203.49@tcp t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:3.0:1789265520.334790:0:19247:0:(genops.c:1385:class_connect()) connect: client 32f639db-fb18-46c7-87cd-9f5b45c18fc6, cookie 0x9272d942b4a97c99 00002000:00100000:3.0:1789265520.334799:0:19247:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 32f639db-fb18-46c7-87cd-9f5b45c18fc6/ffff9fccb6ecf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789265520.334819:0:19247:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789265520.334885:0:19247:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789265520.334909:0:19247:0:(import.c:65:import_set_state_nolock()) ffff9fccb6eca800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265520.335512:0:19247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:2392:x1876180399680128:12345-192.168.203.49@tcp:8:mount.lustre.0 Request processed in 774us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265520.335522:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 19 00000100:00100000:3.0:1789265520.337677:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265520.337848:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399680384 00000100:00100000:1.0:1789265520.337858:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399680384 00000100:00100000:1.0:1789265520.337909:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1 00000100:00100000:1.0:1789265520.337920:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:15035:x1876180399680384:12345-192.168.203.49@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789265520.338019:0:17196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789265520.338137:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:15035:x1876180399680384:12345-192.168.203.49@tcp:33:mount.lustre.0 Request processed in 219us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265520.338145:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1 00000100:00100000:3.0:1789265520.525578:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265520.525667:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399680512 00000100:00100000:0.0:1789265520.525676:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399680512 00000100:00100000:0.0:1789265520.525737:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 22 00000100:00100000:0.0:1789265520.525747:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:15067:x1876180399680512:12345-192.168.203.49@tcp:101:mkdir.0 00010000:00010000:0.0:1789265520.525766:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265520.525785:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a97ca0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc243 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265520.525843:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97ca7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265520.525856:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265520.525883:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265520.525921:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789265520.525924:0:17192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265520.525940:0:17192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265520.525962:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a97ca0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc243 expref: 8 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265520.525979:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc243 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265520.525988:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcc8b0c6400) 00010000:00010000:0.0:1789265520.525990:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265520.525994:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5400, rc 0) 00000100:00100000:0.0:1789265520.526099:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32f639db-fb18-46c7-87cd-9f5b45c18fc6+7:15067:x1876180399680512:12345-192.168.203.49@tcp:101:mkdir.0 Request processed in 353us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265520.526106:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 22 00010000:00010000:2.0:1789265521.153284:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265522.177167:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789265522.694751:0:17926:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 32f639db-fb18-46c7-87cd-9f5b45c18fc6 00000001:00100000:0.0:1789265522.694764:0:17926:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of befb0935-501c-4d01-87d3-564eb87bef45 00000001:00100000:0.0:1789265522.695599:0:18696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 32f639db-fb18-46c7-87cd-9f5b45c18fc6 00000001:00100000:0.0:1789265522.695608:0:18696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of befb0935-501c-4d01-87d3-564eb87bef45 00000001:00100000:0.0:1789265522.696656:0:17172:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 32f639db-fb18-46c7-87cd-9f5b45c18fc6 00000001:00100000:0.0:1789265522.696663:0:17172:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of befb0935-501c-4d01-87d3-564eb87bef45 00000001:00100000:2.0:1789265522.697248:0:19514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 32f639db-fb18-46c7-87cd-9f5b45c18fc6 00000001:00100000:2.0:1789265522.697257:0:19514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of befb0935-501c-4d01-87d3-564eb87bef45 00010000:00010000:2.0:1789265523.201385:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789265523.617212:0:20073:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789265523.717956:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417583616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265523.718062:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265523.718151:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417583616 00000100:00100000:2.0:1789265523.718159:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417583616 00000100:00100000:2.0:1789265523.718210:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789265523.718219:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417583616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789265523.718252:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789265523.718291:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417583616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265523.718298:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789265523.718339:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417583616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265523.720332:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417583744:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265523.720396:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265523.720501:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417583744 00000100:00100000:3.0:1789265523.720509:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417583744 00000100:00100000:3.0:1789265523.720563:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789265523.720573:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417583744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265523.720602:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789265523.720650:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417583744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265523.720658:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789265523.720754:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417583744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265523.722922:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1789265523.723619:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265523.731863:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417583872:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265523.731942:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265523.736409:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417583872 00000100:00100000:1.0:1789265523.736426:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417583872 00000100:00100000:1.0:1789265523.737002:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789265523.737015:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417583872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789265523.737085:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789265523.737201:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417583872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 189us (5258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265523.737209:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789265523.737419:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417583872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265524.225381:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265524.225407:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417584000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265524.225485:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265524.225642:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417584000 00000100:00100000:1.0:1789265524.225663:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417584000 00000100:00100000:1.0:1789265524.225733:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789265524.225754:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417584000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265524.225776:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789265524.225838:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417584000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265524.225845:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1789265524.225866:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789265524.226007:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265524.226084:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417584128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265524.226110:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265524.226142:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417584000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265524.226766:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417584128 00000100:00100000:1.0:1789265524.226772:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417584128 00000100:00100000:1.0:1789265524.226829:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789265524.226838:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417584128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265524.226858:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789265524.226906:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417584128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265524.226912:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1789265524.228107:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265524.228159:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417584128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265524.228941:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265524.228958:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417584256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265524.229015:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265524.229146:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417584256 00000100:00100000:3.0:1789265524.229154:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417584256 00000100:00100000:3.0:1789265524.229216:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789265524.229241:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417584256:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265524.229265:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417584512:0@lo:400:kworker.0 00002000:00000024:3.0:1789265524.229266:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789265524.229312:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265524.229324:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417584256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265524.229333:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789265524.229352:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417585024:0@lo:400:kworker.0 00000100:00100000:3.0:1789265524.229375:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417584768:0@lo:400:kworker.0 00000100:00100000:1.0:1789265524.229390:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265524.229408:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417585536:0@lo:400:kworker.0 00000100:00100000:3.0:1789265524.229427:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265524.229439:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265524.229455:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417585280:0@lo:400:kworker.0 00000100:00100000:1.0:1789265524.229465:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789265524.229474:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417584640:0@lo:400:kworker.0 00000100:00100000:3.0:1789265524.229485:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265524.229545:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417585024 00000100:00100000:0.0:1789265524.229550:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417585024 00000100:00100000:0.0:1789265524.229578:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417585536 00000100:00100000:0.0:1789265524.229581:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417585536 00000100:00100000:0.0:1789265524.229595:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417585280 00000100:00100000:0.0:1789265524.229597:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417585280 00000100:00100000:0.0:1789265524.229610:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789265524.229617:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417585024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265524.229678:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265524.229702:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417585152:0@lo:400:kworker.0 00000100:00100000:1.0:1789265524.229728:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265524.229769:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417584512 00000100:00100000:1.0:1789265524.229772:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417584512 00000100:00100000:1.0:1789265524.229795:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417584768 00000100:00100000:1.0:1789265524.229798:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417584768 00000100:00100000:1.0:1789265524.229809:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789265524.229824:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417584512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265524.229862:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417584512:12345-0@lo:400:kworker.0 Request processed in 47us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265524.229869:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789265524.229881:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789265524.229888:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417584768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265524.229915:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417584768:12345-0@lo:400:kworker.0 Request processed in 28us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265524.229921:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789265524.229937:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417584640 00000100:00100000:1.0:1789265524.229941:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417584640 00000100:00100000:1.0:1789265524.229955:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417585152 00000100:00100000:1.0:1789265524.229957:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417585152 00000100:00100000:1.0:1789265524.229971:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789265524.229977:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417585536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265524.230943:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417585536:12345-0@lo:400:kworker.0 Request processed in 962us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265524.230954:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789265524.230978:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789265524.230989:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417585280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265524.231116:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417585280:12345-0@lo:400:kworker.0 Request processed in 131us (1631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265524.231136:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789265524.231150:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789265524.231157:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417584640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265524.231187:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417584640:12345-0@lo:400:kworker.0 Request processed in 31us (1510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265524.231193:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789265524.231204:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789265524.231210:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417585152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265524.231253:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417585152:12345-0@lo:400:kworker.0 Request processed in 43us (1524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265524.231260:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789265524.231307:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417584640:0@lo:400:kworker.0 00000100:00100000:1.0:1789265524.231318:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417585152:0@lo:400:kworker.0 00000100:00100000:1.0:1789265524.231330:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417584512:0@lo:400:kworker.0 00010000:00080000:1.0:1789265524.231343:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc8376dc00 x1876180417585536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265524.231353:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417585536:0@lo:400:kworker.0 00000100:00080000:1.0:1789265524.231400:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265524.231404:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265524.231408:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265524.231731:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a57aa04c-0472-45c4-bafc-6983957e249b:3642:1876180417584384:0@lo:400:kworker.0 00000100:00100000:2.0:1789265524.231783:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265524.231835:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417584896:0@lo:400:kworker.0 00000100:00100000:2.0:1789265524.231861:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265524.231879:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180417585408:0@lo:400:kworker.0 00000100:00100000:2.0:1789265524.231927:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265524.231963:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417584256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265524.231991:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417585408 00000100:00100000:2.0:1789265524.232008:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417585408 00000100:00100000:2.0:1789265524.232072:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789265524.232079:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876180417585408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265524.232116:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876180417585408:12345-0@lo:400:kworker.0 Request processed in 38us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265524.232123:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1789265524.232141:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265524.232158:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180417585408:0@lo:400:kworker.0 00000100:00100000:1.0:1789265524.232497:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417584384 00000100:00100000:1.0:1789265524.232503:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417584384 00000100:00100000:1.0:1789265524.232546:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789265524.232553:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8a56e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+24:3642:x1876180417584384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265524.232599:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8a56e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+24:3642:x1876180417584384:12345-0@lo:400:kworker.0 Request processed in 47us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265524.232605:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789265524.232633:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417584896 00000100:00100000:1.0:1789265524.232637:0:19582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417584896 00000100:00100000:1.0:1789265524.232666:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265524.232673:0:19582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417584896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265524.232712:0:19582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417584896:12345-0@lo:400:kworker.0 Request processed in 40us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265524.232718:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265524.234175:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a57aa04c-0472-45c4-bafc-6983957e249b:3642:1876180417584384:0@lo:400:kworker.0 00000100:00100000:2.0:1789265524.234195:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417584896:0@lo:400:kworker.0 00010000:00080000:3.0:1789265524.235663:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc8376d500 x1876180417585280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265524.235689:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417585280:0@lo:400:kworker.0 00000100:00100000:3.0:1789265524.235727:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417584768:0@lo:400:kworker.0 00000100:00100000:0.0:1789265524.236094:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417585024:12345-0@lo:400:kworker.0 Request processed in 6474us (6701us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265524.236106:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789265524.238141:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417585024:0@lo:400:kworker.0 00010000:00010000:2.0:1789265525.250892:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265525.574311:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265525.574344:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265525.574361:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265525.574381:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265525.574402:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399681024 00000100:00100000:0.0:1789265525.574410:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399681024 00000100:00100000:0.0:1789265525.574456:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399681536 00000100:00100000:0.0:1789265525.574469:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399681536 00000100:00100000:0.0:1789265525.574491:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 6 00000100:00100000:0.0:1789265525.574499:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:befb0935-501c-4d01-87d3-564eb87bef45+5:2396:x1876180399681024:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265525.574557:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:befb0935-501c-4d01-87d3-564eb87bef45+5:2396:x1876180399681024:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 58us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265525.574564:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 6 00000100:00100000:0.0:1789265525.574579:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:0.0:1789265525.574585:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2396:x1876180399681536:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265525.574604:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2396:x1876180399681536:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 19us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265525.574609:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:0.0:1789265525.574623:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399680768 00000100:00100000:0.0:1789265525.574626:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399680768 00000100:00100000:0.0:1789265525.574646:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399681280 00000100:00100000:0.0:1789265525.574648:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399681280 00000100:00100000:0.0:1789265525.574663:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 48 00000100:00100000:0.0:1789265525.574669:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:befb0935-501c-4d01-87d3-564eb87bef45+6:2396:x1876180399680768:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265525.574704:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:befb0935-501c-4d01-87d3-564eb87bef45+6:2396:x1876180399680768:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 35us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265525.574710:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 48 00000100:00100000:0.0:1789265525.574721:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 49 00000100:00100000:0.0:1789265525.574727:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:2396:x1876180399681280:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265525.574743:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:2396:x1876180399681280:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 16us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265525.574748:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 49 00000100:00080000:0.0:1789265525.574772:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265525.574776:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265525.578002:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265525.578055:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265525.578081:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265525.578102:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265525.578125:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265525.578160:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399680640 00000100:00100000:0.0:1789265525.578169:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399680640 00000100:00100000:2.0:1789265525.578214:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399680896 00000100:00100000:2.0:1789265525.578220:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399680896 00000100:00100000:0.0:1789265525.578224:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 145 00000100:00100000:0.0:1789265525.578236:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0529895c-e416-4b40-9cbc-d7eabe178719+13:2396:x1876180399680640:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265525.578265:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399681408 00000100:00100000:2.0:1789265525.578270:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399681408 00000100:00100000:2.0:1789265525.578289:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 50 00000100:00100000:2.0:1789265525.578298:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:befb0935-501c-4d01-87d3-564eb87bef45+5:2396:x1876180399680896:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265525.578306:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0529895c-e416-4b40-9cbc-d7eabe178719+13:2396:x1876180399680640:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 70us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265525.578314:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 145 00000100:00100000:2.0:1789265525.578337:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:befb0935-501c-4d01-87d3-564eb87bef45+5:2396:x1876180399680896:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 40us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265525.578344:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 50 00000100:00100000:0.0:1789265525.578353:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399681152 00000100:00100000:0.0:1789265525.578359:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399681152 00000100:00100000:2.0:1789265525.578364:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 51 00000100:00100000:2.0:1789265525.578373:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2396:x1876180399681408:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265525.578391:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399681664 00000100:00100000:0.0:1789265525.578396:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399681664 00000100:00100000:2.0:1789265525.578409:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2396:x1876180399681408:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 37us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265525.578416:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 51 00000100:00100000:0.0:1789265525.578426:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 8 00000100:00100000:0.0:1789265525.578436:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:befb0935-501c-4d01-87d3-564eb87bef45+5:2396:x1876180399681152:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265525.578463:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:befb0935-501c-4d01-87d3-564eb87bef45+5:2396:x1876180399681152:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 30us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265525.578470:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 8 00000100:00100000:0.0:1789265525.578483:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 9 00000100:00100000:0.0:1789265525.578490:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2396:x1876180399681664:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265525.578532:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2396:x1876180399681664:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 42us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265525.578544:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 9 00000100:00080000:0.0:1789265525.578577:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265525.578582:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:1.0:1789265525.832757:0:17228:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789265526.283046:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789265527.247424:0:20220:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd90f66de0 20000000:00000080:2.0:1789265527.247441:0:20220:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fccbc15b000 uarg=0000000000000000 20000000:01000000:2.0:1789265527.247479:0:20220:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789265527.247485:0:20220:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789265527.247489:0:20220:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789265527.247943:0:20221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1789265527.248252:0:20220:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789265527.258268:0:20220:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789265527.258300:0:20220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fcb84a2e600/0x9272d942b4a97cae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265527.258319:0:20220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcb83da5c00/0x9272d942b4a97943 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9793c expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265527.258327:0:20220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcb84a2fc00/0x9272d942b4a97951 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9794a expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265527.258334:0:20220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcb83da4000/0x9272d942b4a97990 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a97989 expref: 23 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265527.258340:0:20220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc882b7a00/0x9272d942b4a97a2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a97a23 expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265527.258349:0:20220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc882b6800/0x9272d942b4a97c3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc1a2 expref: 12 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265527.258356:0:20220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc882b6c00/0x9272d942b4a97c7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc212 expref: 12 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265527.258378:0:20220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fcb84a2e600/0x9272d942b4a97cae lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265527.258423:0:20220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc882b6c00/0x9272d942b4a97c7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc212 expref: 12 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265527.258438:0:20220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcc882b6c00/0x9272d942b4a97c7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc212 expref: 12 pid: 17186 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265527.258452:0:20220:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d27b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20220:1876180417585664:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265527.258558:0:20220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc882b6800/0x9272d942b4a97c3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc1a2 expref: 12 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265527.258567:0:20220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcc882b6800/0x9272d942b4a97c3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc1a2 expref: 12 pid: 17186 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265527.258577:0:20220:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d25880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20220:1876180417585792:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265527.258610:0:20220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc882b7a00/0x9272d942b4a97a2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a97a23 expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265527.258619:0:20220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcc882b7a00/0x9272d942b4a97a2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a97a23 expref: 23 pid: 17186 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265527.258628:0:20220:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d26d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20220:1876180417585920:0@lo:104: 00000100:00100000:2.0:1789265527.258684:0:20220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265527.258734:0:20220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcb83da4000/0x9272d942b4a97990 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a97989 expref: 23 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265527.258753:0:20220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcb83da4000/0x9272d942b4a97990 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a97989 expref: 23 pid: 17187 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265527.258761:0:20220:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d26680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20220:1876180417586048:0@lo:104: 00000100:00100000:2.0:1789265527.258786:0:20220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265527.258820:0:20220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcb84a2fc00/0x9272d942b4a97951 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a9794a expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265527.258828:0:20220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcb84a2fc00/0x9272d942b4a97951 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a9794a expref: 23 pid: 17184 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265527.258836:0:20220:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d25c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20220:1876180417586176:0@lo:104: 00000100:00100000:2.0:1789265527.258870:0:20220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265527.258890:0:20220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcb83da5c00/0x9272d942b4a97943 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a9793c expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265527.258897:0:20220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcb83da5c00/0x9272d942b4a97943 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a9793c expref: 23 pid: 17184 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265527.258905:0:20220:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d26300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20220:1876180417586304:0@lo:104: 00000100:00100000:2.0:1789265527.258923:0:20220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265527.258932:0:20220:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc83951900 going to sleep for 11 seconds 00000100:00100000:3.0:1789265527.259066:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417585920 00000100:00100000:3.0:1789265527.259074:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417585920 00000100:00100000:3.0:1789265527.259114:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417586048 00000100:00100000:3.0:1789265527.259117:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417586048 00000100:00100000:3.0:1789265527.259128:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417586176 00000100:00100000:3.0:1789265527.259130:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417586176 00000100:00100000:3.0:1789265527.259140:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417586304 00000100:00100000:3.0:1789265527.259142:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417586304 00000100:00100000:3.0:1789265527.259153:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265527.259161:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a57aa04c-0472-45c4-bafc-6983957e249b+6:20220:x1876180417585920:12345-0@lo:104: 00010000:00010000:3.0:1789265527.259174:0:17176:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a97a23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a97a2a expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.259365:0:17176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789265527.259372:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a57aa04c-0472-45c4-bafc-6983957e249b+6:20220:x1876180417585920:12345-0@lo:104: Request processed in 212us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265527.259379:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265527.259398:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789265527.259406:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a57aa04c-0472-45c4-bafc-6983957e249b+5:20220:x1876180417586048:12345-0@lo:104: 00010000:00010000:3.0:1789265527.259414:0:17176:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7200/0x9272d942b4a97989 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a97990 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.259455:0:17176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789265527.259460:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a57aa04c-0472-45c4-bafc-6983957e249b+5:20220:x1876180417586048:12345-0@lo:104: Request processed in 57us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265527.259466:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789265527.259477:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789265527.259483:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a57aa04c-0472-45c4-bafc-6983957e249b+4:20220:x1876180417586176:12345-0@lo:104: 00010000:00010000:3.0:1789265527.259489:0:17176:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a9794a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a97951 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.259519:0:17176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789265527.259524:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a57aa04c-0472-45c4-bafc-6983957e249b+4:20220:x1876180417586176:12345-0@lo:104: Request processed in 42us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265527.259530:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789265527.259542:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789265527.259548:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a57aa04c-0472-45c4-bafc-6983957e249b+3:20220:x1876180417586304:12345-0@lo:104: 00010000:00010000:3.0:1789265527.259556:0:17176:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a9793c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a97943 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.259620:0:17176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789265527.259625:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a57aa04c-0472-45c4-bafc-6983957e249b+3:20220:x1876180417586304:12345-0@lo:104: Request processed in 78us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265527.259631:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789265527.259653:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789265527.259659:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a97a23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a97a2a expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.259685:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4a00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:3.0:1789265527.259689:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a97a23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a97a2a expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.259696:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a97a23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a97a2a expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265527.259703:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a97a23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a97a2a expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265527.259708:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789265527.259736:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a97a23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a97a2a expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.259742:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265527.259761:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a97a23 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a97a2a expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.259767:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a97a23 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a97a2a expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.259781:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789265527.259784:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7200/0x9272d942b4a97989 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a97990 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.259789:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7200 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:3.0:1789265527.259791:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7200/0x9272d942b4a97989 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a97990 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.259807:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7200/0x9272d942b4a97989 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a97990 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265527.259815:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7200/0x9272d942b4a97989 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a97990 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265527.259820:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789265527.259833:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7200/0x9272d942b4a97989 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a97990 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.259839:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265527.259854:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7200/0x9272d942b4a97989 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a97990 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.259860:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7200/0x9272d942b4a97989 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a97990 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.259868:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265527.259871:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a9794a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a97951 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.259876:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f52c00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:3.0:1789265527.259879:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a9794a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a97951 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.259886:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a9794a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a97951 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265527.259892:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a9794a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a97951 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265527.259903:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789265527.259916:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a9794a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a97951 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265527.260103:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265527.260110:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a9793c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a97943 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265527.260116:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f52e00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:1.0:1789265527.260119:0:19586:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a9793c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a97943 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265527.260125:0:19586:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a9793c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a97943 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265527.260132:0:19586:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a9793c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a97943 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265527.260137:0:19586:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789265527.260153:0:19586:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a9793c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a97943 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265527.260165:0:19586:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265527.260172:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a9793c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a97943 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265527.260179:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52e00/0x9272d942b4a9793c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a97943 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265527.260189:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265527.260191:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265527.260192:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265527.260217:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a57aa04c-0472-45c4-bafc-6983957e249b:3644:1876180417586432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265527.260251:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265527.260306:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417586432 00000100:00100000:1.0:1789265527.260310:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417586432 00010000:00010000:1.0:1789265527.260340:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc882b7a00/0x9272d942b4a97a2a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a97a23 expref: 24 pid: 17186 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265527.260364:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789265527.260371:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a57aa04c-0472-45c4-bafc-6983957e249b+24:3644:x1876180417586432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265527.260382:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265527.260387:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc882b7a00/0x9272d942b4a97a2a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a97a23 expref: 24 pid: 17186 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265527.260396:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc882b7a00/0x9272d942b4a97a2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a97a23 expref: 24 pid: 17186 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265527.260414:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265527.260440:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a57aa04c-0472-45c4-bafc-6983957e249b+24:3644:x1876180417586432:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265527.260454:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789265527.260491:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a57aa04c-0472-45c4-bafc-6983957e249b:3644:1876180417586432:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265527.261212:0:20220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b7a00/0x9272d942b4a97a2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a97a23 expref: 23 pid: 17186 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265527.261226:0:20220:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d26d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20220:1876180417585920:0@lo:104: 00000100:00100000:2.0:1789265527.261238:0:20220:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d26680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20220:1876180417586048:0@lo:104: 00000100:00100000:2.0:1789265527.261246:0:20220:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d25c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20220:1876180417586176:0@lo:104: 00000100:00100000:2.0:1789265527.261266:0:20220:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d26300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20220:1876180417586304:0@lo:104: 00010000:00010000:2.0:1789265527.261305:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265527.261326:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a57aa04c-0472-45c4-bafc-6983957e249b:3641:1876180417586560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265527.261359:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265527.261400:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265527.261406:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a57aa04c-0472-45c4-bafc-6983957e249b:3641:1876180417586816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265527.261425:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265527.261500:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265527.261529:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a9794a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a97951 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.261536:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52c00/0x9272d942b4a9794a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a97951 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.261551:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265527.261553:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265527.261555:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265527.261690:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417586560 00000100:00100000:0.0:1789265527.261695:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417586560 00010000:00010000:0.0:1789265527.261723:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcb83da4000/0x9272d942b4a97990 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a97989 expref: 23 pid: 17187 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265527.261747:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417586816 00000100:00100000:0.0:1789265527.261751:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417586816 00010000:00010000:0.0:1789265527.261761:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcb83da5c00/0x9272d942b4a97943 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9793c expref: 24 pid: 17184 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265527.261788:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265527.261795:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a57aa04c-0472-45c4-bafc-6983957e249b+24:3641:x1876180417586560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265527.261803:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265527.261807:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcb83da4000/0x9272d942b4a97990 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a97989 expref: 24 pid: 17187 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265527.261815:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcb83da4000/0x9272d942b4a97990 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a97989 expref: 24 pid: 17187 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265527.261828:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb83da4000/0x9272d942b4a97990 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a97989 expref: 24 pid: 17187 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265527.261838:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265527.261874:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a57aa04c-0472-45c4-bafc-6983957e249b+23:3641:x1876180417586560:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265527.261890:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265527.261907:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789265527.261913:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a57aa04c-0472-45c4-bafc-6983957e249b+22:3641:x1876180417586816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265527.261920:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265527.261937:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcb83da5c00/0x9272d942b4a97943 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9793c expref: 22 pid: 17184 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265527.261946:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcb83da5c00/0x9272d942b4a97943 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a9793c expref: 22 pid: 17184 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265527.261969:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb83da5c00/0x9272d942b4a97943 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a9793c expref: 22 pid: 17184 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265527.261979:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265527.262002:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a57aa04c-0472-45c4-bafc-6983957e249b+21:3641:x1876180417586816:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265527.262008:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789265527.262073:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a57aa04c-0472-45c4-bafc-6983957e249b:3641:1876180417586816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265527.262081:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a57aa04c-0472-45c4-bafc-6983957e249b:3641:1876180417586560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265527.264363:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a57aa04c-0472-45c4-bafc-6983957e249b:3643:1876180417586688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265527.264431:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265527.268452:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417586688 00000100:00100000:0.0:1789265527.268469:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417586688 00010000:00010000:0.0:1789265527.268524:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcb84a2fc00/0x9272d942b4a97951 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9794a expref: 21 pid: 17184 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265527.268554:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265527.268564:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a57aa04c-0472-45c4-bafc-6983957e249b+21:3643:x1876180417586688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265527.268579:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265527.268610:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcb84a2fc00/0x9272d942b4a97951 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9794a expref: 21 pid: 17184 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265527.268622:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcb84a2fc00/0x9272d942b4a97951 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a9794a expref: 21 pid: 17184 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265527.268641:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb84a2fc00/0x9272d942b4a97951 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a9794a expref: 21 pid: 17184 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265527.268657:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265527.268745:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a57aa04c-0472-45c4-bafc-6983957e249b+20:3643:x1876180417586688:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (4314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265527.268753:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265527.268822:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a57aa04c-0472-45c4-bafc-6983957e249b:3643:1876180417586688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265527.274361:0:20220:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d27b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20220:1876180417585664:192.168.203.49@tcp:104: 00000100:00100000:1.0:1789265527.278737:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265527.278770:0:20220:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d25880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20220:1876180417585792:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265527.278824:0:20220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fcb84a2e600/0x9272d942b4a97cae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265527.278836:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265527.278935:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399681920 00000100:00100000:3.0:1789265527.278943:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399681920 00010000:00010000:3.0:1789265527.278994:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc882b6800/0x9272d942b4a97c3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc1a2 expref: 13 pid: 17186 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265527.279046:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399681792 00000100:00100000:3.0:1789265527.279050:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399681792 00010000:00010000:3.0:1789265527.279062:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc882b6c00/0x9272d942b4a97c7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc212 expref: 14 pid: 17186 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265527.279077:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 13 00000100:00100000:3.0:1789265527.279084:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821ad450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0529895c-e416-4b40-9cbc-d7eabe178719+14:2395:x1876180399681920:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265527.279119:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265527.279127:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc882b6800/0x9272d942b4a97c3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc1a2 expref: 14 pid: 17186 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.279148:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc882b6800/0x9272d942b4a97c3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc1a2 expref: 14 pid: 17186 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.279166:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b6800/0x9272d942b4a97c3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc1a2 expref: 14 pid: 17186 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.279181:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265527.279239:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821ad450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0529895c-e416-4b40-9cbc-d7eabe178719+13:2395:x1876180399681920:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 154us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265527.279248:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 13 00000100:00100000:3.0:1789265527.279291:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 14 00000100:00100000:3.0:1789265527.279298:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0529895c-e416-4b40-9cbc-d7eabe178719+12:2395:x1876180399681792:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265527.279306:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265527.279310:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc882b6c00/0x9272d942b4a97c7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc212 expref: 12 pid: 17186 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.279320:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc882b6c00/0x9272d942b4a97c7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc212 expref: 12 pid: 17186 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.279331:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b6c00/0x9272d942b4a97c7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc212 expref: 12 pid: 17186 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.279343:0:17177:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fcb84a2e600/0x9272d942b4a97cae lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.279351:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb84a2e600/0x9272d942b4a97cae lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.279375:0:17177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fcb84a2e600/0x9272d942b4a97cae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.279382:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fcb84a2e600/0x9272d942b4a97cae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.279389:0:17177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fcb84a2e600/0x9272d942b4a97cae lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.279397:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fcb84a2e600/0x9272d942b4a97cae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.279403:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e600 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265527.279407:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fcb84a2e600/0x9272d942b4a97cae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.279414:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fcb84a2e600/0x9272d942b4a97cae lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.279840:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fcb84a2e600/0x9272d942b4a97cae lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265527.279848:0:20220:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fcb84a2e600/0x9272d942b4a97cae lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265527.279853:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265527.279861:0:20220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fcb84a2e600/0x9272d942b4a97cae lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265527.279869:0:20220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb84a2e600/0x9272d942b4a97cae lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265527.279932:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0529895c-e416-4b40-9cbc-d7eabe178719+11:2395:x1876180399681792:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 633us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265527.279941:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 14 00010000:00010000:1.0:1789265527.313068:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265528.329360:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789265528.449788:0:17189:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265528.449795:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fccbc124800 from 13 10000000:01000000:2.0:1789265528.449800:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265528.449842:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ee00/0x9272d942b4a97cb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265528.449878:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ee00/0x9272d942b4a97cb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265528.449891:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ee00/0x9272d942b4a97cb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265528.449915:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417586944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265528.449982:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265528.450049:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc83951240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265528.450116:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417586944 00000100:00100000:0.0:1789265528.450123:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417586944 00000100:00100000:0.0:1789265528.450178:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789265528.450199:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+20:17189:x1876180417586944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265528.450212:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265528.450227:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83da4600/0x9272d942b4a97cbc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a97cb5 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265528.450249:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83da4600/0x9272d942b4a97cbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a97cb5 expref: 21 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265528.450260:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83da4600/0x9272d942b4a97cbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a97cb5 expref: 21 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265528.450269:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da4600, rc 0) 00000100:00100000:0.0:1789265528.450314:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+21:17189:x1876180417586944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265528.450321:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789265528.450456:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417586944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265528.450470:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ee00/0x9272d942b4a97cb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97cbc expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265528.450478:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ee00/0x9272d942b4a97cb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97cbc expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265528.450605:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417587072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265528.450631:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265528.450666:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc83951240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265528.450715:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417587072 00000100:00100000:0.0:1789265528.450720:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417587072 00000100:00100000:0.0:1789265528.450752:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789265528.450759:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+21:17189:x1876180417587072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265528.450870:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+21:17189:x1876180417587072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265528.450877:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789265528.450949:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417587072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265528.450976:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417587200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265528.451013:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265528.451054:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc83951240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265528.451117:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417587200 00000100:00100000:0.0:1789265528.451122:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417587200 00000100:00100000:0.0:1789265528.451145:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789265528.451151:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+21:17189:x1876180417587200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265528.451293:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+21:17189:x1876180417587200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265528.451300:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789265528.451693:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417587200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789265528.454733:0:20251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789265528.467591:0:17189:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789265528.467641:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265528.467663:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ee00/0x9272d942b4a97cb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97cbc expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265528.467676:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ee00/0x9272d942b4a97cb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97cbc expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265528.467688:0:17189:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265528.467691:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fcc82d4d000 from 13 10000000:01000000:2.0:1789265528.467694:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265528.467736:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f800/0x9272d942b4a97cc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265528.467743:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f800/0x9272d942b4a97cc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265528.467755:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f800/0x9272d942b4a97cc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265528.467779:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417587328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265528.467847:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265528.467899:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc83951240 going to sleep for 11 seconds 00000100:00100000:3.0:1789265528.467971:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417587328 00000100:00100000:3.0:1789265528.467978:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417587328 00000100:00100000:3.0:1789265528.468050:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789265528.468060:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+21:17189:x1876180417587328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265528.468079:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265528.468092:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc882b6c00/0x9272d942b4a97cca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a97cc3 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265528.468117:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc882b6c00/0x9272d942b4a97cca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a97cc3 expref: 22 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265528.468127:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc882b6c00/0x9272d942b4a97cca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a97cc3 expref: 22 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265528.468136:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6c00, rc 0) 00000100:00100000:3.0:1789265528.468179:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+22:17189:x1876180417587328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265528.468186:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789265528.468247:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417587328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265528.468260:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f800/0x9272d942b4a97cc3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97cca expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265528.468269:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f800/0x9272d942b4a97cc3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97cca expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265528.468326:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417587456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265528.468353:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265528.468369:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82dff780 going to sleep for 11 seconds 00000100:00100000:3.0:1789265528.468382:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417587456 00000100:00100000:3.0:1789265528.468385:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417587456 00000100:00100000:3.0:1789265528.468409:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789265528.468416:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+22:17189:x1876180417587456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265528.468540:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+22:17189:x1876180417587456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265528.468547:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789265528.468578:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417587456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265528.468601:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417587584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265528.468634:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265528.468662:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82dff780 going to sleep for 11 seconds 00000100:00100000:3.0:1789265528.468673:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417587584 00000100:00100000:3.0:1789265528.468676:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417587584 00000100:00100000:3.0:1789265528.468697:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789265528.468703:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+22:17189:x1876180417587584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265528.468780:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+22:17189:x1876180417587584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265528.468786:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789265528.468820:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417587584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789265528.469480:0:20252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789265528.469529:0:17189:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789265528.469548:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265528.469554:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f800/0x9272d942b4a97cc3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97cca expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265528.469562:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f800/0x9272d942b4a97cc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97cca expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265528.469571:0:17189:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789265528.469580:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fccaa073800 from 13 10000000:01000000:3.0:1789265528.469583:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789265528.469601:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a97cd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265528.469609:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a97cd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265528.469618:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a97cd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265528.469633:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417587712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789265528.469677:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265528.469694:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82dff480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265528.469709:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417587712 00000100:00100000:3.0:1789265528.469712:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417587712 00000100:00100000:3.0:1789265528.469737:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789265528.469744:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+22:17189:x1876180417587712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265528.469752:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265528.469761:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc882b7200/0x9272d942b4a97cd8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a97cd1 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265528.469777:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc882b7200/0x9272d942b4a97cd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a97cd1 expref: 23 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265528.469787:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc882b7200/0x9272d942b4a97cd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a97cd1 expref: 23 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265528.469795:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b7200, rc 0) 00000100:00100000:3.0:1789265528.469821:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+23:17189:x1876180417587712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265528.469833:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789265528.469868:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417587712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265528.469879:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a97cd1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97cd8 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265528.469887:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a97cd1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97cd8 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265528.469927:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417587840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265528.469952:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265528.469965:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82dff480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265528.469975:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417587840 00000100:00100000:3.0:1789265528.469978:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417587840 00000100:00100000:3.0:1789265528.469998:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789265528.470004:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+23:17189:x1876180417587840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265528.470099:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+23:17189:x1876180417587840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265528.470105:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789265528.470133:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417587840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265528.470155:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417587968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265528.470190:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265528.470205:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82dff480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265528.470215:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417587968 00000100:00100000:3.0:1789265528.470218:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417587968 00000100:00100000:3.0:1789265528.470238:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789265528.470251:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+23:17189:x1876180417587968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265528.470317:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+23:17189:x1876180417587968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265528.470324:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789265528.470361:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417587968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789265528.474014:0:20253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789265528.482392:0:17189:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789265528.482432:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265528.482445:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a97cd1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97cd8 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265528.482457:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a97cd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97cd8 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265528.482468:0:17189:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789265528.482471:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fcb83933000 from 13 10000000:01000000:3.0:1789265528.482473:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789265528.482510:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a97cdf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265528.482517:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a97cdf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265528.482526:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a97cdf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265528.482550:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417588096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789265528.482613:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265528.482704:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82dff480 going to sleep for 11 seconds 00000100:00100000:0.0:1789265528.486970:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417588096 00000100:00100000:0.0:1789265528.486987:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417588096 00000100:00100000:0.0:1789265528.487076:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789265528.487087:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+23:17189:x1876180417588096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265528.487103:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265528.487423:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccbd2ff000/0x9272d942b4a97ce6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a97cdf expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265528.487453:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2ff000/0x9272d942b4a97ce6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a97cdf expref: 24 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265528.487464:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccbd2ff000/0x9272d942b4a97ce6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a97cdf expref: 24 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265528.487472:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2ff000, rc 0) 00000100:00100000:1.0:1789265528.487550:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+24:17189:x1876180417588096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 466us (4937us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265528.487557:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789265528.487635:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417588096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265528.487664:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a97cdf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97ce6 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265528.487673:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a97cdf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97ce6 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265528.487756:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417588224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265528.487789:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265528.487824:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82dff480 going to sleep for 11 seconds 00000100:00100000:2.0:1789265528.487866:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417588224 00000100:00100000:2.0:1789265528.487880:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417588224 00000100:00100000:2.0:1789265528.487912:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789265528.487920:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+24:17189:x1876180417588224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265528.488060:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+24:17189:x1876180417588224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265528.488067:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789265528.488341:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417588224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265528.488372:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417588352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265528.488411:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265528.488446:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cf9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265528.488519:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417588352 00000100:00100000:3.0:1789265528.488524:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417588352 00000100:00100000:3.0:1789265528.488558:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789265528.488565:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+24:17189:x1876180417588352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265528.488644:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+24:17189:x1876180417588352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265528.488650:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789265528.488725:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a57aa04c-0472-45c4-bafc-6983957e249b:17189:1876180417588352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789265528.489718:0:20254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789265528.489950:0:17189:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789265528.489971:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265528.489981:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a97cdf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97ce6 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265528.489991:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a97cdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97ce6 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265528.839527:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417588480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265528.839642:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265528.839714:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417588480 00000100:00100000:0.0:1789265528.839721:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417588480 00000100:00100000:0.0:1789265528.839775:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789265528.839785:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417588480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789265528.839812:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789265528.839857:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417588480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265528.839864:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1789265528.839884:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265528.839920:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417588480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265528.842599:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417588608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265528.842720:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265528.842913:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417588608 00000100:00100000:0.0:1789265528.842920:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417588608 00000100:00100000:3.0:1789265528.845258:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417588736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265528.845434:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265528.845499:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417588736 00000100:00100000:1.0:1789265528.845507:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417588736 00000100:00100000:1.0:1789265528.845560:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789265528.845570:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417588736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265528.845604:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789265528.845643:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789265528.845663:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417588608:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265528.845664:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417588736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265528.845671:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000004:00000024:0.0:1789265528.845683:0:17934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789265528.845734:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417588608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (3014us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265528.845741:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789265528.845773:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417588608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265528.846447:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417588736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265529.229391:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265529.230291:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399682048 00000100:00100000:3.0:1789265529.230303:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399682048 00000100:00100000:3.0:1789265529.230432:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 158 00000100:00100000:3.0:1789265529.230442:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd2f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+11:14917:x1876180399682048:12345-192.168.203.49@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265529.230458:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265529.230474:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc882b6a00/0x9272d942b4a97ced lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc24a expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265529.230502:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc882b6a00/0x9272d942b4a97ced lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc24a expref: 12 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265529.230515:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc882b6a00/0x9272d942b4a97ced lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc24a expref: 12 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265529.230524:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6a00, rc 0) 00000100:00100000:3.0:1789265529.230588:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd2f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+12:14917:x1876180399682048:12345-192.168.203.49@tcp:101:ll_cfg_requeue.0 Request processed in 147us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265529.230595:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 158 00000100:00100000:0.0:1789265529.237841:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265529.238063:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399682176 00000100:00100000:3.0:1789265529.238073:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399682176 00000100:00100000:3.0:1789265529.238125:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 159 00000100:00100000:3.0:1789265529.238135:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8ade3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0529895c-e416-4b40-9cbc-d7eabe178719+12:14917:x1876180399682176:12345-192.168.203.49@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265529.238280:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8ade3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0529895c-e416-4b40-9cbc-d7eabe178719+12:14917:x1876180399682176:12345-192.168.203.49@tcp:501:ll_cfg_requeue.0 Request processed in 146us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265529.238288:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 159 00000100:00100000:3.0:1789265529.242104:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265529.242334:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399682304 00000100:00100000:2.0:1789265529.242344:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399682304 00000100:00100000:2.0:1789265529.242396:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 160 00000100:00100000:2.0:1789265529.242405:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+12:14917:x1876180399682304:12345-192.168.203.49@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265529.242546:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+12:14917:x1876180399682304:12345-192.168.203.49@tcp:503:ll_cfg_requeue.0 Request processed in 141us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265529.242554:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 160 00000100:00100000:1.0:1789265529.259789:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265529.259826:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399682432 00000100:00100000:1.0:1789265529.259834:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399682432 00000100:00100000:1.0:1789265529.259884:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 161 00000100:00100000:1.0:1789265529.259893:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+12:14917:x1876180399682432:12345-192.168.203.49@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265529.259909:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265529.260060:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a97cf4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc251 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265529.260095:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a97cf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc251 expref: 13 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265529.260107:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a97cf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc251 expref: 13 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265529.260117:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2ff600, rc 0) 00000100:00100000:1.0:1789265529.260245:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+13:14917:x1876180399682432:12345-192.168.203.49@tcp:101:ll_cfg_requeue.0 Request processed in 352us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265529.260253:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 161 00000100:00100000:0.0:1789265529.273542:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265529.273605:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399682560 00000100:00100000:3.0:1789265529.273616:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399682560 00000100:00100000:3.0:1789265529.273782:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 162 00000100:00100000:3.0:1789265529.273792:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0529895c-e416-4b40-9cbc-d7eabe178719+13:14917:x1876180399682560:12345-192.168.203.49@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265529.274533:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0529895c-e416-4b40-9cbc-d7eabe178719+13:14917:x1876180399682560:12345-192.168.203.49@tcp:501:ll_cfg_requeue.0 Request processed in 739us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265529.274543:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 162 00000100:00100000:1.0:1789265529.276457:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265529.276718:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399682688 00000100:00100000:3.0:1789265529.276727:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399682688 00000100:00100000:3.0:1789265529.276779:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 163 00000100:00100000:3.0:1789265529.276789:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+13:14917:x1876180399682688:12345-192.168.203.49@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265529.277148:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+13:14917:x1876180399682688:12345-192.168.203.49@tcp:503:ll_cfg_requeue.0 Request processed in 359us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265529.277156:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 163 00000100:00100000:0.0:1789265529.345262:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265529.345286:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417588864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265529.345368:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265529.345461:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265529.345517:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265529.345527:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417588992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265529.345557:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265529.345684:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417588864 00000100:00100000:0.0:1789265529.345684:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417588992 00000100:00100000:2.0:1789265529.345691:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417588864 00000100:00100000:0.0:1789265529.345691:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417588992 00000100:00100000:0.0:1789265529.345755:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789265529.345764:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417588992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789265529.345793:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789265529.345849:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417588992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265529.345856:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789265529.349371:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789265529.349385:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417588864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265529.349412:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789265529.349567:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417588864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 185us (4198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265529.349574:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789265529.349800:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a57aa04c-0472-45c4-bafc-6983957e249b:3641:1876180417589120:0@lo:400:kworker.0 00000100:00100000:3.0:1789265529.349846:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265529.349887:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417589632:0@lo:400:kworker.0 00000100:00100000:3.0:1789265529.349912:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265529.350156:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417589504:0@lo:400:kworker.0 00000100:00100000:2.0:1789265529.350338:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417589120 00000100:00100000:2.0:1789265529.350345:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417589120 00000100:00100000:2.0:1789265529.350433:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789265529.350441:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+24:3641:x1876180417589120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265529.350489:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+24:3641:x1876180417589120:12345-0@lo:400:kworker.0 Request processed in 49us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265529.350495:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789265529.350878:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417590144:0@lo:400:kworker.0 00000100:00100000:3.0:1789265529.350912:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265529.350956:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a57aa04c-0472-45c4-bafc-6983957e249b:3641:1876180417589120:0@lo:400:kworker.0 00000100:00100000:3.0:1789265529.350984:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789265529.350993:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417589248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265529.351018:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265529.351054:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417589760:0@lo:400:kworker.0 00000100:00100000:3.0:1789265529.351075:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265529.351108:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417589632 00000100:00100000:3.0:1789265529.351112:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417589632 00000100:00100000:3.0:1789265529.351143:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417590144 00000100:00100000:3.0:1789265529.351146:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417590144 00000100:00100000:3.0:1789265529.351162:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417589760 00000100:00100000:3.0:1789265529.351164:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417589760 00000100:00100000:3.0:1789265529.351178:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789265529.351184:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417589632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265529.351223:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417589632:12345-0@lo:400:kworker.0 Request processed in 39us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265529.351228:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789265529.351241:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789265529.351260:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417590144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265529.351287:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417590144:12345-0@lo:400:kworker.0 Request processed in 29us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265529.351293:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789265529.351303:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789265529.351308:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417589760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265529.351333:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417589760:12345-0@lo:400:kworker.0 Request processed in 25us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265529.351337:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789265529.351373:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417589376:0@lo:400:kworker.0 00000100:00100000:3.0:1789265529.351402:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265529.351421:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417589888:0@lo:400:kworker.0 00000100:00100000:3.0:1789265529.351440:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265529.351540:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417588992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265529.351565:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417589376 00000100:00100000:3.0:1789265529.351568:0:19582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417589376 00000100:00100000:3.0:1789265529.351598:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789265529.351611:0:19582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417589376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265529.351659:0:19582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417589376:12345-0@lo:400:kworker.0 Request processed in 44us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265529.351665:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789265529.351688:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265529.351721:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180417590016:0@lo:400:kworker.0 00000100:00100000:3.0:1789265529.351748:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265529.351786:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417589888 00000100:00100000:3.0:1789265529.351791:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417588864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265529.351793:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417589888 00000100:00100000:3.0:1789265529.351825:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417589248 00000100:00100000:3.0:1789265529.351830:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417589248 00000100:00100000:0.0:1789265529.351831:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417589504 00000100:00100000:0.0:1789265529.351836:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417589504 00000100:00100000:0.0:1789265529.351855:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417590016 00000100:00100000:0.0:1789265529.351858:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417590016 00000100:00100000:3.0:1789265529.351862:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789265529.351871:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417589248:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265529.351878:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00002000:00000024:3.0:1789265529.351884:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789265529.351889:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417589888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265529.351922:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417589248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265529.351929:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789265529.351948:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417589888:12345-0@lo:400:kworker.0 Request processed in 62us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265529.351953:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789265529.351961:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789265529.351965:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417589504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265529.351982:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789265529.351990:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180417590016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265529.352046:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180417590016:12345-0@lo:400:kworker.0 Request processed in 58us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265529.352061:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789265529.352207:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417589504:12345-0@lo:400:kworker.0 Request processed in 245us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265529.352214:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789265529.352242:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417589376:0@lo:400:kworker.0 00010000:00080000:3.0:1789265529.352254:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb84a3fb80 x1876180417589888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265529.352264:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417589888:0@lo:400:kworker.0 00000100:00100000:3.0:1789265529.352294:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417589248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265529.352304:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417589760:0@lo:400:kworker.0 00000100:00100000:3.0:1789265529.352314:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417589632:0@lo:400:kworker.0 00010000:00080000:3.0:1789265529.352324:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83f30700 x1876180417590144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265529.352332:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417590144:0@lo:400:kworker.0 00000100:00100000:3.0:1789265529.352361:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417589504:0@lo:400:kworker.0 00000100:00100000:3.0:1789265529.352371:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180417590016:0@lo:400:kworker.0 00000100:00080000:1.0:1789265529.354273:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265529.354283:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265529.354286:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265529.354288:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1789265529.857924:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789265530.370310:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265530.707909:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265530.707974:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265530.708013:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265530.708064:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265530.708081:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265530.708098:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265530.708129:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265530.708406:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265530.708431:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265530.708746:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399683072 00000100:00100000:3.0:1789265530.708757:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399683072 00000100:00100000:3.0:1789265530.708822:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399683584 00000100:00100000:3.0:1789265530.708826:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399683584 00000100:00100000:3.0:1789265530.708844:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399682944 00000100:00100000:3.0:1789265530.708847:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399682944 00000100:00100000:3.0:1789265530.708861:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399683456 00000100:00100000:3.0:1789265530.708864:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399683456 00000100:00100000:3.0:1789265530.708897:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 58 00000100:00100000:3.0:1789265530.708907:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+5:2393:x1876180399683072:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265530.708984:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+5:2393:x1876180399683072:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 79us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265530.708993:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 58 00000100:00100000:3.0:1789265530.709011:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 59 00000100:00100000:3.0:1789265530.709019:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2393:x1876180399683584:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265530.709091:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2393:x1876180399683584:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 73us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265530.709097:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 59 00000100:00100000:3.0:1789265530.709123:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 60 00000100:00100000:3.0:1789265530.709131:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+6:2393:x1876180399682944:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265530.709163:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+6:2393:x1876180399682944:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 33us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265530.709170:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 60 00000100:00100000:3.0:1789265530.709424:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 61 00000100:00100000:3.0:1789265530.709433:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:2393:x1876180399683456:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265530.709461:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:2393:x1876180399683456:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 30us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265530.709467:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 61 00000100:00100000:3.0:1789265530.709512:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399683328 00000100:00100000:3.0:1789265530.709517:0:19582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399683328 00000100:00100000:3.0:1789265530.709545:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399683840 00000100:00100000:3.0:1789265530.709549:0:19582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399683840 00000100:00100000:3.0:1789265530.709576:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399683200 00000100:00100000:3.0:1789265530.709579:0:19582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399683200 00000100:00100000:3.0:1789265530.709590:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399683712 00000100:00100000:3.0:1789265530.709592:0:19582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399683712 00000100:00100000:3.0:1789265530.709604:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 11 00000100:00100000:3.0:1789265530.709610:0:19582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:befb0935-501c-4d01-87d3-564eb87bef45+5:2393:x1876180399683328:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265530.709648:0:19582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:befb0935-501c-4d01-87d3-564eb87bef45+5:2393:x1876180399683328:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 29us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265530.709655:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 11 00000100:00100000:3.0:1789265530.709668:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 12 00000100:00100000:3.0:1789265530.709674:0:19582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2393:x1876180399683840:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265530.709784:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399682816 00000100:00100000:0.0:1789265530.709789:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399682816 00000100:00100000:0.0:1789265530.709819:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 165 00000100:00100000:0.0:1789265530.709826:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+13:2393:x1876180399682816:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265530.709852:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+13:2393:x1876180399682816:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 28us (1954us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265530.709858:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 165 00000100:00100000:0.0:1789265530.709891:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 13 00000100:00100000:0.0:1789265530.709898:0:19247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:befb0935-501c-4d01-87d3-564eb87bef45+5:2393:x1876180399683200:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265530.709922:0:19247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:befb0935-501c-4d01-87d3-564eb87bef45+5:2393:x1876180399683200:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 25us (1793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265530.709928:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 13 00000100:00100000:0.0:1789265530.709941:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 14 00000100:00100000:0.0:1789265530.709946:0:19247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2393:x1876180399683712:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265530.709968:0:19247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2393:x1876180399683712:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 22us (1536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265530.709973:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 14 00000100:00080000:1.0:1789265530.710773:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265530.710779:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265530.710782:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265530.710784:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265530.710913:0:19582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2393:x1876180399683840:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 1236us (2826us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265530.710922:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 12 00000100:00100000:1.0:1789265531.017394:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265531.017483:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399683968 00000100:00100000:3.0:1789265531.017493:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399683968 00000100:00100000:3.0:1789265531.017613:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23 00000100:00100000:3.0:1789265531.017624:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+6:15584:x1876180399683968:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265531.017653:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265531.017673:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a97cfb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc258 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.017737:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97d02 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.017752:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97d02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.017797:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97d02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.017813:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d09 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.017821:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.017828:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.017905:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6400/0x9272d942b4a97d10 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.017913:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6400/0x9272d942b4a97d10 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.017920:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6400/0x9272d942b4a97d10 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265531.017950:0:17194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789265531.017953:0:17194:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265531.018002:0:17194:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6400/0x9272d942b4a97d10 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.018012:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97d02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.018019:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97d02 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.018066:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97d02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.018072:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265531.018076:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97d02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.018083:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97d02 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.018093:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcc8b0c6400) 00010000:00010000:3.0:1789265531.018096:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265531.018099:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97d02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.018105:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97d02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.018117:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.018123:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d09 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.018127:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.018132:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265531.018134:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.018148:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d09 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.018155:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9fcc8b0c6500) 00010000:00010000:3.0:1789265531.018157:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265531.018159:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d09 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.018165:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d09 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.018194:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a97cfb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc258 expref: 8 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.018207:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6400/0x9272d942b4a97d10 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc258 expref: 7 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.018215:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fcc8b0c6c00) 00010000:00010000:3.0:1789265531.018217:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265531.018219:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6400, rc 0) 00000100:00100000:3.0:1789265531.018282:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+7:15584:x1876180399683968:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 660us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265531.018289:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23 00000100:00100000:0.0:1789265531.037904:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265531.038535:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399684096 00000100:00100000:2.0:1789265531.038545:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399684096 00000100:00100000:2.0:1789265531.038761:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5 00000100:00100000:2.0:1789265531.038772:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:befb0935-501c-4d01-87d3-564eb87bef45+7:15584:x1876180399684096:12345-192.168.203.49@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789265531.038936:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:befb0935-501c-4d01-87d3-564eb87bef45+7:15584:x1876180399684096:12345-192.168.203.49@tcp:900:lhsmtool_posix.0 Request processed in 164us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265531.038957:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5 00000100:00100000:1.0:1789265531.049397:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265531.049497:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399684352 00000100:00100000:3.0:1789265531.049510:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399684352 00000100:00100000:3.0:1789265531.049591:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24 00000100:00100000:3.0:1789265531.049603:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:befb0935-501c-4d01-87d3-564eb87bef45+7:15584:x1876180399684352:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265531.049659:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265531.049686:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a97d17 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc25f expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.049789:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d1e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.049807:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d1e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.049820:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d1e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.050016:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97d25 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.050075:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97d25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.050088:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97d25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.050209:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7a00/0x9272d942b4a97d2c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.050218:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7a00/0x9272d942b4a97d2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.050226:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7a00/0x9272d942b4a97d2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265531.050236:0:17193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789265531.050406:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d1e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.050414:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d1e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.050420:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d1e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.050425:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265531.050429:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d1e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.050435:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d1e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.050447:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fcc8b0c6c00) 00010000:00010000:3.0:1789265531.050449:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265531.050453:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d1e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.050458:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d1e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.050470:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97d25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.050476:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97d25 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.050482:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97d25 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.050497:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265531.050501:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97d25 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.050508:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97d25 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.050516:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fcc8b0c6500) 00010000:00010000:3.0:1789265531.050518:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265531.050521:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97d25 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.050527:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97d25 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.054268:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7000/0x9272d942b4a97d17 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc25f expref: 10 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.054294:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7a00/0x9272d942b4a97d2c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc25f expref: 9 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.054303:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fcc8b0c6f00) 00010000:00010000:3.0:1789265531.054306:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265531.054309:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b7a00, rc 0) 00000100:00100000:3.0:1789265531.059500:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:befb0935-501c-4d01-87d3-564eb87bef45+9:15584:x1876180399684352:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 9885us (10104us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789265531.059514:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24 00000100:00100000:0.0:1789265531.063006:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265531.063163:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265531.067384:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399684480 00000100:00100000:3.0:1789265531.067415:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399684480 00000100:00100000:3.0:1789265531.067501:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399684608 00000100:00100000:3.0:1789265531.067505:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399684608 00000100:00100000:3.0:1789265531.067529:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 25 00000100:00100000:3.0:1789265531.067538:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:befb0935-501c-4d01-87d3-564eb87bef45+10:15590:x1876180399684480:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1789265531.067558:0:19245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265531.067580:0:19245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97d3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc266 expref: -99 pid: 19245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.067653:0:19245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d41 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.067668:0:19245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265531.067671:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 26 00010000:00010000:3.0:1789265531.067686:0:19245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265531.067699:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+11:15584:x1876180399684608:12345-192.168.203.49@tcp:59:lhsmtool_posix.0 00010000:00010000:3.0:1789265531.067703:0:19245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97d48 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.067713:0:19245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97d48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.067720:0:19245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97d48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.067760:0:19245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.067767:0:19245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d41 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.067785:0:19245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.067793:0:19245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265531.067798:0:19245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.067806:0:19245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d41 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.067819:0:19245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcc8b0c6400) 00010000:00010000:3.0:1789265531.067822:0:19245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265531.067828:0:19245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265531.067835:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+11:15584:x1876180399684608:12345-192.168.203.49@tcp:59:lhsmtool_posix.0 Request processed in 151us (4670us total) trans 0 rc 0/0 00010000:00010000:3.0:1789265531.067838:0:19245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6600/0x9272d942b4a97d41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265531.067850:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 26 00010000:00010000:3.0:1789265531.067858:0:19245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97d48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.067867:0:19245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97d48 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.067874:0:19245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97d48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.067880:0:19245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f52c00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265531.067883:0:19245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97d48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.067899:0:19245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97d48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.067908:0:19245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fcc8b0c6500) 00010000:00010000:3.0:1789265531.067910:0:19245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265531.067913:0:19245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97d48 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.067919:0:19245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97d48 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.067950:0:19245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97d3a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc266 expref: 10 pid: 19245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.067961:0:19245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcc8b0c6400) 00010000:00010000:3.0:1789265531.067964:0:19245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265531.067968:0:19245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97d3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc266 expref: 10 pid: 19245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.067979:0:19245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6000, rc 0) 00000100:00100000:3.0:1789265531.068004:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:befb0935-501c-4d01-87d3-564eb87bef45+9:15590:x1876180399684480:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 467us (5006us total) trans 0 rc 301/301 00000100:00100000:3.0:1789265531.068011:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 25 00000100:00100000:0.0:1789265531.076594:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265531.076703:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265531.077285:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399684864 00000100:00100000:3.0:1789265531.077295:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399684864 00000100:00100000:3.0:1789265531.077339:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 0 00000100:00100000:3.0:1789265531.077348:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:befb0935-501c-4d01-87d3-564eb87bef45+9:15590:x1876180399684864:12345-192.168.203.49@tcp:700:lfs.0 00000100:00100000:3.0:1789265531.077440:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:befb0935-501c-4d01-87d3-564eb87bef45+9:15590:x1876180399684864:12345-192.168.203.49@tcp:700:lfs.0 Request processed in 92us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265531.077449:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 0 00000100:00100000:2.0:1789265531.078311:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399684736 00000100:00100000:2.0:1789265531.078322:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399684736 00000100:00100000:2.0:1789265531.078401:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 27 00000100:00100000:2.0:1789265531.078411:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+5:15584:x1876180399684736:12345-192.168.203.49@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1789265531.081780:0:17192:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3337us 00000100:00100000:2.0:1789265531.089432:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265531.089595:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399685120 00000100:00100000:0.0:1789265531.089614:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399685120 00000100:00100000:0.0:1789265531.089682:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 28 00000100:00100000:0.0:1789265531.089692:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:befb0935-501c-4d01-87d3-564eb87bef45+9:15590:x1876180399685120:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:0.0:1789265531.089743:0:17193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265531.089769:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a97c68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc1d3 expref: 9 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.089785:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcc8b0c6400) 00010000:00010000:0.0:1789265531.089790:0:17193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265531.089848:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a97d4f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.089879:0:17193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97ca7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc243 expref: 5 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.089886:0:17193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a97d4f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.089919:0:17193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc243 expref: 5 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.089932:0:17193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97ca7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc243 expref: 5 pid: 17192 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265531.089945:0:17193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17193:1876180417590272:192.168.203.49@tcp:104: 00000100:00100000:0.0:1789265531.090059:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cf9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265531.094340:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265531.095871:0:17193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17193:1876180417590272:192.168.203.49@tcp:104: 00010000:00010000:3.0:1789265531.095914:0:17193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a97d4f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265531.096357:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399685248 00000100:00100000:2.0:1789265531.096372:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399685248 00010000:00010000:2.0:1789265531.096436:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97ca7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc243 expref: 6 pid: 17192 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265531.096481:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 15 00000100:00100000:2.0:1789265531.096491:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:2395:x1876180399685248:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265531.096609:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265531.096617:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97ca7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc243 expref: 6 pid: 17192 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.096661:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc243 expref: 6 pid: 17192 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.096683:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97ca7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc243 expref: 6 pid: 17192 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.096705:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcc8b0c6400) 00010000:00010000:2.0:1789265531.096711:0:17179:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a97d4f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.096720:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a97d4f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.096727:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a97d4f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.096758:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265531.096818:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2395:x1876180399685248:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 328us (2492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265531.096827:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 15 00010000:00010000:2.0:1789265531.103584:0:17193:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a97d4f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.103603:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a97d4f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.103647:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a97d56 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.103678:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a97d56 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.103690:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a97d56 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265531.107197:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+5:15584:x1876180399684736:12345-192.168.203.49@tcp:59:lhsmtool_posix.0 Request processed in 28761us (30586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265531.107230:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 27 00010000:00010000:2.0:1789265531.107628:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97d5d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.107660:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97d5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.107672:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97d5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265531.107691:0:17193:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033dfc9bc reply state 0000000077d6c16d transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97d5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.107703:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97d5d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.107711:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fcb83b85000) 00010000:00010000:2.0:1789265531.107714:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789265531.107718:0:17193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789265531.107723:0:17193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789265531.107731:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a97d4f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.107738:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a97d4f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.107745:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a97d4f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.107757:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265531.107762:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a97d4f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.107769:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a97d4f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.107780:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcc8b0c6400) 00010000:00010000:2.0:1789265531.107782:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265531.107786:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a97d4f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.107792:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a97d4f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265531.107809:0:17193:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033dfc9bc reply state 0000000077d6c16d transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a97d56 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.107818:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a97d56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.107824:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fcb83b85c00) 00010000:00010000:2.0:1789265531.107827:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789265531.107829:0:17193:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789265531.109195:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:befb0935-501c-4d01-87d3-564eb87bef45+10:15590:x1876180399685120:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 19496us (19764us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789265531.109207:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 28 00000100:00100000:3.0:1789265531.196985:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265531.197203:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399685376 00000100:00100000:0.0:1789265531.197218:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399685376 00000100:00100000:0.0:1789265531.197298:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 29 00000100:00100000:0.0:1789265531.197311:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:befb0935-501c-4d01-87d3-564eb87bef45+10:15598:x1876180399685376:12345-192.168.203.49@tcp:101:lctl.0 00010000:00010000:0.0:1789265531.197344:0:19245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265531.197385:0:19245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a97d64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc26d expref: -99 pid: 19245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.197471:0:19245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a97d6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.197487:0:19245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a97d6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.197501:0:19245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a97d6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265531.197563:0:19245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789265531.197568:0:19245:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265531.197614:0:19245:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a97d6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.197654:0:19245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a97d64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc26d expref: 12 pid: 19245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.197678:0:19245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a97d6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc26d expref: 11 pid: 19245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.197709:0:19245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fccacd51400) 00010000:00010000:0.0:1789265531.197712:0:19245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265531.197717:0:19245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da4000, rc 0) 00000100:00100000:0.0:1789265531.197800:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:befb0935-501c-4d01-87d3-564eb87bef45+11:15598:x1876180399685376:12345-192.168.203.49@tcp:101:lctl.0 Request processed in 492us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265531.197808:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 29 00000100:00100000:0.0:1789265531.223357:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265531.223759:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399685504 00000100:00100000:2.0:1789265531.223772:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399685504 00000100:00100000:2.0:1789265531.223890:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 30 00000100:00100000:2.0:1789265531.223929:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:15600:x1876180399685504:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1789265531.223956:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265531.223981:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97d72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc274 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.224096:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97d79 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.224113:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97d79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.224128:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97d79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265531.224199:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789265531.224204:0:17192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265531.224229:0:17192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97d79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.224259:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97d72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc274 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.224282:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97d79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc274 expref: 6 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.224292:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fccacd51400) 00010000:00010000:2.0:1789265531.224296:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265531.224300:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2fc00, rc 0) 00000100:00100000:2.0:1789265531.224502:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:15600:x1876180399685504:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 575us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265531.224522:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 30 00000100:00100000:0.0:1789265531.228157:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265531.228307:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399685632 00000100:00100000:3.0:1789265531.228321:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399685632 00000100:00100000:3.0:1789265531.228494:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 31 00000100:00100000:3.0:1789265531.228507:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:15600:x1876180399685632:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1789265531.228533:0:19245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265531.228558:0:19245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97d80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc27b expref: -99 pid: 19245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.228893:0:19245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52e00/0x9272d942b4a97d87 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.228923:0:19245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52e00/0x9272d942b4a97d87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.228939:0:19245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52e00/0x9272d942b4a97d87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.228952:0:19245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52800/0x9272d942b4a97d8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.228960:0:19245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52800/0x9272d942b4a97d8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.228985:0:19245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52800/0x9272d942b4a97d8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.229121:0:19245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53800/0x9272d942b4a97d95 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.229131:0:19245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53800/0x9272d942b4a97d95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.229139:0:19245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53800/0x9272d942b4a97d95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265531.229197:0:19245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789265531.229201:0:19245:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265531.229232:0:19245:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53800/0x9272d942b4a97d95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.229247:0:19245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52e00/0x9272d942b4a97d87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.229255:0:19245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52e00/0x9272d942b4a97d87 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.229262:0:19245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52e00/0x9272d942b4a97d87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.229269:0:19245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f52e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265531.229275:0:19245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52e00/0x9272d942b4a97d87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.229284:0:19245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52e00/0x9272d942b4a97d87 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.229305:0:19245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fccacd51400) 00010000:00010000:3.0:1789265531.229308:0:19245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265531.229313:0:19245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52e00/0x9272d942b4a97d87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.229320:0:19245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52e00/0x9272d942b4a97d87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.229336:0:19245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52800/0x9272d942b4a97d8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.229343:0:19245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52800/0x9272d942b4a97d8e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.229350:0:19245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52800/0x9272d942b4a97d8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.229356:0:19245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f52800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265531.229359:0:19245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52800/0x9272d942b4a97d8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.229365:0:19245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52800/0x9272d942b4a97d8e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.229524:0:19245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fcb83b85c00) 00010000:00010000:3.0:1789265531.229526:0:19245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265531.229530:0:19245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52800/0x9272d942b4a97d8e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.229535:0:19245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52800/0x9272d942b4a97d8e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.229587:0:19245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97d80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc27b expref: 8 pid: 19245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.229601:0:19245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53800/0x9272d942b4a97d95 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc27b expref: 7 pid: 19245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.229608:0:19245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fcb83b85000) 00010000:00010000:3.0:1789265531.229610:0:19245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265531.229613:0:19245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f53800, rc 0) 00000100:00100000:3.0:1789265531.229714:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32f639db-fb18-46c7-87cd-9f5b45c18fc6+7:15600:x1876180399685632:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 1210us (1570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265531.229724:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 31 00000100:00100000:0.0:1789265531.233528:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265531.233655:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399685760 00000100:00100000:1.0:1789265531.233669:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399685760 00000100:00100000:1.0:1789265531.233772:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 6 00000100:00100000:1.0:1789265531.233784:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:15600:x1876180399685760:12345-192.168.203.49@tcp:900:lfs.0 00000100:00100000:1.0:1789265531.233901:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:15600:x1876180399685760:12345-192.168.203.49@tcp:900:lfs.0 Request processed in 111us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265531.233911:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 6 00000100:00100000:0.0:1789265531.238006:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265531.238124:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399686016 00000100:00100000:3.0:1789265531.238136:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399686016 00000100:00100000:3.0:1789265531.238218:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 32 00000100:00100000:3.0:1789265531.238231:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+7:15600:x1876180399686016:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1789265531.238260:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265531.238285:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97d9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc282 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265531.238427:0:17193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789265531.238556:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97d9c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc282 expref: 9 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.238574:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fccacd51400) 00010000:00010000:3.0:1789265531.238577:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265531.238600:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97d9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc282 expref: 9 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.238619:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f53400, rc 0) 00000100:00100000:3.0:1789265531.238710:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+8:15600:x1876180399686016:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 482us (719us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1789265531.238719:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 32 00000100:00100000:0.0:1789265531.242267:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265531.242420:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399686272 00000100:00100000:1.0:1789265531.242434:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399686272 00000100:00100000:1.0:1789265531.242507:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 33 00000100:00100000:1.0:1789265531.242518:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32f639db-fb18-46c7-87cd-9f5b45c18fc6+8:15600:x1876180399686272:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:1.0:1789265531.242602:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265531.242648:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53800/0x9272d942b4a97d95 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc27b expref: 8 pid: 19245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.242698:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fcb83b85000) 00010000:00010000:1.0:1789265531.242705:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265531.242737:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97daa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.242753:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97daa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.242765:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97daa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265531.243002:0:17194:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b833e29 reply state 000000005d5127ca transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97daa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.243017:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97daa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.243487:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fcb83b85000) 00010000:00010000:1.0:1789265531.243490:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1789265531.243494:0:17194:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789265531.243505:0:17194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789265531.243671:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32f639db-fb18-46c7-87cd-9f5b45c18fc6+9:15600:x1876180399686272:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 1152us (1417us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789265531.243680:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 33 00000100:00100000:0.0:1789265531.251293:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265531.251408:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399686528 00000100:00100000:1.0:1789265531.251426:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399686528 00000100:00100000:1.0:1789265531.251540:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 2 00000100:00100000:1.0:1789265531.251554:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32f639db-fb18-46c7-87cd-9f5b45c18fc6+9:15600:x1876180399686528:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:1.0:1789265531.251891:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32f639db-fb18-46c7-87cd-9f5b45c18fc6+10:15600:x1876180399686528:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 339us (615us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789265531.251927:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 2 00000100:00100000:0.0:1789265531.254998:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265531.255255:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399686784 00000100:00100000:3.0:1789265531.255269:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399686784 00000100:00100000:2.0:1789265531.255547:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 34 00000100:00100000:2.0:1789265531.255559:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+10:15600:x1876180399686784:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1789265531.255596:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265531.255623:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97db1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc289 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.255737:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e000/0x9272d942b4a97db8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.255758:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e000/0x9272d942b4a97db8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.255772:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e000/0x9272d942b4a97db8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.255786:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97dbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.255794:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97dbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.255801:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97dbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265531.255938:0:17193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789265531.256067:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e000/0x9272d942b4a97db8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.256076:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e000/0x9272d942b4a97db8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.256102:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e000/0x9272d942b4a97db8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.256109:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265531.256114:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e000/0x9272d942b4a97db8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.256123:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e000/0x9272d942b4a97db8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.256138:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fccacd51400) 00010000:00010000:2.0:1789265531.256141:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265531.256147:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e000/0x9272d942b4a97db8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.256167:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e000/0x9272d942b4a97db8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.256185:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97dbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.256192:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97dbf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.256197:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97dbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.256202:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265531.256205:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97dbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.256222:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97dbf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.256231:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fcb83b85c00) 00010000:00010000:2.0:1789265531.256234:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265531.256237:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97dbf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.256243:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97dbf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.256287:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97db1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc289 expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.256299:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fccacd51400) 00010000:00010000:2.0:1789265531.256302:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265531.256306:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97db1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc289 expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.256317:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2e600, rc 0) 00000100:00100000:2.0:1789265531.256417:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+11:15600:x1876180399686784:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 859us (1433us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789265531.256427:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 34 00000100:00100000:2.0:1789265531.259787:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265531.259959:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399686912 00000100:00100000:3.0:1789265531.259972:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399686912 00000100:00100000:3.0:1789265531.260129:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 35 00000100:00100000:3.0:1789265531.260142:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32f639db-fb18-46c7-87cd-9f5b45c18fc6+11:15600:x1876180399686912:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1789265531.260184:0:19245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265531.260211:0:19245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97dcd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc290 expref: -99 pid: 19245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.260338:0:19245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97dd4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.260357:0:19245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.260373:0:19245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265531.260404:0:19245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789265531.260407:0:19245:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265531.260432:0:19245:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.260487:0:19245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97dcd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc290 expref: 13 pid: 19245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.260510:0:19245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97dd4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc290 expref: 12 pid: 19245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.260519:0:19245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fcb83b85000) 00010000:00010000:3.0:1789265531.260523:0:19245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265531.260527:0:19245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f52c00, rc 0) 00000100:00100000:3.0:1789265531.260610:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32f639db-fb18-46c7-87cd-9f5b45c18fc6+12:15600:x1876180399686912:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 471us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265531.260618:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 35 00000100:00100000:3.0:1789265531.264655:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265531.264733:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399687040 00000100:00100000:0.0:1789265531.264747:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399687040 00000100:00100000:0.0:1789265531.264876:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 3 00000100:00100000:0.0:1789265531.264889:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+12:15600:x1876180399687040:12345-192.168.203.49@tcp:37:lfs.0 00000100:00100000:1.0:1789265531.270827:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+12:15600:x1876180399687040:12345-192.168.203.49@tcp:37:lfs.0 Request processed in 5923us (6181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265531.270845:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 3 00000100:00100000:2.0:1789265531.273745:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265531.273917:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399687296 00000100:00100000:1.0:1789265531.273930:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399687296 00000100:00100000:1.0:1789265531.274000:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 4 00000100:00100000:1.0:1789265531.274011:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad8fc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32f639db-fb18-46c7-87cd-9f5b45c18fc6+12:15600:x1876180399687296:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:1.0:1789265531.274307:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad8fc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32f639db-fb18-46c7-87cd-9f5b45c18fc6+13:15600:x1876180399687296:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 296us (577us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789265531.274314:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 4 00000100:00100000:3.0:1789265531.318460:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265531.318706:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399687424 00000100:00100000:0.0:1789265531.318720:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399687424 00000100:00100000:0.0:1789265531.318795:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 36 00000100:00100000:0.0:1789265531.318808:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+11:15606:x1876180399687424:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1789265531.318835:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265531.318863:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a97ddb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc297 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.318974:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a97de2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.318991:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a97de2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.319004:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a97de2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.319017:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97de9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.319070:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97de9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.319078:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97de9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.319200:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5c00/0x9272d942b4a97df0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.319211:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5c00/0x9272d942b4a97df0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.319218:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5c00/0x9272d942b4a97df0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265531.319262:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789265531.319266:0:17192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265531.319314:0:17192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5c00/0x9272d942b4a97df0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.319340:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a97de2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.319346:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a97de2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.319353:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a97de2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.319359:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265531.319364:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a97de2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.319372:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a97de2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.319388:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fccacd51400) 00010000:00010000:0.0:1789265531.319392:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265531.319397:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a97de2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.319403:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a97de2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.319419:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97de9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.319425:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97de9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.319431:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97de9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.319443:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4a00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265531.319446:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97de9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.319453:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97de9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.319461:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fcb83b85c00) 00010000:00010000:0.0:1789265531.319464:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265531.319467:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97de9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.319473:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97de9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.319504:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5e00/0x9272d942b4a97ddb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc297 expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.319518:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5c00/0x9272d942b4a97df0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc297 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.319525:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fcb83b85000) 00010000:00010000:0.0:1789265531.319527:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789265531.319530:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5c00, rc 0) 00000100:00100000:0.0:1789265531.319810:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+12:15606:x1876180399687424:12345-192.168.203.49@tcp:101:bash.0 Request processed in 1003us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265531.319819:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 36 00000100:00100000:2.0:1789265531.327519:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265531.327630:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399687552 00000100:00100000:3.0:1789265531.327653:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399687552 00000100:00100000:3.0:1789265531.327728:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:3.0:1789265531.327741:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:befb0935-501c-4d01-87d3-564eb87bef45+5:15606:x1876180399687552:12345-192.168.203.49@tcp:900:bash.0 00000100:00100000:3.0:1789265531.327850:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:befb0935-501c-4d01-87d3-564eb87bef45+5:15606:x1876180399687552:12345-192.168.203.49@tcp:900:bash.0 Request processed in 111us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265531.327859:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:3.0:1789265531.330458:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265531.330594:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399687808 00000100:00100000:1.0:1789265531.330609:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399687808 00000100:00100000:1.0:1789265531.330700:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 37 00000100:00100000:1.0:1789265531.330712:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+12:15606:x1876180399687808:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1789265531.330742:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265531.330772:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97df7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc29e expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.330943:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a97dfe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.330962:0:17194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97dd4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc290 expref: 12 pid: 19245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.330974:0:17194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a97dfe lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.331082:0:17194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97dd4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc290 expref: 12 pid: 19245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.331097:0:17194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97dd4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc290 expref: 12 pid: 19245 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265531.331112:0:17194:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc8376e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17194:1876180417590400:192.168.203.49@tcp:104: 00000100:00100000:1.0:1789265531.331236:0:17194:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83e9ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265531.334986:0:17194:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc8376e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17194:1876180417590400:192.168.203.49@tcp:104: 00010000:00010000:1.0:1789265531.335095:0:17194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a97dfe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265531.336204:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265531.336459:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399687936 00000100:00100000:1.0:1789265531.336471:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399687936 00010000:00010000:1.0:1789265531.336533:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97dd4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc290 expref: 13 pid: 19245 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265531.336589:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 16 00000100:00100000:1.0:1789265531.336600:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32f639db-fb18-46c7-87cd-9f5b45c18fc6+13:2396:x1876180399687936:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265531.336617:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265531.336625:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97dd4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc290 expref: 13 pid: 19245 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.336648:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97dd4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc290 expref: 13 pid: 19245 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.336703:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97dd4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc290 expref: 13 pid: 19245 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.336723:0:17177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fcb83b85000) 00010000:00010000:1.0:1789265531.336728:0:17177:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a97dfe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.336740:0:17177:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a97dfe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.336748:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a97dfe lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.336778:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265531.336972:0:17194:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a97dfe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.336990:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a97dfe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.337019:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52800/0x9272d942b4a97e05 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.337054:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52800/0x9272d942b4a97e05 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.337064:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52800/0x9272d942b4a97e05 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265531.337732:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32f639db-fb18-46c7-87cd-9f5b45c18fc6+12:2396:x1876180399687936:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 1126us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265531.337743:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 16 00010000:00010000:3.0:1789265531.338536:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97e0c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.338563:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97e0c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.338578:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97e0c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265531.338599:0:17194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789265531.338660:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a97dfe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.338668:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a97dfe lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.338675:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a97dfe lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.338682:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ffa00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265531.338706:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a97dfe lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.338714:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a97dfe lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.338727:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fcb83b85000) 00010000:00010000:3.0:1789265531.338730:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265531.338734:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a97dfe lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.338741:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a97dfe lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265531.338758:0:17194:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4b36a63 reply state 0000000052c5f2fd transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52800/0x9272d942b4a97e05 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.338768:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52800/0x9272d942b4a97e05 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.338774:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9fcc8b0c6500) 00010000:00010000:3.0:1789265531.338777:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789265531.338779:0:17194:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789265531.342436:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97df7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc29e expref: 15 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.342463:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97e0c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc29e expref: 14 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.342472:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fcc8b0c6200) 00010000:00010000:3.0:1789265531.342475:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789265531.342496:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f53400, rc 0) 00000100:00100000:3.0:1789265531.342576:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+15:15606:x1876180399687808:12345-192.168.203.49@tcp:101:bash.0 Request processed in 11865us (12131us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789265531.342585:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 37 00000100:00100000:3.0:1789265531.360261:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265531.360395:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399688064 00000100:00100000:0.0:1789265531.360428:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399688064 00000100:00100000:0.0:1789265531.360511:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 38 00000100:00100000:0.0:1789265531.360526:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+15:15606:x1876180399688064:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1789265531.360560:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265531.360594:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a97e1a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc2a5 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.360699:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97e21 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.360717:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97e21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.360730:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97e21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265531.360801:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789265531.360807:0:17192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265531.360832:0:17192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97e21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.360846:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97e21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.360878:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a97e1a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2a5 expref: 17 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.360901:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97e21 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2a5 expref: 16 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.360911:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fcc8b0c6200) 00010000:00010000:0.0:1789265531.360921:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265531.360926:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5400, rc 0) 00000100:00100000:0.0:1789265531.361015:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+16:15606:x1876180399688064:12345-192.168.203.49@tcp:101:bash.0 Request processed in 492us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265531.361089:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 38 00000100:00100000:0.0:1789265531.364542:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265531.364708:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399688320 00000100:00100000:1.0:1789265531.364722:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399688320 00000100:00100000:1.0:1789265531.364828:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5 00000100:00100000:1.0:1789265531.364841:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:befb0935-501c-4d01-87d3-564eb87bef45+16:15606:x1876180399688320:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:1.0:1789265531.365296:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:befb0935-501c-4d01-87d3-564eb87bef45+17:15606:x1876180399688320:12345-192.168.203.49@tcp:35:bash.0 Request processed in 456us (767us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1789265531.365305:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5 00010000:00010000:0.0:1789265531.394258:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265531.452357:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265531.452704:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399688576 00000100:00100000:0.0:1789265531.452719:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399688576 00000100:00100000:0.0:1789265531.452846:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 39 00000100:00100000:0.0:1789265531.452859:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:befb0935-501c-4d01-87d3-564eb87bef45+17:15616:x1876180399688576:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:0.0:1789265531.452892:0:19245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265531.452917:0:19245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a97e28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc2ac expref: -99 pid: 19245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265531.453105:0:19245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789265531.456761:0:19245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a97e28 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2ac expref: 19 pid: 19245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.456793:0:19245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fccacd51400) 00010000:00010000:0.0:1789265531.456994:0:19245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265531.457002:0:19245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a97e28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2ac expref: 19 pid: 19245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.457058:0:19245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da4800, rc 0) 00000100:00100000:2.0:1789265531.457935:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:befb0935-501c-4d01-87d3-564eb87bef45+18:15616:x1876180399688576:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 5069us (5583us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1789265531.457981:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 39 00000100:00100000:3.0:1789265531.470243:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265531.470722:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399688832 00000100:00100000:0.0:1789265531.470736:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399688832 00000100:00100000:0.0:1789265531.470824:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 6 00000100:00100000:0.0:1789265531.470855:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:befb0935-501c-4d01-87d3-564eb87bef45+18:15616:x1876180399688832:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:0.0:1789265531.471216:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:befb0935-501c-4d01-87d3-564eb87bef45+19:15616:x1876180399688832:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 355us (978us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1789265531.471225:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 6 00000100:00100000:0.0:1789265531.521754:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265531.521879:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399689088 00000100:00100000:2.0:1789265531.521892:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399689088 00000100:00100000:2.0:1789265531.521978:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 40 00000100:00100000:2.0:1789265531.521992:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+19:15619:x1876180399689088:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1789265531.522068:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265531.522098:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a97e36 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc2b3 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.522263:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a97e3d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.522280:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a97e3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.522308:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a97e3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265531.522323:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789265531.522484:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a97e36 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2b3 expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.522508:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a97e3d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2b3 expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.522518:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fcc8b0c6200) 00010000:00010000:2.0:1789265531.522521:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265531.522525:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81490600, rc 0) 00000100:00100000:2.0:1789265531.522652:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+21:15619:x1876180399689088:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 662us (912us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789265531.522661:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 40 00000100:00100000:3.0:1789265531.529390:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265531.530186:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399689216 00000100:00100000:1.0:1789265531.530206:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399689216 00000100:00100000:1.0:1789265531.530350:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 41 00000100:00100000:1.0:1789265531.530381:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+21:15619:x1876180399689216:12345-192.168.203.49@tcp:54:lfs.0 00010000:00010000:1.0:1789265531.530472:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97e4b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.530495:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97e4b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.530509:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97e4b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.530557:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97e4b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.530565:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97e4b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.530572:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97e4b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.530580:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ffe00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265531.530585:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97e4b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.530594:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97e4b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.530607:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fcc8b0c6200) 00010000:00010000:1.0:1789265531.530610:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789265531.530616:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97e4b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.530623:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffe00/0x9272d942b4a97e4b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265531.533010:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265531.534483:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399689344 00000100:00100000:2.0:1789265531.534507:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399689344 00000100:00100000:2.0:1789265531.534649:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 0 00000100:00100000:2.0:1789265531.534664:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:befb0935-501c-4d01-87d3-564eb87bef45+22:2396:x1876180399689344:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265531.534686:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265531.534721:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a97e3d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2b3 expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.534746:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fcc8b0c6200) 00010000:00010000:2.0:1789265531.534752:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265531.534833:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:befb0935-501c-4d01-87d3-564eb87bef45+21:2396:x1876180399689344:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 172us (1840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265531.534841:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 0 00000100:00100000:1.0:1789265531.537265:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+20:15619:x1876180399689216:12345-192.168.203.49@tcp:54:lfs.0 Request processed in 6860us (7862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265531.537292:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 41 00000100:00100000:3.0:1789265531.545441:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265531.545554:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399689600 00000100:00100000:0.0:1789265531.545568:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399689600 00000100:00100000:0.0:1789265531.545684:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:0.0:1789265531.545697:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:befb0935-501c-4d01-87d3-564eb87bef45+20:15619:x1876180399689600:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:0.0:1789265531.546215:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:befb0935-501c-4d01-87d3-564eb87bef45+21:15619:x1876180399689600:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 519us (788us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789265531.546225:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:0.0:1789265531.784883:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265531.785927:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399689856 00000100:00100000:2.0:1789265531.785947:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399689856 00000100:00100000:2.0:1789265531.786086:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 42 00000100:00100000:2.0:1789265531.786098:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+21:15650:x1876180399689856:12345-192.168.203.49@tcp:101:cat.0 00010000:00010000:2.0:1789265531.786130:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265531.786156:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a97e52 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc2ba expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.786299:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a97e59 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.786338:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a97e59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.786354:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a97e59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265531.786368:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789265531.786996:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a97e52 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2ba expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.787157:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a97e59 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2ba expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.787169:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fcc8b0c6200) 00010000:00010000:2.0:1789265531.787172:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265531.787175:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81490000, rc 0) 00000100:00100000:2.0:1789265531.787267:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+23:15650:x1876180399689856:12345-192.168.203.49@tcp:101:cat.0 Request processed in 1170us (2399us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789265531.787277:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 42 00000100:00100000:3.0:1789265531.790727:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265531.790787:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265531.790967:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399690112 00000100:00100000:0.0:1789265531.790980:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399690112 00000100:00100000:0.0:1789265531.791084:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 8 00000100:00100000:0.0:1789265531.791097:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:befb0935-501c-4d01-87d3-564eb87bef45+23:15650:x1876180399690112:12345-192.168.203.49@tcp:35:cat.0 00000100:00100000:0.0:1789265531.791479:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:befb0935-501c-4d01-87d3-564eb87bef45+24:15650:x1876180399690112:12345-192.168.203.49@tcp:35:cat.0 Request processed in 383us (767us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1789265531.791560:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 8 00000100:00100000:2.0:1789265531.793654:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399690240 00000100:00100000:2.0:1789265531.793675:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399690240 00000100:00100000:2.0:1789265531.793788:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1 00000100:00100000:2.0:1789265531.793800:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82869500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:befb0935-501c-4d01-87d3-564eb87bef45+24:2394:x1876180399690240:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265531.793822:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265531.793856:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a97e59 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2ba expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.793915:0:17178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fcc8b0c6200) 00010000:00010000:2.0:1789265531.793922:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265531.793995:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82869500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:befb0935-501c-4d01-87d3-564eb87bef45+23:2394:x1876180399690240:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 197us (3207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265531.794004:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1 00000100:00100000:3.0:1789265531.862169:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265531.864088:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399690496 00000100:00100000:2.0:1789265531.864110:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399690496 00000100:00100000:2.0:1789265531.864209:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 43 00000100:00100000:2.0:1789265531.864224:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:befb0935-501c-4d01-87d3-564eb87bef45+23:15656:x1876180399690496:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:2.0:1789265531.864272:0:19245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265531.864303:0:19245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a97e67 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc2c1 expref: -99 pid: 19245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.864462:0:19245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a97e6e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.864826:0:19245:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97e0c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc29e expref: 24 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.864837:0:19245:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97e21 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2a5 expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.864847:0:19245:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a97e6e lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.864895:0:19245:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97e21 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2a5 expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.864937:0:19245:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97e21 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2a5 expref: 24 pid: 17192 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265531.864954:0:19245:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d26d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19245:1876180417590528:192.168.203.49@tcp:104: 00010000:00010000:0.0:1789265531.872317:0:19245:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97e0c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc29e expref: 24 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.872343:0:19245:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97e0c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc29e expref: 24 pid: 17194 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265531.872383:0:19245:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19245:1876180417590656:192.168.203.49@tcp:104: 00000100:00100000:0.0:1789265531.872547:0:19245:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83bed240 going to sleep for 11 seconds 00000100:00100000:3.0:1789265531.880290:0:19245:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d26d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19245:1876180417590528:192.168.203.49@tcp:104: 00000100:00100000:0.0:1789265531.880949:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265531.881810:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399690624 00000100:00100000:3.0:1789265531.881825:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399690624 00010000:00010000:3.0:1789265531.881895:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97e21 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2a5 expref: 25 pid: 17192 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265531.881950:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 17 00000100:00100000:3.0:1789265531.881961:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:befb0935-501c-4d01-87d3-564eb87bef45+25:2396:x1876180399690624:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265531.881979:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265531.881987:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97e21 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2a5 expref: 25 pid: 17192 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.882002:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97e21 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2a5 expref: 25 pid: 17192 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.882084:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5400/0x9272d942b4a97e21 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2a5 expref: 25 pid: 17192 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.882104:0:17177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fcc8b0c6200) 00010000:00010000:3.0:1789265531.882109:0:17177:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a97e6e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.882119:0:17177:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a97e6e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.882125:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265531.882369:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:befb0935-501c-4d01-87d3-564eb87bef45+24:2396:x1876180399690624:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 408us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265531.882381:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 17 00000100:00100000:2.0:1789265531.886855:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265531.886910:0:19245:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19245:1876180417590656:192.168.203.49@tcp:104: 00010000:00010000:3.0:1789265531.886950:0:19245:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a97e6e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265531.887120:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399690752 00000100:00100000:0.0:1789265531.887130:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399690752 00010000:00010000:0.0:1789265531.887263:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97e0c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc29e expref: 24 pid: 17194 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265531.887353:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 18 00000100:00100000:0.0:1789265531.887365:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821acc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:befb0935-501c-4d01-87d3-564eb87bef45+24:2395:x1876180399690752:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265531.887386:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265531.887394:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97e0c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc29e expref: 24 pid: 17194 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.887418:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97e0c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc29e expref: 24 pid: 17194 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.887448:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97e0c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc29e expref: 24 pid: 17194 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.887466:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fcc8b0c6200) 00010000:00010000:0.0:1789265531.887472:0:17179:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a97e6e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.887482:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a97e6e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.887514:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a97e6e lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.887546:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265531.887689:0:19245:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a97e6e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.887698:0:19245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a97e6e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265531.887722:0:19245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789265531.887937:0:19245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a97e67 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2c1 expref: 25 pid: 19245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.887985:0:19245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a97e6e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2c1 expref: 24 pid: 19245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.887994:0:19245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fcc8b0c6200) 00010000:00010000:3.0:1789265531.887998:0:19245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789265531.888000:0:19245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81490600, rc 0) 00000100:00100000:0.0:1789265531.888113:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821acc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:befb0935-501c-4d01-87d3-564eb87bef45+24:2395:x1876180399690752:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 749us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265531.888122:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 18 00000100:00100000:3.0:1789265531.888956:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:befb0935-501c-4d01-87d3-564eb87bef45+23:15656:x1876180399690496:12345-192.168.203.49@tcp:101:dd.0 Request processed in 24732us (26799us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1789265531.888976:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 43 00000100:00100000:1.0:1789265531.895951:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265531.896166:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399690880 00000100:00100000:0.0:1789265531.896180:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399690880 00000100:00100000:0.0:1789265531.896260:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 44 00000100:00100000:0.0:1789265531.896272:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:befb0935-501c-4d01-87d3-564eb87bef45+23:15656:x1876180399690880:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:0.0:1789265531.896304:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265531.896329:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a97e7c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc2c8 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.896374:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97e83 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.896393:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97e83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.896418:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97e83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.896608:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4c00/0x9272d942b4a97e7c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2c8 expref: 25 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.896642:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97e83 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2c8 expref: 24 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265531.896660:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fcc8b0c6200) 00010000:00010000:0.0:1789265531.896663:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789265531.896667:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da4a00, rc 0) 00000100:00100000:0.0:1789265531.896756:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:befb0935-501c-4d01-87d3-564eb87bef45+24:15656:x1876180399690880:12345-192.168.203.49@tcp:101:dd.0 Request processed in 485us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265531.896764:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 44 00000040:00080000:2.0:1789265531.906758:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789265531.910758:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265531.911783:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399691136 00000100:00100000:3.0:1789265531.911797:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399691136 00000100:00100000:3.0:1789265531.911926:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 45 00000100:00100000:3.0:1789265531.911938:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+24:15656:x1876180399691136:12345-192.168.203.49@tcp:36:dd.0 00010000:00010000:3.0:1789265531.912286:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52e00/0x9272d942b4a97e8a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.912306:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52e00/0x9272d942b4a97e8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.912321:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52e00/0x9272d942b4a97e8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789265531.912368:0:17194:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1789265531.912392:0:17194:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005dd5f5e5 reply state 0000000017caa95e transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52e00/0x9272d942b4a97e8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.914355:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52e00/0x9272d942b4a97e8a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.914393:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fcc8b0c6200) 00010000:00010000:3.0:1789265531.914396:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789265531.914466:0:17194:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265531.914673:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+27:15656:x1876180399691136:12345-192.168.203.49@tcp:36:dd.0 Request processed in 2729us (3921us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1789265531.914684:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 45 00000020:00080000:3.0:1789265531.914692:0:17194:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789265531.925372:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265531.927796:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399691264 00000100:00100000:1.0:1789265531.927819:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399691264 00000100:00100000:1.0:1789265531.927918:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 46 00000100:00100000:1.0:1789265531.927930:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:befb0935-501c-4d01-87d3-564eb87bef45+27:15656:x1876180399691264:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:1.0:1789265531.927960:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265531.927987:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97e91 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc2cf expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.928106:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97e91 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2cf expref: 28 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.928124:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97e91 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2cf expref: 28 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265531.928273:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fcc8b0c6200) 00010000:00010000:1.0:1789265531.928278:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265531.928284:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fe800, rc 0) 00000100:00100000:1.0:1789265531.928372:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:befb0935-501c-4d01-87d3-564eb87bef45+28:15656:x1876180399691264:12345-192.168.203.49@tcp:101:dd.0 Request processed in 443us (3015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265531.928380:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 46 00000100:00100000:1.0:1789265531.962477:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265531.967809:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399691520 00000100:00100000:3.0:1789265531.967831:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399691520 00000100:00100000:3.0:1789265531.968167:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 2 00000100:00100000:3.0:1789265531.968247:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc8376f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:befb0935-501c-4d01-87d3-564eb87bef45+28:15656:x1876180399691520:12345-192.168.203.49@tcp:103:dd.0 00010000:00010000:3.0:1789265531.968270:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265531.968305:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fe800/0x9272d942b4a97e91 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2cf expref: 28 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.968332:0:17177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fcc8b0c6200) 00010000:00010000:3.0:1789265531.968339:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265531.968491:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc8376f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:befb0935-501c-4d01-87d3-564eb87bef45+27:15656:x1876180399691520:12345-192.168.203.49@tcp:103:dd.0 Request processed in 247us (6025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265531.968501:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 2 00000100:00100000:0.0:1789265531.971199:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265531.971267:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399691648 00000100:00100000:3.0:1789265531.971282:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399691648 00000100:00100000:3.0:1789265531.971374:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 47 00000100:00100000:3.0:1789265531.971388:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:befb0935-501c-4d01-87d3-564eb87bef45+27:15656:x1876180399691648:12345-192.168.203.49@tcp:58:dd.0 00010000:00010000:3.0:1789265531.971536:0:19245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52400/0x9272d942b4a97e98 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.971558:0:19245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52400/0x9272d942b4a97e98 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265531.971573:0:19245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52400/0x9272d942b4a97e98 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265531.971995:0:17228:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789265531.972904:0:19245:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265531.972947:0:19245:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1789265531.973145:0:19245:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789265531.973880:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:befb0935-501c-4d01-87d3-564eb87bef45+27:15656:x1876180399691648:12345-192.168.203.49@tcp:58:dd.0 Request processed in 2485us (2685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265531.973903:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 47 00000100:00100000:0.0:1789265531.977768:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265531.977948:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399691776 00000100:00100000:2.0:1789265531.978165:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399691776 00000100:00100000:2.0:1789265531.978321:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 48 00000100:00100000:2.0:1789265531.978334:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+27:15656:x1876180399691776:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:2.0:1789265531.978362:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265531.978390:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a97e9f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc2d6 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.978465:0:17192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52400/0x9272d942b4a97e98 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.978477:0:17192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a97e9f lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2d6 expref: 28 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.978524:0:17192:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52400/0x9272d942b4a97e98 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.978541:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a97e9f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2d6 expref: 28 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.978559:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fcc8b0c6200) 00010000:00010000:2.0:1789265531.978562:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265531.978566:0:17192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a97e9f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2d6 expref: 28 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265531.978576:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81490000, rc 0) 00000100:00100000:2.0:1789265531.978772:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+28:15656:x1876180399691776:12345-192.168.203.49@tcp:101:dd.0 Request processed in 439us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265531.978780:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 48 00010000:00010000:3.0:1789265532.422272:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789265532.993324:0:17228:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789265532.993338:0:17228:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789265532.993410:0:17228:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789265532.993422:0:17228:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789265532.993866:0:17228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17228:1876180417590784:192.168.203.49@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789265532.994740:0:17228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83e9ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265533.003488:0:17228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17228:1876180417590784:192.168.203.49@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789265533.005684:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265533.006312:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399691904 00000100:00100000:3.0:1789265533.006327:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399691904 00000100:00100000:3.0:1789265533.006509:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 49 00000100:00100000:3.0:1789265533.006523:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+28:15657:x1876180399691904:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789265533.006561:0:17194:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789265533.006756:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+28:15657:x1876180399691904:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 Request processed in 236us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265533.006764:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 49 00000100:00080000:1.0:1789265533.007986:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265533.012198:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265533.012356:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399692032 00000100:00100000:1.0:1789265533.012371:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399692032 00000100:00100000:2.0:1789265533.012584:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 50 00000100:00100000:2.0:1789265533.012598:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+28:15657:x1876180399692032:12345-192.168.203.49@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789265533.012706:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97ea6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.012726:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97ea6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.012743:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97ea6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013377:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a97ead lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013412:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a97ead lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013424:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a97ead lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013456:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97eb4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013465:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013471:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265533.013521:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789265533.013526:0:17192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265533.013542:0:17192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013554:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97ea6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013561:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97ea6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013567:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97ea6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013574:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265533.013578:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97ea6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013755:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97ea6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013769:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fcc8b0c6f00) 00010000:00010000:2.0:1789265533.013772:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265533.013778:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97ea6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013785:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490400/0x9272d942b4a97ea6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013803:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a97ead lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013810:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a97ead lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013815:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a97ead lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013819:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265533.013822:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a97ead lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013827:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a97ead lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013833:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9fcb83b85600) 00010000:00010000:2.0:1789265533.013836:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265533.013838:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a97ead lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013854:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490200/0x9272d942b4a97ead lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013870:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013876:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97eb4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013881:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97eb4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013885:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265533.013887:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97eb4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013893:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97eb4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013900:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fcc8b0c6200) 00010000:00010000:2.0:1789265533.013902:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265533.013905:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97eb4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.013911:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97eb4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265533.014009:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+28:15657:x1876180399692032:12345-192.168.203.49@tcp:34:lhsmtool_posix.0 Request processed in 1411us (1823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265533.014020:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 50 00000100:00100000:0.0:1789265533.029311:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265533.030472:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399692288 00000100:00100000:2.0:1789265533.030490:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399692288 00000100:00100000:2.0:1789265533.030706:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 51 00000100:00100000:2.0:1789265533.030720:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:befb0935-501c-4d01-87d3-564eb87bef45+28:15657:x1876180399692288:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265533.030748:0:19245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265533.030773:0:19245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97ebb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc2dd expref: -99 pid: 19245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.030908:0:19245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97ec2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.030928:0:19245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.030942:0:19245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265533.030956:0:19245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789265533.031082:0:19245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.031090:0:19245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97ec2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.031097:0:19245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.031103:0:19245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265533.031108:0:19245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.031116:0:19245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97ec2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.031152:0:19245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fcc8b0c6200) 00010000:00010000:2.0:1789265533.031155:0:19245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789265533.031162:0:19245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97ec2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.031169:0:19245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97ec2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.031218:0:19245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97ebb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2dd expref: 30 pid: 19245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.031228:0:19245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fcc8b0c6f00) 00010000:00010000:2.0:1789265533.031231:0:19245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265533.031235:0:19245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97ebb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2dd expref: 30 pid: 19245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.031245:0:19245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2e600, rc 0) 00000100:00100000:2.0:1789265533.031687:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:befb0935-501c-4d01-87d3-564eb87bef45+29:15657:x1876180399692288:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 967us (5022us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1789265533.031696:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 51 00000100:00100000:0.0:1789265533.045906:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265533.046054:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399692416 00000100:00100000:1.0:1789265533.046069:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399692416 00000100:00100000:1.0:1789265533.046143:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 52 00000100:00100000:1.0:1789265533.046154:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:befb0935-501c-4d01-87d3-564eb87bef45+29:15657:x1876180399692416:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789265533.046204:0:17193:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789265533.046498:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:befb0935-501c-4d01-87d3-564eb87bef45+29:15657:x1876180399692416:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 Request processed in 344us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265533.046510:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 52 00000100:00100000:0.0:1789265533.055297:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265533.055426:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399692672 00000100:00100000:3.0:1789265533.055439:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399692672 00000100:00100000:3.0:1789265533.055526:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 53 00000100:00100000:3.0:1789265533.055537:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+29:15657:x1876180399692672:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265533.055565:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265533.055593:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a97ed0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc2e4 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789265533.056191:0:17194:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:3.0:1789265533.056200:0:17194:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:3.0:1789265533.056223:0:17194:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:3.0:1789265533.056397:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97ed7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.056415:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.056449:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.056527:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a97ed0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2e4 expref: 32 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.056550:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2e4 expref: 31 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.056560:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fcc8b0c6000) 00010000:00010000:3.0:1789265533.056564:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265533.056568:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f53400, rc 0) 00000100:00100000:3.0:1789265533.056656:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+31:15657:x1876180399692672:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 1120us (1375us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1789265533.056665:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 53 00000100:00100000:3.0:1789265533.060455:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265533.060552:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399692928 00000100:00100000:2.0:1789265533.060564:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399692928 00000100:00100000:2.0:1789265533.060660:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 54 00000100:00100000:2.0:1789265533.060673:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+31:15657:x1876180399692928:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789265533.060752:0:17192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265533.060788:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97ed7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2e4 expref: 31 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.060834:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fcc8b0c6000) 00010000:00010000:2.0:1789265533.060849:0:17192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265533.060913:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97ee5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.060929:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97ee5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.060940:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97ee5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.060957:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97eec lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x236054ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.060965:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97eec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x236054ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.060972:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97eec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x236054ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.061075:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97ee5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.061083:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97ee5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.061091:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97ee5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.061097:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265533.061103:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97ee5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.061120:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97ee5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.061130:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fcb83b85000) 00010000:00010000:2.0:1789265533.061132:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265533.061136:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97ee5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.061142:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e600/0x9272d942b4a97ee5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.061152:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97eec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x236054ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.061158:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97eec lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x236054ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.061174:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97eec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x236054ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.061180:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265533.061182:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97eec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x236054ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.061189:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97eec lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x236054ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.061196:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x236054ee (ffff9fcb83b85600) 00010000:00010000:2.0:1789265533.061200:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265533.061203:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97eec lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x236054ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.061219:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97eec lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x236054ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265533.061315:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+30:15657:x1876180399692928:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 Request processed in 644us (871us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789265533.061323:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 54 00000100:00100000:0.0:1789265533.064785:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265533.064890:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399693056 00000100:00100000:3.0:1789265533.064902:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399693056 00000100:00100000:3.0:1789265533.064972:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 55 00000100:00100000:3.0:1789265533.064983:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+30:15657:x1876180399693056:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265533.065007:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265533.065067:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a97ef3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc2eb expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.065113:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97efa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.065150:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97efa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.065172:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97efa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.065307:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a97ef3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2eb expref: 32 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.065329:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97efa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2eb expref: 31 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.065338:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fcc8b0c6600) 00010000:00010000:3.0:1789265533.065340:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789265533.065344:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f52c00, rc 0) 00000100:00100000:3.0:1789265533.065412:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+31:15657:x1876180399693056:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 431us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265533.065421:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 55 00000100:00100000:0.0:1789265533.069157:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265533.069337:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399693312 00000100:00100000:2.0:1789265533.069349:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399693312 00000100:00100000:2.0:1789265533.069416:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 56 00000100:00100000:2.0:1789265533.069431:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+31:15657:x1876180399693312:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789265533.069564:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f01 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.069584:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.069598:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265533.069831:0:17192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1789265533.069855:0:17192:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 584299831377ns, next at 585299828140ns, rc = 0 00000004:00010000:2.0:1789265533.069914:0:17192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b81d853 reply state 00000000323e8128 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.069929:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.069936:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fcc8b0c6600) 00010000:00010000:2.0:1789265533.069948:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789265533.069953:0:17192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265533.070106:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+33:15657:x1876180399693312:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 Request processed in 678us (962us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1789265533.070115:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 56 00000100:00100000:0.0:1789265533.078814:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265533.078987:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399693440 00000100:00100000:3.0:1789265533.079000:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399693440 00000100:00100000:3.0:1789265533.079116:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 57 00000100:00100000:3.0:1789265533.079130:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+33:15657:x1876180399693440:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265533.079160:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265533.079195:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a97f08 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc2f2 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.079271:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a97f08 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2f2 expref: 34 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.079307:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a97f08 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2f2 expref: 34 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.079331:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fcc8b0c6600) 00010000:00010000:3.0:1789265533.079334:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789265533.079339:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f53e00, rc 0) 00000100:00100000:3.0:1789265533.079406:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+34:15657:x1876180399693440:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 280us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265533.079414:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 57 00000100:00100000:0.0:1789265533.086620:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265533.086831:0:19247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399693568 00000100:00100000:2.0:1789265533.086959:0:19247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399693568 00000100:00100000:2.0:1789265533.087115:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 20 00000100:00100000:2.0:1789265533.087128:0:19247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:befb0935-501c-4d01-87d3-564eb87bef45+5:2396:x1876180399693568:12345-192.168.203.49@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789265533.087471:0:19247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:befb0935-501c-4d01-87d3-564eb87bef45+6:2396:x1876180399693568:12345-192.168.203.49@tcp:2:lhsmtool_posix.0 Request processed in 345us (1037us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789265533.087480:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 20 00000100:00100000:0.0:1789265533.090570:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265533.090688:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399693824 00000100:00100000:2.0:1789265533.090700:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399693824 00000100:00100000:2.0:1789265533.090762:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 9 00000100:00100000:2.0:1789265533.090774:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:befb0935-501c-4d01-87d3-564eb87bef45+34:15657:x1876180399693824:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789265533.091381:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:befb0935-501c-4d01-87d3-564eb87bef45+35:15657:x1876180399693824:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 Request processed in 606us (821us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1789265533.091390:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 9 00000100:00080000:1.0:1789265533.091807:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265533.095338:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265533.095500:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399694080 00000100:00100000:2.0:1789265533.095513:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399694080 00000100:00100000:2.0:1789265533.095578:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 58 00000100:00100000:2.0:1789265533.095590:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+35:15657:x1876180399694080:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789265533.095744:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+35:15657:x1876180399694080:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 Request processed in 156us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265533.095752:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 58 00000100:00100000:0.0:1789265533.099281:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265533.099367:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399694208 00000100:00100000:3.0:1789265533.099379:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399694208 00000100:00100000:3.0:1789265533.099495:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 59 00000100:00100000:3.0:1789265533.099507:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+35:15657:x1876180399694208:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265533.099542:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265533.099615:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53800/0x9272d942b4a97f0f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc2f9 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.099719:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97f16 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.099737:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97f16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.099750:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97f16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265533.099830:0:17194:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265533.100213:0:17194:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97f16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.100249:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53800/0x9272d942b4a97f0f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2f9 expref: 37 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.100270:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97f16 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2f9 expref: 36 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.100280:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fcc8b0c6600) 00010000:00010000:3.0:1789265533.100282:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789265533.100287:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f53400, rc 0) 00000100:00100000:3.0:1789265533.100370:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+36:15657:x1876180399694208:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 865us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265533.100379:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 59 00000100:00100000:0.0:1789265533.103810:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265533.103906:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399694336 00000100:00100000:3.0:1789265533.103920:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399694336 00000100:00100000:3.0:1789265533.104007:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 21 00000100:00100000:3.0:1789265533.104020:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa291f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:befb0935-501c-4d01-87d3-564eb87bef45+6:2396:x1876180399694336:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265533.104066:0:18700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265533.104095:0:18700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a9e1b3c/0x9272d942b4a97f1d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc300 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265533.104129:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa6067d, blocks: 0x0 00010000:00010000:3.0:1789265533.104156:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1789265533.104190:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265533.104202:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a9e1b3c/0x9272d942b4a97f1d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc300 expref: 7 pid: 18700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.104228:0:18700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a9e1b3c/0x9272d942b4a97f1d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc300 expref: 7 pid: 18700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.104245:0:18700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6e00, rc 0) 00000100:00100000:3.0:1789265533.104367:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa291f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:befb0935-501c-4d01-87d3-564eb87bef45+7:2396:x1876180399694336:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 349us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265533.104374:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 21 00000100:00100000:0.0:1789265533.108422:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265533.108527:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399694592 00000100:00100000:2.0:1789265533.108540:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399694592 00000100:00100000:2.0:1789265533.108611:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 60 00000100:00100000:2.0:1789265533.108631:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+36:15657:x1876180399694592:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789265533.109004:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+36:15657:x1876180399694592:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 Request processed in 383us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265533.109013:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 60 00000100:00100000:1.0:1789265533.114069:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265533.114350:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399694720 00000100:00100000:2.0:1789265533.114364:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399694720 00000100:00100000:2.0:1789265533.114443:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 61 00000100:00100000:2.0:1789265533.114455:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:befb0935-501c-4d01-87d3-564eb87bef45+36:15657:x1876180399694720:12345-192.168.203.49@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789265533.120979:0:17172:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1789265533.120993:0:17172:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789265533.121094:0:17172:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:2.0:1789265533.121131:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a97d56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.121150:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a97d56 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.121158:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a97d56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.121164:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265533.121169:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a97d56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.121179:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a97d56 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.121200:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fcb83b85c00) 00010000:00010000:2.0:1789265533.121204:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265533.121227:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a97d56 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.121230:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97daa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.121234:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2e200/0x9272d942b4a97d56 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.121239:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97daa lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.121244:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97daa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.121248:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265533.121261:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97d5d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.121267:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97d5d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.121273:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97d5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265533.121411:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417590912:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789265533.121503:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265533.121862:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417590912 00000100:00100000:1.0:1789265533.121873:0:19582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417590912 00000100:00100000:1.0:1789265533.121956:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789265533.121967:0:19582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417590912:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789265533.122152:0:19582:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789265533.122156:0:19582:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789265533.122166:0:19582:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789265533.122168:0:19582:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789265533 -> 1789265533 00002000:00010000:1.0:1789265533.122171:0:19582:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789265533.122224:0:19582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180417590912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 258us (721us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789265533.122232:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:1.0:1789265533.122281:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fcb8286a680/2, rc 0, transno 8589934596 00000100:00100000:1.0:1789265533.122287:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417590912:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1789265533.122411:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789265533.122966:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97daa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.122983:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97daa lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.123003:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fcb83b85000) 00010000:00010000:3.0:1789265533.123005:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1789265533.123048:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97daa lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.123057:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97daa lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265533.124361:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:befb0935-501c-4d01-87d3-564eb87bef45+19:15657:x1876180399694720:12345-192.168.203.49@tcp:44:lhsmtool_posix.0 Request processed in 9895us (10294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265533.124378:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 61 00000100:00100000:3.0:1789265533.127567:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265533.127989:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399694848 00000100:00100000:1.0:1789265533.128002:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399694848 00000100:00100000:1.0:1789265533.128092:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23 00000100:00100000:1.0:1789265533.128105:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:befb0935-501c-4d01-87d3-564eb87bef45+7:2395:x1876180399694848:12345-192.168.203.49@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789265533.128237:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:befb0935-501c-4d01-87d3-564eb87bef45+7:2395:x1876180399694848:12345-192.168.203.49@tcp:16:lhsmtool_posix.0 Request processed in 135us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265533.128245:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23 00010000:00010000:2.0:1789265533.130409:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2fa00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265533.130429:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97d5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.130447:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97d5d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.130472:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fcb83b85000) 00010000:00010000:2.0:1789265533.130475:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265533.130482:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97d5d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.130490:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fa00/0x9272d942b4a97d5d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.130520:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52800/0x9272d942b4a97e05 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.130551:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52800/0x9272d942b4a97e05 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.130559:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52800/0x9272d942b4a97e05 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.130565:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f52800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265533.130568:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52800/0x9272d942b4a97e05 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.130575:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52800/0x9272d942b4a97e05 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.130584:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9fcc8b0c6500) 00010000:00010000:2.0:1789265533.130587:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265533.130590:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52800/0x9272d942b4a97e05 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.130596:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52800/0x9272d942b4a97e05 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.130633:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52e00/0x9272d942b4a97e8a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.130640:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52e00/0x9272d942b4a97e8a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.130647:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52e00/0x9272d942b4a97e8a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.130653:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f52e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265533.130779:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52e00/0x9272d942b4a97e8a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.130791:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52e00/0x9272d942b4a97e8a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.130799:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fcc8b0c6200) 00010000:00010000:2.0:1789265533.130802:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265533.130805:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52e00/0x9272d942b4a97e8a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.130811:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52e00/0x9272d942b4a97e8a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.130824:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.130831:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f01 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.130837:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.130843:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265533.130845:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.130851:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f01 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.130858:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fcc8b0c6600) 00010000:00010000:2.0:1789265533.130860:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789265533.130870:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f01 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.130876:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f01 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265533.134949:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265533.138723:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399695104 00000100:00100000:0.0:1789265533.138746:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399695104 00000100:00100000:0.0:1789265533.138836:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 62 00000100:00100000:0.0:1789265533.138849:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:befb0935-501c-4d01-87d3-564eb87bef45+15:15657:x1876180399695104:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789265533.138936:0:17193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265533.138971:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53400/0x9272d942b4a97f16 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2f9 expref: 15 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.138998:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fcc8b0c6600) 00010000:00010000:0.0:1789265533.139004:0:17193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265533.139091:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a97f24 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.139109:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a97f24 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.139122:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a97f24 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789265533.139275:0:17193:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0810d21 reply state 000000001b6e73b9 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a97f24 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.139290:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a97f24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.139297:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fcc8b0c6600) 00010000:00010000:0.0:1789265533.139300:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789265533.139303:0:17193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789265533.139465:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:befb0935-501c-4d01-87d3-564eb87bef45+16:15657:x1876180399695104:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 Request processed in 618us (4528us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1789265533.139474:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 62 00000100:00100000:3.0:1789265533.143365:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265533.143449:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399695232 00000100:00100000:2.0:1789265533.143469:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399695232 00000100:00100000:3.0:1789265533.143609:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24 00000100:00100000:3.0:1789265533.143748:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:befb0935-501c-4d01-87d3-564eb87bef45+7:2395:x1876180399695232:12345-192.168.203.49@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789265533.144326:0:18702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789265533.144330:0:18702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789265532 00002000:00010000:3.0:1789265533.144333:0:18702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789265532 00002000:00010000:3.0:1789265533.144335:0:18702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789265533 -> 1789265532 00002000:00010000:3.0:1789265533.144337:0:18702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789265533.144455:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:befb0935-501c-4d01-87d3-564eb87bef45+8:2395:x1876180399695232:12345-192.168.203.49@tcp:2:lhsmtool_posix.0 Request processed in 834us (1097us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789265533.144463:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24 00000100:00100000:1.0:1789265533.152166:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265533.152247:0:19247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399695360 00000100:00100000:2.0:1789265533.152265:0:19247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399695360 00000100:00100000:2.0:1789265533.152346:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 25 00000100:00100000:2.0:1789265533.152358:0:19247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:befb0935-501c-4d01-87d3-564eb87bef45+8:2395:x1876180399695360:12345-192.168.203.49@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789265533.152420:0:19247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a97f2b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.152441:0:19247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265533.152446:0:19247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265533.152454:0:19247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a97f2b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.152470:0:19247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a97f2b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.152506:0:19247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a97f2b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.152515:0:19247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a97f2b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.152544:0:19247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a97f2b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.152552:0:19247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f200 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265533.152557:0:19247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a97f2b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.152566:0:19247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a97f2b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.152585:0:19247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a97f2b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.152594:0:19247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a97f2b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265533.152715:0:19247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:befb0935-501c-4d01-87d3-564eb87bef45+8:2395:x1876180399695360:12345-192.168.203.49@tcp:1:lhsmtool_posix.0 Request processed in 358us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265533.152724:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 25 00000100:00100000:1.0:1789265533.156812:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265533.156916:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399695616 00000100:00100000:0.0:1789265533.156933:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399695616 00000100:00100000:0.0:1789265533.157074:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 63 00000100:00100000:0.0:1789265533.157088:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+16:15657:x1876180399695616:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789265533.159843:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97f32 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265533.159885:0:17194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97e83 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2c8 expref: 16 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265533.159895:0:17194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97f32 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265533.159945:0:17194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97e83 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2c8 expref: 16 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265533.159975:0:17194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97e83 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2c8 expref: 16 pid: 17193 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265533.159990:0:17194:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91422300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17194:1876180417591040:192.168.203.49@tcp:104: 00000100:00100000:1.0:1789265533.160142:0:17194:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83e9c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789265533.166314:0:17194:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91422300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17194:1876180417591040:192.168.203.49@tcp:104: 00010000:00010000:3.0:1789265533.166345:0:17194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97f32 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265533.167718:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265533.171007:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399695744 00000100:00100000:0.0:1789265533.171101:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399695744 00010000:00010000:0.0:1789265533.171293:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97e83 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2c8 expref: 17 pid: 17193 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265533.171338:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 19 00000100:00100000:0.0:1789265533.171348:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91420700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:befb0935-501c-4d01-87d3-564eb87bef45+17:2396:x1876180399695744:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265533.171364:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265533.171371:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97e83 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2c8 expref: 17 pid: 17193 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.171384:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97e83 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2c8 expref: 17 pid: 17193 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.171407:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4a00/0x9272d942b4a97e83 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2c8 expref: 17 pid: 17193 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.171425:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fcc8b0c6200) 00010000:00010000:0.0:1789265533.171432:0:17179:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a97e9f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2d6 expref: 16 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.171462:0:17179:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97f32 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.171470:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97f32 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.171477:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97f32 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.171579:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265533.171676:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91420700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:befb0935-501c-4d01-87d3-564eb87bef45+16:2396:x1876180399695744:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 329us (3963us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265533.171685:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 19 00010000:00010000:3.0:1789265533.175392:0:17194:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97f32 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.175428:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97f32 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.175830:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f39 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.175850:0:17194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a97f08 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2f2 expref: 16 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.175872:0:17194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f39 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.176308:0:17194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a97f08 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2f2 expref: 16 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.176325:0:17194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a97f08 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2f2 expref: 16 pid: 17194 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265533.176339:0:17194:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d24380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17194:1876180417591168:192.168.203.49@tcp:104: 00000100:00100000:2.0:1789265533.176440:0:17194:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83bed6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265533.180320:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265533.180480:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399695872 00000100:00100000:3.0:1789265533.180489:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399695872 00010000:00010000:3.0:1789265533.180542:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a97f08 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2f2 expref: 17 pid: 17194 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265533.180587:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 20 00000100:00100000:3.0:1789265533.180598:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91421f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:befb0935-501c-4d01-87d3-564eb87bef45+17:2396:x1876180399695872:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265533.180612:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265533.180619:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a97f08 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2f2 expref: 17 pid: 17194 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.180643:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a97f08 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2f2 expref: 17 pid: 17194 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.180665:0:17177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fcc8b0c6600) 00010000:00010000:3.0:1789265533.180670:0:17177:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f39 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.180679:0:17177:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f39 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.180686:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f39 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.180704:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265533.180780:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91421f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:befb0935-501c-4d01-87d3-564eb87bef45+17:2396:x1876180399695872:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 184us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265533.180789:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 20 00010000:00010000:2.0:1789265533.181440:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f53e00/0x9272d942b4a97f08 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2f2 expref: 16 pid: 17194 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265533.181459:0:17194:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d24380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17194:1876180417591168:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265533.181479:0:17194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f39 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.181488:0:17194:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f39 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.181493:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f39 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265533.181602:0:17194:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1789265533.181729:0:17194:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1789265533.181919:0:17194:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1789265533.182402:0:17194:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d24380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17194:1876180417591296:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789265533.182455:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265533.182489:0:17194:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c27900 going to sleep for 11 seconds 00000100:00100000:1.0:1789265533.182580:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417591296 00000100:00100000:1.0:1789265533.182586:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417591296 00000100:00100000:1.0:1789265533.182642:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789265533.182651:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17194:x1876180417591296:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789265533.182751:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17194:x1876180417591296:12345-0@lo:1000:mdt00_002.0 Request processed in 101us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265533.182759:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789265533.183723:0:17194:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d24380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17194:1876180417591296:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789265533.183939:0:17194:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1789265533.184004:0:17194:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82869500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17194:1876180417591424:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789265533.184518:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265533.184591:0:17194:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265533.184680:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417591424 00000100:00100000:1.0:1789265533.184688:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417591424 00000100:00100000:1.0:1789265533.184823:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789265533.184833:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17194:x1876180417591424:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789265533.184999:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17194:x1876180417591424:12345-0@lo:1000:mdt00_002.0 Request processed in 167us (481us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1789265533.185008:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789265533.185102:0:17194:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82869500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17194:1876180417591424:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789265533.185141:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f39 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.185151:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f39 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.185159:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f39 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.185175:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265533.185180:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f39 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.185188:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f39 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.185204:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fcc8b0c6600) 00010000:00010000:3.0:1789265533.185207:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789265533.185212:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f39 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.185233:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2f200/0x9272d942b4a97f39 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.185269:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52400/0x9272d942b4a97e98 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.185276:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52400/0x9272d942b4a97e98 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.185283:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52400/0x9272d942b4a97e98 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.185288:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f52400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265533.185291:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52400/0x9272d942b4a97e98 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.185297:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52400/0x9272d942b4a97e98 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.185305:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fcc8b0c6200) 00010000:00010000:3.0:1789265533.185307:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789265533.185313:0:17194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a97e9f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2d6 expref: 19 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.185324:0:17194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a97e9f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2d6 expref: 19 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.185334:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a97e9f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2d6 expref: 19 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.185401:0:17194:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a97e9f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2d6 expref: 19 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265533.185414:0:17194:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf608e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17194:1876180417591552:192.168.203.49@tcp:105: 00000100:00100000:3.0:1789265533.185492:0:17194:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83bed240 going to sleep for 11 seconds 00000100:00100000:3.0:1789265533.190136:0:17194:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf608e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17194:1876180417591552:192.168.203.49@tcp:105: 00010000:00010000:3.0:1789265533.190171:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52400/0x9272d942b4a97e98 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.190182:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52400/0x9272d942b4a97e98 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.190298:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a97f40 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.190311:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a97f40 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.190323:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a97f40 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.190333:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a97f40 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.190339:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a97f40 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.190345:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a97f40 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.190367:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265533.190371:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a97f40 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.190377:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a97f40 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.190389:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fcc8b0c6200) 00010000:00010000:0.0:1789265533.190392:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265533.190395:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a97f40 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.190401:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4800/0x9272d942b4a97f40 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.190413:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97f32 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.190419:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97f32 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.190425:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97f32 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.190430:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265533.190433:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97f32 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.190439:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97f32 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.190458:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fcc8b0c6200) 00010000:00010000:0.0:1789265533.190460:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789265533.190463:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97f32 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.190470:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ff800/0x9272d942b4a97f32 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265533.190703:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+19:15657:x1876180399695616:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 Request processed in 33616us (33899us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1789265533.190713:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 63 00000020:00080000:0.0:1789265533.190719:0:17194:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789265533.191800:0:17228:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789265533.191807:0:17228:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789265533.191834:0:17228:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789265533.191840:0:17228:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789265533.194175:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265533.194315:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399696000 00000100:00100000:3.0:1789265533.194325:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399696000 00000100:00100000:3.0:1789265533.194379:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 10 00000100:00100000:3.0:1789265533.194389:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad8fec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:befb0935-501c-4d01-87d3-564eb87bef45+19:15656:x1876180399696000:12345-192.168.203.49@tcp:49:dd.0 00000100:00100000:3.0:1789265533.194508:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad8fec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:befb0935-501c-4d01-87d3-564eb87bef45+19:15656:x1876180399696000:12345-192.168.203.49@tcp:49:dd.0 Request processed in 120us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265533.194516:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 10 00000100:00100000:2.0:1789265533.195811:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265533.198805:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399696256 00000100:00100000:3.0:1789265533.198820:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399696256 00000100:00100000:3.0:1789265533.207290:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265533.207481:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399696384 00000100:00100000:1.0:1789265533.207492:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399696384 00000100:00100000:1.0:1789265533.207550:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 64 00000100:00100000:1.0:1789265533.207560:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+20:15656:x1876180399696384:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:1.0:1789265533.207581:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265533.207600:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a97f47 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc307 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265533.207650:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97f4e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265533.207663:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97f4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265533.207674:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97f4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265533.207802:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2ffa00/0x9272d942b4a97f47 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc307 expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265533.207821:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97f4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc307 expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265533.207830:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fcc8b0c6200) 00010000:00010000:1.0:1789265533.207833:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789265533.207837:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fea00, rc 0) 00000100:00100000:1.0:1789265533.207895:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+21:15656:x1876180399696384:12345-192.168.203.49@tcp:101:dd.0 Request processed in 337us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265533.207903:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 64 00000100:00100000:3.0:1789265533.213317:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 11 00000100:00100000:3.0:1789265533.213334:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:befb0935-501c-4d01-87d3-564eb87bef45+20:15657:x1876180399696256:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789265533.213579:0:17196:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789265533.213635:0:17196:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1789265533.213686:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97f55 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.213712:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97f55 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.213722:0:17196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97f55 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.213731:0:17196:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97f55 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.213738:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97f55 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.213744:0:17196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97f55 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.213763:0:17196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265533.213801:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265533.213810:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97f55 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265533.213818:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6000 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265533.213823:0:19586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97f55 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265533.213831:0:19586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97f55 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265533.213846:0:19586:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fcc8b0c6600) 00010000:00010000:1.0:1789265533.213849:0:19586:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789265533.213853:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97f55 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265533.213858:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:befb0935-501c-4d01-87d3-564eb87bef45+22:15657:x1876180399696256:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 Request processed in 528us (18049us total) trans 8589934622 rc 0/0 00010000:00010000:1.0:1789265533.213867:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a97f55 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265533.213872:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 11 00000020:00080000:3.0:1789265533.213879:0:17196:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789265533.213886:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265533.213889:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265533.213892:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265533.321975:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265533.323717:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399696512 00000100:00100000:2.0:1789265533.323730:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399696512 00000100:00100000:2.0:1789265533.323816:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 0 00000100:00100000:2.0:1789265533.323829:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:befb0935-501c-4d01-87d3-564eb87bef45+8:2394:x1876180399696512:12345-192.168.203.49@tcp:4:dd.0 00010000:00010000:2.0:1789265533.323885:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008efefd8/0x9272d942b4a97f5c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.323906:0:18705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a9e1b3c/0x9272d942b4a97f1d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc300 expref: 8 pid: 18700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.323915:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265533.323920:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265533.323924:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008efefd8/0x9272d942b4a97f5c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.324018:0:18705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a9e1b3c/0x9272d942b4a97f1d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc300 expref: 8 pid: 18700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.324099:0:18705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a9e1b3c/0x9272d942b4a97f1d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc300 expref: 8 pid: 18700 timeout: 684 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265533.324141:0:18705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d25880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18705:1876180417591680:192.168.203.49@tcp:104: 00000100:00100000:3.0:1789265533.324408:0:18705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc8a6c0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265533.324595:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265533.325095:0:18707:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789265533.325108:0:18707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1789265533.327548:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399696640 00000100:00100000:1.0:1789265533.327565:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399696640 00000100:00100000:1.0:1789265533.328951:0:18705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d25880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18705:1876180417591680:192.168.203.49@tcp:104: 00010000:00010000:1.0:1789265533.328991:0:18705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000008efefd8/0x9272d942b4a97f5c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265533.329598:0:20335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1 00000100:00100000:2.0:1789265533.329618:0:20335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:befb0935-501c-4d01-87d3-564eb87bef45+9:2393:x1876180399696640:12345-192.168.203.49@tcp:4:dd.0 00010000:00010000:2.0:1789265533.329673:0:20335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97f63 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.329693:0:20335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265533.329703:0:20335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265533.329707:0:20335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97f63 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.329718:0:20335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97f63 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265533.330419:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265533.331009:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399696768 00000100:00100000:3.0:1789265533.331070:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399696768 00010000:00010000:3.0:1789265533.331137:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a9e1b3c/0x9272d942b4a97f1d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc300 expref: 10 pid: 18700 timeout: 684 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265533.331302:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 21 00000100:00100000:3.0:1789265533.331314:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa292d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:befb0935-501c-4d01-87d3-564eb87bef45+10:2396:x1876180399696768:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265533.331332:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265533.331361:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a9e1b3c/0x9272d942b4a97f1d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc300 expref: 10 pid: 18700 timeout: 684 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.331377:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a9e1b3c/0x9272d942b4a97f1d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc300 expref: 10 pid: 18700 timeout: 684 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.331406:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a9e1b3c/0x9272d942b4a97f1d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc300 expref: 10 pid: 18700 timeout: 684 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.331428:0:17179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265533.331432:0:17179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265533.331439:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008efefd8/0x9272d942b4a97f5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.331470:0:17179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008efefd8/0x9272d942b4a97f5c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.331483:0:17179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265533.331487:0:17179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265533.331491:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97f63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.331499:0:17179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97f63 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265533.331546:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265533.331574:0:20335:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97f63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265533.331593:0:20335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97f63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265533.331756:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa292d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:befb0935-501c-4d01-87d3-564eb87bef45+9:2396:x1876180399696768:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 442us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265533.331767:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 21 00010000:00010000:1.0:1789265533.332067:0:18705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000008efefd8/0x9272d942b4a97f5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265533.332092:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008efefd8/0x9272d942b4a97f5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789265533.419834:0:19514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:0.0:1789265533.419852:0:19514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:1.0:1789265533.420070:0:20335:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:1.0:1789265533.420075:0:20335:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1789265532 -> 1789265534 00002000:00010000:1.0:1789265533.420077:0:20335:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789265532 -> 1789265534 00002000:00010000:1.0:1789265533.420080:0:20335:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:1.0:1789265533.420097:0:20335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97f63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265533.420110:0:20335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97f63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265533.420120:0:20335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97f63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265533.420127:0:20335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e000 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265533.420132:0:20335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97f63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265533.420142:0:20335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97f63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265533.420162:0:20335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97f63 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265533.420193:0:20335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c01c3985/0x9272d942b4a97f63 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265533.420300:0:20335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:befb0935-501c-4d01-87d3-564eb87bef45+7:2393:x1876180399696640:12345-192.168.203.49@tcp:4:dd.0 Request processed in 90685us (95700us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789265533.420316:0:20335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1 00010000:00010000:0.0:1789265533.442507:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789265533.453648:0:19514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:1.0:1789265533.453821:0:18705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:1.0:1789265533.453841:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008efefd8/0x9272d942b4a97f5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265533.453853:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008efefd8/0x9272d942b4a97f5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265533.453863:0:18705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008efefd8/0x9272d942b4a97f5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265533.453872:0:18705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e600 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265533.453876:0:18705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008efefd8/0x9272d942b4a97f5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265533.453885:0:18705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008efefd8/0x9272d942b4a97f5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265533.453906:0:18705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008efefd8/0x9272d942b4a97f5c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265533.453930:0:18705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008efefd8/0x9272d942b4a97f5c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265533.454093:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:befb0935-501c-4d01-87d3-564eb87bef45+5:2394:x1876180399696512:12345-192.168.203.49@tcp:4:dd.0 Request processed in 130263us (132122us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1789265533.454104:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 0 00000100:00100000:0.0:1789265533.953536:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417591808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265533.953610:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265533.954041:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417591808 00000100:00100000:3.0:1789265533.954049:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417591808 00000100:00100000:3.0:1789265533.954105:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789265533.954115:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417591808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265533.954145:0:17934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1789265533.954194:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417591808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265533.954201:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789265533.954551:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417591808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265533.954571:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265533.954579:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417591936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265533.954610:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265533.954971:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265533.954983:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417592064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265533.955015:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265533.955126:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417592064 00000100:00100000:0.0:1789265533.955132:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417592064 00000100:00100000:0.0:1789265533.955171:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789265533.955192:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417592064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789265533.955225:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789265533.955270:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417592064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265533.955277:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789265533.955395:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417592064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265533.955496:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417591936 00000100:00100000:3.0:1789265533.955501:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417591936 00000100:00100000:3.0:1789265533.955554:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789265533.955571:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417591936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789265533.955590:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789265533.955650:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417591936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265533.955657:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789265533.955724:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417591936:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789265533.956100:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789265534.465661:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265534.465975:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417592192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265534.466075:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265534.466307:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265534.466317:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417592320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265534.466347:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265534.466379:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417592192 00000100:00100000:2.0:1789265534.466386:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417592192 00000100:00100000:2.0:1789265534.466429:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417592320 00000100:00100000:2.0:1789265534.466432:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417592320 00000100:00100000:2.0:1789265534.466465:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789265534.466473:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417592192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265534.466499:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:2.0:1789265534.466550:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417592192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265534.466558:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789265534.466575:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789265534.466582:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417592320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789265534.466605:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:2.0:1789265534.466648:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417592320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265534.466654:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1789265534.466670:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265534.466712:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417592320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265534.466739:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1789265534.466744:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fcb8286a680, transno 8589934596 00000004:00080000:2.0:1789265534.466755:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1789265534.466773:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417592192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265534.467402:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417592704:0@lo:400:kworker.0 00000100:00100000:1.0:1789265534.467445:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265534.467470:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91423100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417593216:0@lo:400:kworker.0 00000100:00100000:1.0:1789265534.467493:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265534.467514:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789265534.467520:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a57aa04c-0472-45c4-bafc-6983957e249b:3642:1876180417592576:0@lo:400:kworker.0 00000100:00100000:1.0:1789265534.467545:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265534.467569:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417593088:0@lo:400:kworker.0 00000100:00100000:1.0:1789265534.467587:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265534.467625:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417592704 00000100:00100000:1.0:1789265534.467630:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417592704 00000100:00100000:3.0:1789265534.467775:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417592832:0@lo:400:kworker.0 00000100:00100000:3.0:1789265534.467805:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265534.467824:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417593344:0@lo:400:kworker.0 00000100:00100000:3.0:1789265534.467843:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265534.467861:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789265534.467867:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417592448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265534.467965:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265534.467981:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417592960:0@lo:400:kworker.0 00000100:00100000:3.0:1789265534.468000:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265534.468010:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417593472:0@lo:400:kworker.0 00000100:00100000:3.0:1789265534.468054:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265534.468075:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417593216 00000100:00100000:3.0:1789265534.468079:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417593216 00000100:00100000:3.0:1789265534.468102:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417593088 00000100:00100000:3.0:1789265534.468105:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417593088 00000100:00100000:3.0:1789265534.468115:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417592832 00000100:00100000:3.0:1789265534.468117:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417592832 00000100:00100000:3.0:1789265534.468127:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417593344 00000100:00100000:3.0:1789265534.468139:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417593344 00000100:00100000:0.0:1789265534.468443:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417592960 00000100:00100000:0.0:1789265534.468447:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417592960 00000100:00100000:0.0:1789265534.468466:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417593472 00000100:00100000:0.0:1789265534.468468:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417593472 00000100:00100000:0.0:1789265534.468484:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789265534.468492:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417593216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265534.468539:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417593216:12345-0@lo:400:kworker.0 Request processed in 48us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265534.468546:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789265534.468559:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789265534.468564:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417593088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265534.468587:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417593088:12345-0@lo:400:kworker.0 Request processed in 24us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265534.468592:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789265534.468602:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789265534.468607:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417592832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265534.468646:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417592832:12345-0@lo:400:kworker.0 Request processed in 39us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265534.468652:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789265534.468663:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789265534.468669:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417593344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265534.468951:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789265534.468959:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417592960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265534.468992:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417592960:12345-0@lo:400:kworker.0 Request processed in 35us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265534.468998:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789265534.469013:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789265534.469019:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417593472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265534.469070:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417593472:12345-0@lo:400:kworker.0 Request processed in 51us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265534.469075:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789265534.469138:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789265534.469149:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417592704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265534.469285:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417593344:12345-0@lo:400:kworker.0 Request processed in 616us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265534.469292:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789265534.469331:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417592960:0@lo:400:kworker.0 00010000:00080000:0.0:1789265534.469345:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc91421180 x1876180417593472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265534.469355:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417593472:0@lo:400:kworker.0 00000100:00100000:0.0:1789265534.469366:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417592832:0@lo:400:kworker.0 00000100:00100000:0.0:1789265534.469377:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417593344:0@lo:400:kworker.0 00000100:00100000:0.0:1789265534.469441:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417593088:0@lo:400:kworker.0 00010000:00080000:0.0:1789265534.469452:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc91423100 x1876180417593216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265534.469461:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91423100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417593216:0@lo:400:kworker.0 00000100:00100000:2.0:1789265534.469541:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417592576 00000100:00100000:2.0:1789265534.469547:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417592576 00000100:00100000:2.0:1789265534.469585:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789265534.469592:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+24:3642:x1876180417592576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265534.469651:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+24:3642:x1876180417592576:12345-0@lo:400:kworker.0 Request processed in 59us (2104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265534.469658:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789265534.469792:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417592704:12345-0@lo:400:kworker.0 Request processed in 645us (2347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265534.469799:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1789265534.469830:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265534.469835:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265534.469838:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265534.469858:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417592448 00000100:00100000:1.0:1789265534.469861:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417592448 00000100:00100000:1.0:1789265534.470098:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789265534.470105:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417592448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265534.470121:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789265534.470598:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a57aa04c-0472-45c4-bafc-6983957e249b:3642:1876180417592576:0@lo:400:kworker.0 00000100:00100000:1.0:1789265534.470756:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417592448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 651us (2790us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265534.470764:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789265534.471094:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417592704:0@lo:400:kworker.0 00000100:00100000:2.0:1789265534.471396:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417592448:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1789265534.992732:0:20372:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000040:00080000:1.0:1789265535.233259:0:17228:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789265535.233269:0:17228:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789265535.233288:0:17228:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789265535.233296:0:17228:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789265535.489353:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265535.814442:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265535.814496:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265535.814536:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265535.814566:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265535.814585:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265535.814602:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265535.814632:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265535.814650:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265535.814671:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265535.814816:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399697152 00000100:00100000:1.0:1789265535.814826:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399697152 00000100:00100000:1.0:1789265535.814882:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399697664 00000100:00100000:1.0:1789265535.814886:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399697664 00000100:00100000:1.0:1789265535.814899:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399697024 00000100:00100000:1.0:1789265535.814901:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399697024 00000100:00100000:1.0:1789265535.814911:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399697536 00000100:00100000:1.0:1789265535.814913:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399697536 00000100:00100000:1.0:1789265535.814928:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 68 00000100:00100000:1.0:1789265535.814937:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:befb0935-501c-4d01-87d3-564eb87bef45+5:2393:x1876180399697152:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265535.815061:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:befb0935-501c-4d01-87d3-564eb87bef45+5:2393:x1876180399697152:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 124us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265535.815070:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 68 00000100:00100000:1.0:1789265535.815089:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 69 00000100:00100000:1.0:1789265535.815096:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2393:x1876180399697664:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265535.815122:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2393:x1876180399697664:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 27us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265535.815129:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 69 00000100:00100000:1.0:1789265535.815142:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 70 00000100:00100000:1.0:1789265535.815162:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:befb0935-501c-4d01-87d3-564eb87bef45+22:2393:x1876180399697024:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265535.815192:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:befb0935-501c-4d01-87d3-564eb87bef45+22:2393:x1876180399697024:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 44us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265535.815200:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 70 00000100:00100000:1.0:1789265535.815213:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 71 00000100:00100000:1.0:1789265535.815219:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:2393:x1876180399697536:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265535.815246:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:2393:x1876180399697536:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 27us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265535.815254:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 71 00000100:00100000:1.0:1789265535.815273:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399697408 00000100:00100000:1.0:1789265535.815277:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399697408 00000100:00100000:1.0:1789265535.815302:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399697920 00000100:00100000:1.0:1789265535.815306:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399697920 00000100:00100000:1.0:1789265535.815318:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399697280 00000100:00100000:1.0:1789265535.815321:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399697280 00000100:00100000:1.0:1789265535.815331:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399697792 00000100:00100000:1.0:1789265535.815340:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399697792 00000100:00100000:1.0:1789265535.815358:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 16 00000100:00100000:1.0:1789265535.815365:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc85b1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:befb0935-501c-4d01-87d3-564eb87bef45+5:2393:x1876180399697408:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265535.815393:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc85b1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:befb0935-501c-4d01-87d3-564eb87bef45+5:2393:x1876180399697408:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 29us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265535.815400:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 16 00000100:00100000:1.0:1789265535.815587:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 17 00000100:00100000:1.0:1789265535.815594:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2393:x1876180399697920:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265535.815634:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2393:x1876180399697920:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 40us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265535.815640:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 17 00000100:00100000:1.0:1789265535.815652:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 18 00000100:00100000:1.0:1789265535.815658:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:befb0935-501c-4d01-87d3-564eb87bef45+5:2393:x1876180399697280:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265535.815681:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:befb0935-501c-4d01-87d3-564eb87bef45+5:2393:x1876180399697280:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 23us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265535.815687:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 18 00000100:00100000:1.0:1789265535.815699:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 19 00000100:00100000:1.0:1789265535.815705:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2393:x1876180399697792:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265535.815727:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2393:x1876180399697792:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 23us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265535.815733:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 19 00000100:00080000:3.0:1789265535.816314:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789265535.816319:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265535.816321:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265535.816324:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265535.816394:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399696896 00000100:00100000:0.0:1789265535.816401:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399696896 00000100:00100000:0.0:1789265535.816450:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 167 00000100:00100000:0.0:1789265535.816683:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+13:2393:x1876180399696896:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265535.816733:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+13:2393:x1876180399696896:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 275us (2299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265535.816740:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 167 00010000:00010000:1.0:1789265536.513850:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 42437 lines, 42437 kept, 0 dropped, 0 bad.